-- Logs begin at Mon 2022-09-26 17:00:17 UTC, end at Mon 2022-09-26 18:18:02 UTC. -- Sep 26 17:40:51.894055 dv-cinder-859318-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 26 17:40:51.901964 dv-cinder-859318-1-smb devstack@keystone.service[81265]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 26 17:40:51.903956 dv-cinder-859318-1-smb devstack@keystone.service[81265]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 26 17:40:51 2022] *** Sep 26 17:40:51.903956 dv-cinder-859318-1-smb devstack@keystone.service[81265]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 26 17:40:51.903956 dv-cinder-859318-1-smb devstack@keystone.service[81265]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 26 17:40:51.903956 dv-cinder-859318-1-smb devstack@keystone.service[81265]: nodename: dv-cinder-859318-1-smb Sep 26 17:40:51.903956 dv-cinder-859318-1-smb devstack@keystone.service[81265]: machine: x86_64 Sep 26 17:40:51.903956 dv-cinder-859318-1-smb devstack@keystone.service[81265]: clock source: unix Sep 26 17:40:51.903956 dv-cinder-859318-1-smb devstack@keystone.service[81265]: pcre jit disabled Sep 26 17:40:51.904399 dv-cinder-859318-1-smb devstack@keystone.service[81265]: detected number of CPU cores: 4 Sep 26 17:40:51.904399 dv-cinder-859318-1-smb devstack@keystone.service[81265]: current working directory: / Sep 26 17:40:51.904399 dv-cinder-859318-1-smb devstack@keystone.service[81265]: detected binary path: /usr/bin/uwsgi-core Sep 26 17:40:51.904399 dv-cinder-859318-1-smb devstack@keystone.service[81265]: your processes number limit is 47680 Sep 26 17:40:51.904399 dv-cinder-859318-1-smb devstack@keystone.service[81265]: your memory page size is 4096 bytes Sep 26 17:40:51.904399 dv-cinder-859318-1-smb devstack@keystone.service[81265]: detected max file descriptor number: 2048 Sep 26 17:40:51.904399 dv-cinder-859318-1-smb devstack@keystone.service[81265]: lock engine: pthread robust mutexes Sep 26 17:40:51.904399 dv-cinder-859318-1-smb devstack@keystone.service[81265]: thunder lock: enabled Sep 26 17:40:51.904399 dv-cinder-859318-1-smb devstack@keystone.service[81265]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 26 17:40:51.904399 dv-cinder-859318-1-smb devstack@keystone.service[81265]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 26 17:40:51.944579 dv-cinder-859318-1-smb devstack@keystone.service[81265]: Python main interpreter initialized at 0x5624f20a99c0 Sep 26 17:40:51.944579 dv-cinder-859318-1-smb devstack@keystone.service[81265]: python threads support enabled Sep 26 17:40:51.944579 dv-cinder-859318-1-smb devstack@keystone.service[81265]: your server socket listen backlog is limited to 100 connections Sep 26 17:40:51.944579 dv-cinder-859318-1-smb devstack@keystone.service[81265]: your mercy for graceful operations on workers is 90 seconds Sep 26 17:40:51.944954 dv-cinder-859318-1-smb devstack@keystone.service[81265]: mapped 403077 bytes (393 KB) for 2 cores Sep 26 17:40:51.945048 dv-cinder-859318-1-smb devstack@keystone.service[81265]: *** Operational MODE: preforking *** Sep 26 17:40:51.945325 dv-cinder-859318-1-smb devstack@keystone.service[81265]: *** uWSGI is running in multiple interpreter mode *** Sep 26 17:40:51.945325 dv-cinder-859318-1-smb devstack@keystone.service[81265]: spawned uWSGI master process (pid: 81265) Sep 26 17:40:51.945533 dv-cinder-859318-1-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 26 17:40:51.947531 dv-cinder-859318-1-smb devstack@keystone.service[81265]: spawned uWSGI worker 1 (pid: 81277, cores: 1) Sep 26 17:40:51.947531 dv-cinder-859318-1-smb devstack@keystone.service[81265]: spawned uWSGI worker 2 (pid: 81278, cores: 1) Sep 26 17:40:51.947531 dv-cinder-859318-1-smb devstack@keystone.service[81265]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 26 17:40:56.223552 dv-cinder-859318-1-smb devstack@keystone.service[81277]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 17:40:56.223552 dv-cinder-859318-1-smb devstack@keystone.service[81277]: from cryptography.utils import int_from_bytes Sep 26 17:40:56.224376 dv-cinder-859318-1-smb devstack@keystone.service[81277]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 17:40:56.224376 dv-cinder-859318-1-smb devstack@keystone.service[81277]: from cryptography.utils import int_from_bytes Sep 26 17:40:56.226754 dv-cinder-859318-1-smb devstack@keystone.service[81278]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 17:40:56.226754 dv-cinder-859318-1-smb devstack@keystone.service[81278]: from cryptography.utils import int_from_bytes Sep 26 17:40:56.227272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 17:40:56.227272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: from cryptography.utils import int_from_bytes Sep 26 17:40:56.274588 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 26 17:40:56.274772 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 26 17:40:56.274951 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] command line args: [] {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 26 17:40:56.275226 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 26 17:40:56.275404 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ================================================================================ {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 26 17:40:56.275661 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] admin_token = **** {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.275911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] config_dir = [] {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.276099 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.276281 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] config_source = [] {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.276461 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] debug = True {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.276661 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.277854 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.277952 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 26 17:40:56.278022 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.278089 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 26 17:40:56.278153 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.278215 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] command line args: [] {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 26 17:40:56.278276 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.278337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 26 17:40:56.278403 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] list_limit = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.278464 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ================================================================================ {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 26 17:40:56.278526 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] log_config_append = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.278582 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] admin_token = **** {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.278654 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.278654 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] log_dir = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.278765 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] config_dir = [] {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.278821 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] log_file = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.278883 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.278883 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] config_source = [] {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.278988 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.279049 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] debug = True {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.279106 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.279168 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.279450 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.279557 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.279670 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.279781 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.279876 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.279987 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.280082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.280181 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.280286 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.280385 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] list_limit = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.280484 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.280590 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] log_config_append = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.280696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.280796 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.280796 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] log_dir = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.280968 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.281119 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] log_file = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.281217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.281324 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.281430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.281536 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.281636 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.281743 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.281849 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.281957 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.282067 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.282169 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.282269 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.282446 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.282571 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.62/identity {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.282696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] publish_errors = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.282814 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.282943 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.283062 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.283174 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.283290 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.283408 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.283520 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.283641 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.283755 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.283872 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.283984 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.284095 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] standard_threads = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.284206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.284324 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.284437 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.284553 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.284553 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.284790 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] use_journal = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.284910 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.62/identity {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.285065 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] use_json = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.285181 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] publish_errors = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.285346 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] use_stderr = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.285346 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] use_syslog = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.285650 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.285772 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.285885 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.285885 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.286102 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.286215 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.286326 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.286443 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.286554 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.286671 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] standard_threads = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.286795 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.286909 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.287021 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.287132 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.287243 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.287317 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.287317 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] use_journal = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.287317 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] use_json = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.287562 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.287635 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] use_stderr = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.287703 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.287778 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] use_syslog = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.287856 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.287927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 17:40:56.287994 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.288062 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.288209 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.288287 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.288447 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.288531 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.288700 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.288777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.288940 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.289043 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.289227 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.289306 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.289480 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.289556 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.289721 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.289798 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.289971 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.290053 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.290223 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.290299 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.290477 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.290556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.290714 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.290790 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.290963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.291044 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.291204 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.291294 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.291456 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.291537 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.291707 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.291782 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.291941 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.292023 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.292174 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.292257 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.292406 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.292481 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.292642 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.292718 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.292893 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.292971 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.293170 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.293249 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.293403 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.293484 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.293637 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.293714 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.293886 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.293961 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.294134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.294222 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.294366 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.294442 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.294603 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.294685 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.294833 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.294916 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.295073 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.295149 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.295310 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.295387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.295544 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.295672 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.295774 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.295848 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.296006 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.296081 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.296237 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.296322 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.296475 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.296551 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.296724 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.296798 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.296955 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.297102 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.297224 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.297299 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.297455 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.297529 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.297688 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.297773 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.297924 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.298000 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.298161 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.298236 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.298391 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.298473 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.298630 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.298709 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.298867 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.298941 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.299105 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.299190 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.299346 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.299422 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.299580 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.299657 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.299809 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.299891 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.300046 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.300120 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.300286 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.300366 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.300517 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.300601 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.300751 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.300827 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.300975 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.301078 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.301245 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.301334 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.301483 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.301557 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.301721 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.301799 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.301956 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.302043 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.302207 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.302298 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.302473 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.302556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.302718 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.302802 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.302956 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.303032 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.303192 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.303274 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.303428 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.303538 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.303666 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.303769 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.303906 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.304008 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.304144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.304261 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.304382 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.304466 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.304627 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.304744 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.304866 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.304951 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.305137 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.305217 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.305377 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.305492 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.305602 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.305687 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.305834 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.305917 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.306072 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.306191 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.306308 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.306394 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.306548 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.306683 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.306797 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.306873 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.307038 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.307156 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.307278 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.307355 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.307517 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.307604 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.307754 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.307837 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.307990 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.308067 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.308227 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.308305 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.308461 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.308538 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.308694 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.308775 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.308925 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.309000 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.309179 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.309256 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.309416 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.309506 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.309648 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.309726 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.309889 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.309966 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.310126 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.310201 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.310366 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.310442 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.310607 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.310683 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.310842 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.310919 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.311078 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.311156 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.311312 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.311390 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.311553 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.311629 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] auth.external = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.311784 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.311860 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.312025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.312107 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.312264 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.312353 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.312517 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.312607 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] auth.password = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.312745 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] auth.token = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.312823 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.312985 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.313126 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.313247 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.313338 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.313496 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.313574 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.313729 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.313806 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] auth.external = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.313962 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.314046 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.314214 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.314290 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.314446 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.314546 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.314730 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] credential.caching = True {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.314825 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] auth.password = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.314945 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.315020 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] auth.token = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.315156 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.315244 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.315392 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.315478 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.315637 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.315715 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.315869 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.315946 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.316109 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.316262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.316358 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.316435 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.316595 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.316673 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.316835 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] credential.caching = True {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.316925 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.317112 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.317196 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.317367 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.317445 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.317620 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.317710 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.317868 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.317946 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.318632 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.318716 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.318873 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.318959 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.319112 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] federation.caching = True {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.319188 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.319352 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.319429 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.319600 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.319685 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.319847 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.319924 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.320079 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.320162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.320328 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.320453 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.320552 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.320641 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.320808 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.320892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.321079 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.321171 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.321337 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.321415 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] federation.caching = True {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.321574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.321652 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.322077 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.322168 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.322313 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] identity.caching = True {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.322389 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.322552 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.322628 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.322798 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.322950 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.323024 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.323093 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.323261 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.323337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.323510 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.323588 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.323737 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.323813 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.323976 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.324054 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.324225 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.324304 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.324479 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] identity.caching = True {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.324601 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.324697 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.324774 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.324929 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.325028 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.325186 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.325265 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.325428 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.325504 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.325674 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.325761 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.325905 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.325982 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.326147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.326225 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.326396 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.326474 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.326650 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.326728 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.326886 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.326964 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.327121 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.327200 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.327352 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.327428 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.327588 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.327664 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.327819 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.327898 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.328055 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.328133 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.328295 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.328373 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.328535 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.328614 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.328782 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.328860 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.329081 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.329164 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.329281 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.329398 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.329522 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.329603 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.329756 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.329833 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.329987 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.330065 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.330226 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.330305 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.330454 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.330530 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.330692 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.330771 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.330928 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.331005 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.331158 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.331235 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.331394 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.331472 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.331631 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.331709 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.331869 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.331947 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.332108 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.332187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.332352 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.332429 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.332585 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.332712 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.332826 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.332950 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.333079 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.333209 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.333321 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.333461 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.333552 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.334336 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.334524 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.334590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.334648 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.334867 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.335119 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.335357 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.335438 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.335589 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.335666 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.335824 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.335911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.user = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.336068 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.336198 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.336373 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.336469 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.336551 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.336684 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.336802 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.336926 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.337075 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.337190 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.337327 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.337427 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.user = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.337563 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.337672 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.337796 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.337938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.338025 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.338175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.338253 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.338427 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.338504 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.338680 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.338766 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.338931 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.339009 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.339171 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.339248 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.339411 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.339497 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.339650 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.339728 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.339889 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.339966 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.340119 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.340204 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.340352 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.340429 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.340595 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.340671 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.340835 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.340921 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.341097 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.341177 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.341339 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.341417 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.341587 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.341676 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.341823 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.341901 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.342061 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.342138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.342301 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.342389 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.342536 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.342613 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.342773 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.342850 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.343008 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.343094 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.343244 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.343322 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.343481 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.343559 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.343721 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.343807 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.343958 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.344036 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.344191 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.344269 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.344430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.344516 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.344668 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.344745 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] resource.caching = True {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.344906 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.344984 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.345169 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.345262 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.345406 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.345489 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.345651 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.345728 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.345887 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.345973 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.346122 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.346199 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.346364 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] resource.caching = True {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.346440 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.346601 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.346753 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.346828 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.346899 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.347065 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] role.caching = True {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.347149 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.347312 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] role.driver = sql {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.347398 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.347543 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.347621 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.347786 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.347862 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.348032 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.348118 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.348272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.348348 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.348516 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.348594 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.348756 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] role.caching = True {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.348842 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.349002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.349166 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] role.driver = sql {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.349259 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.349370 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.349533 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.349613 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.349768 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.349846 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.350017 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.350095 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.350266 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.350345 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.350512 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.350589 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.350759 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.350844 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.351008 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.351164 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.351242 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.351403 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.351481 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.351658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.351744 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.351908 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.351986 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.352158 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.352236 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.352407 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.352494 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.352644 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.352819 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.352897 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.353088 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.353171 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.353345 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.353425 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.353600 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.353677 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.353834 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.353911 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.354069 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.354148 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.354315 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.354391 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.354566 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.354651 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.354815 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.354893 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.355054 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.355130 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.355289 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.355373 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.355520 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.355597 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.355751 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.355828 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] token.caching = True {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.355988 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.356073 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.356237 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.356316 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.356473 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.356551 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.356713 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.356798 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.356953 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.357046 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.357213 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.357290 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.357452 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] token.caching = True {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.357542 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.357694 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.357771 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.357942 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.358020 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.358179 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.358263 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.358416 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.358493 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.358651 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.358728 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.358897 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.358983 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.359143 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.359220 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.359393 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.359478 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.359635 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.359714 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.359871 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.359964 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.360112 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.360191 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] database.connection = **** {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.360351 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.360428 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.360601 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.360687 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.360842 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.360919 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.361107 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.361189 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.361346 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.361435 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.361588 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.361668 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.361826 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.361910 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] database.connection = **** {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.362062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.362140 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.362308 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.362388 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.362547 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.362625 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.362793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.362871 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.363029 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.363108 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.363268 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.363345 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.363503 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.363579 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.363740 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.363818 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.363967 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.364043 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.364206 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.364285 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.364440 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.364520 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.364611 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 26 17:40:56.364690 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.364941 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.365266 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.365518 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.365752 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.365996 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.366235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 17:40:56.366408 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 26 17:40:56.394313 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.394543 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.394768 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.394960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.395195 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.395424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.403159 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.403835 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.431919 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.432144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.432515 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.432752 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.485429 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.485702 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.536051 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.536285 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.538890 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.539126 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.694161 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.694351 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.694425 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.694532 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.694611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.694736 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.694822 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.694956 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.695049 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.695175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.695259 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.695387 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.718078 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.718343 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.718442 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.718546 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.718672 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.718756 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.718898 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.718983 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.719116 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.719199 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.719330 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.719412 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.719540 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.719750 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.730400 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.730723 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.743578 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.743764 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.743855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.743994 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.744078 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.744225 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.744349 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.744424 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.744488 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.744647 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.744741 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.744856 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.744947 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81278) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.745099 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 17:40:56.762052 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.762265 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 26 17:40:56.762546 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.762651 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.762758 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 26 17:40:56.762843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 26 17:40:56.763059 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.763139 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.763282 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 26 17:40:56.763372 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.763557 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.763638 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.763818 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.763898 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.764077 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.764334 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.773453 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.773740 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.774014 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.774095 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.774297 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.774381 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.774605 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.774890 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.781280 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 17:40:56.781833 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 17:40:56.784178 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 17:40:56.784464 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.784752 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.784834 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 17:40:56.785067 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.785152 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.785360 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.785441 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.785629 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.785710 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.785907 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.785993 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.786187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.786269 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.786458 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.786546 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.786733 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.786811 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.787031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.787110 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.787306 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.787576 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.810525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.812046 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.812280 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 17:40:56.812571 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.813547 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 17:40:56.813842 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.817288 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 17:40:56.817577 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.817863 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.818731 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 17:40:56.819016 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.819296 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.824554 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 17:40:56.824844 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.825961 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 17:40:56.826251 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.830611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 17:40:56.830912 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.831209 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.831502 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.831786 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.832070 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.832151 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 17:40:56.832349 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.832430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.832626 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.832707 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.832929 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.833237 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.833515 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.834317 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.834587 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.848642 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.848926 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.850182 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.850468 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.852873 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 17:40:56.854272 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 17:40:56.856119 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.856422 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.857468 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.857765 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.860641 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 17:40:56.861979 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 17:40:56.863856 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 17:40:56.865559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 17:40:56.867660 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.867963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.868250 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.868533 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.868793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.868886 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.869112 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.869197 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.869399 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.869686 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.869968 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.870249 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.884909 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 17:40:56.885238 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.885513 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.885780 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.886213 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 17:40:56.886506 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.886778 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.887046 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.892580 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.893859 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.894159 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.895391 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.895703 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.895983 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.897444 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.897722 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.899168 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 17:40:56.899456 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.899741 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.900027 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.900336 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 17:40:56.900419 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.900619 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.900904 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.901215 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.901614 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.911514 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 17:40:56.911802 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.912136 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.912418 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.912801 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.912959 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 17:40:56.913104 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.913271 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.913389 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.913554 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.913839 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.914222 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.914504 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.914796 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.929221 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 17:40:56.930601 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 17:40:56.932134 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 17:40:56.933511 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 17:40:56.935028 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.936382 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.936489 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.937843 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.937963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 17:40:56.938251 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.938658 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.939296 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 17:40:56.939850 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.940109 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.945167 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.946623 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 17:40:56.946706 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.948389 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 17:40:56.949795 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.950190 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.950478 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.950759 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.951297 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.951692 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.951979 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.952254 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.958548 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 17:40:56.959378 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.959663 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.960588 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 17:40:56.960895 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.961208 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.966559 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81278) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 17:40:56.966846 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.967128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.967418 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.967698 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.967974 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.968063 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 17:40:56.968250 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.968332 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.968530 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.968611 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.968803 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.968885 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.969108 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.969242 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.969385 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.969467 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.969657 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.969738 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.969922 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.970009 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.970194 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.970273 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81278) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.970491 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.970885 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.971155 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.971436 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:56.971743 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 17:40:57.004211 dv-cinder-859318-1-smb devstack@keystone.service[81278]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5624f20a99c0 pid: 81278 (default app) Sep 26 17:40:57.006151 dv-cinder-859318-1-smb devstack@keystone.service[81277]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5624f20a99c0 pid: 81277 (default app) Sep 26 17:40:57.007983 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebd7be-2ae6-4ada-afbd-9307cf504188 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:40:57.008272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebd7be-2ae6-4ada-afbd-9307cf504188 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:40:57.008544 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebd7be-2ae6-4ada-afbd-9307cf504188 None None] PATH_INFO: `/v3` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:40:57.012718 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1/1] 10.222.0.62 () {50 vars in 791 bytes} [Mon Sep 26 17:40:57 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:03.923227 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9a521-bdf6-409d-b811-7afbcb492d14 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:03.923759 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9a521-bdf6-409d-b811-7afbcb492d14 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:03.923759 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9a521-bdf6-409d-b811-7afbcb492d14 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:03.928698 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1/2] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 17:41:03.934023 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69fc27-16ee-4547-b923-c340d220113c None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:03.934582 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69fc27-16ee-4547-b923-c340d220113c None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:03.934582 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69fc27-16ee-4547-b923-c340d220113c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:04.004492 dv-cinder-859318-1-smb devstack@keystone.service[81278]: INFO dbcounter [None req-bb69fc27-16ee-4547-b923-c340d220113c None None] Registered counter for database keystone Sep 26 17:41:04.023241 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG oslo_db.sqlalchemy.engines [None req-bb69fc27-16ee-4547-b923-c340d220113c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81278) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 17:41:04.029449 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writer thread running {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 17:41:04.210909 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG passlib.handlers.bcrypt [None req-bb69fc27-16ee-4547-b923-c340d220113c None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81278) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 26 17:41:04.211211 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG passlib.handlers.bcrypt [None req-bb69fc27-16ee-4547-b923-c340d220113c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81278) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 26 17:41:04.269113 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-bb69fc27-16ee-4547-b923-c340d220113c None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:04.270715 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-bb69fc27-16ee-4547-b923-c340d220113c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:04.398174 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 2/3] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 26 17:41:04.888169 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9a521-bdf6-409d-b811-7afbcb492d14 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:04.958207 dv-cinder-859318-1-smb devstack@keystone.service[81277]: INFO dbcounter [None req-f8c9a521-bdf6-409d-b811-7afbcb492d14 None None] Registered counter for database keystone Sep 26 17:41:04.980217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG oslo_db.sqlalchemy.engines [None req-f8c9a521-bdf6-409d-b811-7afbcb492d14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 17:41:04.986406 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writer thread running {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 17:41:05.105128 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9a521-bdf6-409d-b811-7afbcb492d14 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:05.109355 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cd07d-34d7-4bd6-917f-3cc6c9cb96ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:05.109975 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cd07d-34d7-4bd6-917f-3cc6c9cb96ce admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:05.110251 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cd07d-34d7-4bd6-917f-3cc6c9cb96ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:05.110517 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cd07d-34d7-4bd6-917f-3cc6c9cb96ce admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:05.119496 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693cd07d-34d7-4bd6-917f-3cc6c9cb96ce admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:05.170783 dv-cinder-859318-1-smb devstack@keystone.service[81277]: WARNING keystone.common.rbac_enforcer.enforcer [None req-693cd07d-34d7-4bd6-917f-3cc6c9cb96ce admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 26 17:41:05.171138 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693cd07d-34d7-4bd6-917f-3cc6c9cb96ce admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:05.181075 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 2/4] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Sep 26 17:41:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 17:41:05.187074 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69fc27-16ee-4547-b923-c340d220113c None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:05.204438 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69fc27-16ee-4547-b923-c340d220113c None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:05.208809 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e2a87-2efd-4c20-9052-397c179aca77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:05.209959 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e2a87-2efd-4c20-9052-397c179aca77 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:05.210241 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e2a87-2efd-4c20-9052-397c179aca77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:05.210508 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e2a87-2efd-4c20-9052-397c179aca77 admin admin] PATH_INFO: `/v3/projects/068ad96e90d940c6a9455251dbef5ca0` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:05.212088 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e2a87-2efd-4c20-9052-397c179aca77 admin admin] RBAC: Authorizing `identity:get_project(project_id=068ad96e90d940c6a9455251dbef5ca0)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:05.266237 dv-cinder-859318-1-smb devstack@keystone.service[81278]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ba3e2a87-2efd-4c20-9052-397c179aca77 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 26 17:41:05.266583 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e2a87-2efd-4c20-9052-397c179aca77 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:05.271124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 3/5] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Sep 26 17:41:05 2022] GET /identity/v3/projects/068ad96e90d940c6a9455251dbef5ca0 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:07.384245 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293d035-05f5-42c9-914c-5d9bcaaee6fe None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:07.384635 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293d035-05f5-42c9-914c-5d9bcaaee6fe None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:07.384798 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293d035-05f5-42c9-914c-5d9bcaaee6fe None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:07.388929 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 3/6] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:41:07.394471 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df144cd-d859-4b7c-9087-36946435a81c None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:07.394925 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df144cd-d859-4b7c-9087-36946435a81c None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:07.395027 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df144cd-d859-4b7c-9087-36946435a81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:07.416192 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-5df144cd-d859-4b7c-9087-36946435a81c None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:07.417750 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-5df144cd-d859-4b7c-9087-36946435a81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:07.425945 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 4/7] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 26 17:41:07.690861 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293d035-05f5-42c9-914c-5d9bcaaee6fe None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:07.703178 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293d035-05f5-42c9-914c-5d9bcaaee6fe None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:07.707323 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37f8ac-0abf-4320-93f2-3a53d9b0797f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:07.707914 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37f8ac-0abf-4320-93f2-3a53d9b0797f admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:07.708192 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37f8ac-0abf-4320-93f2-3a53d9b0797f admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:07.708460 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37f8ac-0abf-4320-93f2-3a53d9b0797f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:07.716075 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed37f8ac-0abf-4320-93f2-3a53d9b0797f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:07.717886 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed37f8ac-0abf-4320-93f2-3a53d9b0797f admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:07.726896 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 4/8] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Sep 26 17:41:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 17:41:07.732360 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df144cd-d859-4b7c-9087-36946435a81c None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:07.741930 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df144cd-d859-4b7c-9087-36946435a81c None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:07.746559 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9cdec5-5421-4d4d-ab09-669ca3988cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:07.747179 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cdec5-5421-4d4d-ab09-669ca3988cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:07.747463 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cdec5-5421-4d4d-ab09-669ca3988cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:07.747735 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cdec5-5421-4d4d-ab09-669ca3988cd4 admin admin] PATH_INFO: `/v3/users/7155e9699cdb4b3f90bd34118e45f2bc` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:07.749074 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9cdec5-5421-4d4d-ab09-669ca3988cd4 admin admin] RBAC: Authorizing `identity:get_user(user_id=7155e9699cdb4b3f90bd34118e45f2bc)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:07.750900 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9cdec5-5421-4d4d-ab09-669ca3988cd4 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:07.752419 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 5/9] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Sep 26 17:41:07 2022] GET /identity/v3/users/7155e9699cdb4b3f90bd34118e45f2bc => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:09.973117 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7992f4-c046-48dd-8b4e-a2af45188cc8 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:09.973666 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7992f4-c046-48dd-8b4e-a2af45188cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:09.973666 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7992f4-c046-48dd-8b4e-a2af45188cc8 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:09.974992 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 5/10] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:41:09.980181 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ecabfb-a2db-4405-8d7f-94d1b14862ca None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:09.980574 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ecabfb-a2db-4405-8d7f-94d1b14862ca None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:09.980846 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ecabfb-a2db-4405-8d7f-94d1b14862ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:09.998775 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-44ecabfb-a2db-4405-8d7f-94d1b14862ca None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:09.999946 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-44ecabfb-a2db-4405-8d7f-94d1b14862ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:10.004146 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ab427-4b30-45ab-a2a9-b3c2e86a4430 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:10.004431 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ab427-4b30-45ab-a2a9-b3c2e86a4430 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:10.004702 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ab427-4b30-45ab-a2a9-b3c2e86a4430 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:10.006047 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 6/11] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 17:41:10.011705 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d5af8-43c2-47b2-8fcf-0e4a9af73c33 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:10.011983 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d5af8-43c2-47b2-8fcf-0e4a9af73c33 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:10.012257 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d5af8-43c2-47b2-8fcf-0e4a9af73c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:10.054262 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG passlib.handlers.bcrypt [None req-2f8d5af8-43c2-47b2-8fcf-0e4a9af73c33 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81277) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 26 17:41:10.054641 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG passlib.handlers.bcrypt [None req-2f8d5af8-43c2-47b2-8fcf-0e4a9af73c33 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81277) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 26 17:41:10.083471 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 6/12] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:41:10.104403 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-2f8d5af8-43c2-47b2-8fcf-0e4a9af73c33 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:10.106026 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-2f8d5af8-43c2-47b2-8fcf-0e4a9af73c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:10.204626 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 7/13] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 17:41:10.351164 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ecabfb-a2db-4405-8d7f-94d1b14862ca None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:10.375275 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:10.467257 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d5af8-43c2-47b2-8fcf-0e4a9af73c33 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:10.481914 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ecabfb-a2db-4405-8d7f-94d1b14862ca None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:10.515841 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1dd2c-24a7-4efe-82ad-f34995e762a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:10.516473 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1dd2c-24a7-4efe-82ad-f34995e762a6 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:10.516749 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1dd2c-24a7-4efe-82ad-f34995e762a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:10.517033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1dd2c-24a7-4efe-82ad-f34995e762a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:10.528010 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e1dd2c-24a7-4efe-82ad-f34995e762a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:41:10.537455 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-b8e1dd2c-24a7-4efe-82ad-f34995e762a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:41:10.537455 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:41:10.537455 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:41:10.537455 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:41:10.537455 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:41:10.537455 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:41:10.537455 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:41:10.537455 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:41:10.537455 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:41:10.537455 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:41:10.537455 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:41:10.537455 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:41:10.537455 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:41:10.537455 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:41:10.537455 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:41:10.537455 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:41:10.539096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:41:10.539096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:41:10.539096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:41:10.539096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:41:10.539096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:41:10.539096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:41:10.539096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:41:10.539096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:41:10.539096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:41:10.539096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:41:10.539096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:41:10.539096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:41:10.539096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:41:10.539096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:41:10.539096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:41:10.539096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:41:10.539943 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:41:10.539943 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:41:10.539943 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:41:10.539943 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:41:10.539943 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:41:10.539943 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:41:10.539943 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:41:10.539943 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:41:10.539943 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:41:10.539943 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:41:10.539943 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:41:10.539943 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:41:10.539943 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 7/14] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Sep 26 17:41:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:41:10.544903 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1dd2c-24a7-4efe-82ad-f34995e762a6 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:10.569732 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d5af8-43c2-47b2-8fcf-0e4a9af73c33 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:10.571996 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:10.606671 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a42f34-d386-4c14-a3d7-67a2209e8b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:10.607451 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a42f34-d386-4c14-a3d7-67a2209e8b2e None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:10.607736 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a42f34-d386-4c14-a3d7-67a2209e8b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:10.608008 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a42f34-d386-4c14-a3d7-67a2209e8b2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:10.627803 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:10.646353 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1dd2c-24a7-4efe-82ad-f34995e762a6 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:10.676193 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a42f34-d386-4c14-a3d7-67a2209e8b2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:10.677772 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a42f34-d386-4c14-a3d7-67a2209e8b2e None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:10.687446 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bda52a-dbef-4246-8290-4ac8edf4f297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:10.688426 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bda52a-dbef-4246-8290-4ac8edf4f297 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:10.688696 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bda52a-dbef-4246-8290-4ac8edf4f297 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:10.688975 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bda52a-dbef-4246-8290-4ac8edf4f297 None admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:10.689792 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bda52a-dbef-4246-8290-4ac8edf4f297 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:10.689983 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bda52a-dbef-4246-8290-4ac8edf4f297 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:10.691402 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bda52a-dbef-4246-8290-4ac8edf4f297 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:10.705453 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 8/15] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:41:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:41:10.711996 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bda52a-dbef-4246-8290-4ac8edf4f297 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:10.792053 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 8/16] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:41:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 26 17:41:10.797830 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a42f34-d386-4c14-a3d7-67a2209e8b2e None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:10.801549 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:10.821598 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bda52a-dbef-4246-8290-4ac8edf4f297 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:10.857396 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d9248-f730-48ab-96cf-74b71dcfa5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:10.857954 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d9248-f730-48ab-96cf-74b71dcfa5f8 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:10.858233 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d9248-f730-48ab-96cf-74b71dcfa5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:10.858508 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d9248-f730-48ab-96cf-74b71dcfa5f8 None admin] PATH_INFO: `/v3/users/7155e9699cdb4b3f90bd34118e45f2bc` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:10.859711 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d9248-f730-48ab-96cf-74b71dcfa5f8 None admin] RBAC: Authorizing `identity:get_user(user_id=7155e9699cdb4b3f90bd34118e45f2bc)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:10.861218 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d9248-f730-48ab-96cf-74b71dcfa5f8 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:10.862811 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 9/17] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:41:10 2022] GET /identity/v3/users/7155e9699cdb4b3f90bd34118e45f2bc => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:41:10.868828 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d9248-f730-48ab-96cf-74b71dcfa5f8 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:10.884932 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:10.911947 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a42f34-d386-4c14-a3d7-67a2209e8b2e None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:10.948390 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788b2f9-7988-4ccb-8a3b-4eb29902ceba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:10.949276 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788b2f9-7988-4ccb-8a3b-4eb29902ceba None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:10.949562 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788b2f9-7988-4ccb-8a3b-4eb29902ceba None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:10.949842 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788b2f9-7988-4ccb-8a3b-4eb29902ceba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:10.968123 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788b2f9-7988-4ccb-8a3b-4eb29902ceba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:10.969622 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788b2f9-7988-4ccb-8a3b-4eb29902ceba None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:10.973906 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d9248-f730-48ab-96cf-74b71dcfa5f8 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:10.988468 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-0788b2f9-7988-4ccb-8a3b-4eb29902ceba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:41:10.988468 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:41:10.988468 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:41:10.988468 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:41:10.988468 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:41:10.988468 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:41:10.988468 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:41:10.988468 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:41:10.988468 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:41:10.988468 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:41:10.988468 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:41:10.988468 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:41:10.988468 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:41:10.988468 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:41:10.988468 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:41:10.988468 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:41:10.989841 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:41:10.989841 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:41:10.989841 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:41:10.989841 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:41:10.989841 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:41:10.989841 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:41:10.989841 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:41:10.989841 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:41:10.989841 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:41:10.989841 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:41:10.989841 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:41:10.989841 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:41:10.989841 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:41:10.989841 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:41:10.989841 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:41:10.989841 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:41:10.989841 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:41:10.990681 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:41:10.990681 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:41:10.990681 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:41:10.990681 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 9/18] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:41:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:41:10.996009 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788b2f9-7988-4ccb-8a3b-4eb29902ceba None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:11.012807 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a66e33-adc2-419e-b6ab-949814fd8931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:11.013475 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a66e33-adc2-419e-b6ab-949814fd8931 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:11.013752 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a66e33-adc2-419e-b6ab-949814fd8931 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:11.014025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a66e33-adc2-419e-b6ab-949814fd8931 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:11.015147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a66e33-adc2-419e-b6ab-949814fd8931 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:11.016621 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a66e33-adc2-419e-b6ab-949814fd8931 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:11.018193 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 10/19] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:41:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:41:11.024106 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a66e33-adc2-419e-b6ab-949814fd8931 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:11.052118 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:11.103714 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788b2f9-7988-4ccb-8a3b-4eb29902ceba None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:11.117715 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:11.138020 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a66e33-adc2-419e-b6ab-949814fd8931 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:11.142334 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a6ae5-ea6b-48e4-954f-7a2a207b2ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:11.142950 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a6ae5-ea6b-48e4-954f-7a2a207b2ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:11.143235 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a6ae5-ea6b-48e4-954f-7a2a207b2ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:11.143510 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a6ae5-ea6b-48e4-954f-7a2a207b2ed4 None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:11.144170 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a6ae5-ea6b-48e4-954f-7a2a207b2ed4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:11.144474 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a6ae5-ea6b-48e4-954f-7a2a207b2ed4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:11.146395 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a6ae5-ea6b-48e4-954f-7a2a207b2ed4 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:11.165690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 10/20] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:41:11.174096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce419b9-9481-4fdc-ae34-a891c06947e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:11.174733 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce419b9-9481-4fdc-ae34-a891c06947e8 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:11.175043 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce419b9-9481-4fdc-ae34-a891c06947e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:11.175317 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce419b9-9481-4fdc-ae34-a891c06947e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:11.176109 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce419b9-9481-4fdc-ae34-a891c06947e8 None admin] RBAC: Adding query filter params (role.id=be6ee971abf54b26be509c14823ece55, scope.domain.id=default, user.id=7155e9699cdb4b3f90bd34118e45f2bc) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:11.176732 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce419b9-9481-4fdc-ae34-a891c06947e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:11.178259 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce419b9-9481-4fdc-ae34-a891c06947e8 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:11.186832 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 11/21] 10.222.0.62 () {56 vars in 1322 bytes} [Mon Sep 26 17:41:11 2022] GET /identity/v3/role_assignments?user.id=7155e9699cdb4b3f90bd34118e45f2bc&scope.domain.id=default&role.id=be6ee971abf54b26be509c14823ece55 => generated 233 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:41:13.860202 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cb76f-3dfe-462f-bda2-582020eb50ab None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:13.861262 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cb76f-3dfe-462f-bda2-582020eb50ab None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:13.861773 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cb76f-3dfe-462f-bda2-582020eb50ab None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:13.863337 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 11/22] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:41:13.869476 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd2df6-ffee-4bac-aeb3-059236643530 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:13.869895 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd2df6-ffee-4bac-aeb3-059236643530 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:13.870067 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd2df6-ffee-4bac-aeb3-059236643530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:13.898209 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-e8bd2df6-ffee-4bac-aeb3-059236643530 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:13.899467 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-e8bd2df6-ffee-4bac-aeb3-059236643530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:13.998765 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 12/23] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:41:14.012365 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d925b90-0baf-4a13-b416-d642629188fe None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:14.013004 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d925b90-0baf-4a13-b416-d642629188fe None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:14.013527 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d925b90-0baf-4a13-b416-d642629188fe None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:14.016483 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 12/24] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:41:14.021190 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecec47-2a23-4735-b53e-848d57a5a21f None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:14.021491 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecec47-2a23-4735-b53e-848d57a5a21f None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:14.021775 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecec47-2a23-4735-b53e-848d57a5a21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:14.051266 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-b2ecec47-2a23-4735-b53e-848d57a5a21f None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:14.052466 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-b2ecec47-2a23-4735-b53e-848d57a5a21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:14.148783 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 13/25] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:41:14.228230 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebaa15-a69f-44ea-b733-c346a489d53f None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:14.228854 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebaa15-a69f-44ea-b733-c346a489d53f None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:14.229365 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebaa15-a69f-44ea-b733-c346a489d53f None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:14.230897 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 13/26] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:41:14.236234 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f28785-8f61-413e-b32d-1683890d0dc6 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:14.236524 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f28785-8f61-413e-b32d-1683890d0dc6 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:14.236799 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f28785-8f61-413e-b32d-1683890d0dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:14.249502 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:14.262745 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-63f28785-8f61-413e-b32d-1683890d0dc6 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:14.263946 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-63f28785-8f61-413e-b32d-1683890d0dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:14.357784 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 14/27] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:41:14.380860 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbebaa15-a69f-44ea-b733-c346a489d53f None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:14.529336 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbebaa15-a69f-44ea-b733-c346a489d53f None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:14.547418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:14.554178 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f28785-8f61-413e-b32d-1683890d0dc6 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:14.573807 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657a788-d5ea-4e60-9158-b4c7862de9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:14.574455 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657a788-d5ea-4e60-9158-b4c7862de9a7 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:14.574734 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657a788-d5ea-4e60-9158-b4c7862de9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:14.575054 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657a788-d5ea-4e60-9158-b4c7862de9a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:14.590366 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657a788-d5ea-4e60-9158-b4c7862de9a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:41:14.597083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-4657a788-d5ea-4e60-9158-b4c7862de9a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:41:14.597083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:41:14.597083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:41:14.597083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:41:14.597083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:41:14.597083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:41:14.597083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:41:14.597083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:41:14.597083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:41:14.597083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:41:14.597083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:41:14.597083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:41:14.597083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:41:14.597083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:41:14.597083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:41:14.597083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:41:14.597917 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:41:14.597917 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:41:14.597917 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:41:14.597917 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:41:14.597917 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:41:14.597917 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:41:14.597917 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:41:14.597917 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:41:14.597917 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:41:14.597917 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:41:14.597917 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:41:14.597917 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:41:14.597917 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:41:14.597917 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:41:14.597917 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:41:14.597917 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:41:14.598684 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:41:14.598684 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:41:14.598684 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:41:14.598684 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:41:14.598684 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:41:14.598684 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:41:14.598684 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:41:14.598684 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:41:14.598684 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:41:14.598684 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:41:14.598684 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:41:14.598684 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:41:14.598684 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 14/28] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Sep 26 17:41:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:41:14.599764 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc65bed-0a07-4173-9dee-143644447886 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:14.600206 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc65bed-0a07-4173-9dee-143644447886 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:14.600657 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc65bed-0a07-4173-9dee-143644447886 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:14.602946 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 15/29] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:41:14.608279 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8adf3d-a679-4d2d-a169-5063d193835a None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:14.608747 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8adf3d-a679-4d2d-a169-5063d193835a None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:14.609210 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8adf3d-a679-4d2d-a169-5063d193835a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:14.640734 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-ce8adf3d-a679-4d2d-a169-5063d193835a None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:14.642966 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-ce8adf3d-a679-4d2d-a169-5063d193835a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:14.761525 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 16/30] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:41:14.762746 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8adf3d-a679-4d2d-a169-5063d193835a None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:14.785915 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f28785-8f61-413e-b32d-1683890d0dc6 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:14.837128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54c126-ec69-4a26-bfea-a2c5ab4633ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:14.838872 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54c126-ec69-4a26-bfea-a2c5ab4633ab None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:14.839521 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54c126-ec69-4a26-bfea-a2c5ab4633ab None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:14.841206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54c126-ec69-4a26-bfea-a2c5ab4633ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:14.849752 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:14.864268 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c54c126-ec69-4a26-bfea-a2c5ab4633ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:14.865818 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c54c126-ec69-4a26-bfea-a2c5ab4633ab None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:14.892370 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-0c54c126-ec69-4a26-bfea-a2c5ab4633ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:41:14.892370 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:41:14.892370 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:41:14.892370 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:41:14.892370 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:41:14.892370 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:41:14.892370 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:41:14.892370 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:41:14.892370 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:41:14.892370 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:41:14.892370 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:41:14.892370 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:41:14.892370 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:41:14.892370 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:41:14.892370 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:41:14.892370 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:41:14.893797 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:41:14.893797 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:41:14.893797 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:41:14.893797 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:41:14.893797 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:41:14.893797 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:41:14.893797 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:41:14.893797 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:41:14.893797 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:41:14.893797 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:41:14.893797 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:41:14.893797 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:41:14.893797 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:41:14.893797 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:41:14.893797 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:41:14.893797 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:41:14.893797 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:41:14.894599 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:41:14.894599 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:41:14.894599 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:41:14.896486 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 15/31] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:41:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:41:14.898031 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54c126-ec69-4a26-bfea-a2c5ab4633ab None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:14.935426 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8adf3d-a679-4d2d-a169-5063d193835a None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:14.947804 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:15.007242 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413a998-ab86-43a1-a0c9-657b795b6dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:15.007863 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413a998-ab86-43a1-a0c9-657b795b6dee None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:15.008176 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413a998-ab86-43a1-a0c9-657b795b6dee None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:15.008619 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413a998-ab86-43a1-a0c9-657b795b6dee None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:15.009488 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413a998-ab86-43a1-a0c9-657b795b6dee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:15.009992 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413a998-ab86-43a1-a0c9-657b795b6dee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:15.011539 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413a998-ab86-43a1-a0c9-657b795b6dee None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:15.030144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 17/32] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:41:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:15.031560 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413a998-ab86-43a1-a0c9-657b795b6dee None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:15.088494 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54c126-ec69-4a26-bfea-a2c5ab4633ab None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:15.124826 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda0500-49fd-47f4-a7db-b0354f82ed82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:15.125771 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda0500-49fd-47f4-a7db-b0354f82ed82 None admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:15.126274 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda0500-49fd-47f4-a7db-b0354f82ed82 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:15.126725 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda0500-49fd-47f4-a7db-b0354f82ed82 None admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:15.127577 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda0500-49fd-47f4-a7db-b0354f82ed82 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:15.129385 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda0500-49fd-47f4-a7db-b0354f82ed82 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:15.152038 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413a998-ab86-43a1-a0c9-657b795b6dee None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:15.188468 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140026ba-b0af-466f-84e6-7d43d8203c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:15.189191 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140026ba-b0af-466f-84e6-7d43d8203c75 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:15.189477 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140026ba-b0af-466f-84e6-7d43d8203c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:15.189754 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140026ba-b0af-466f-84e6-7d43d8203c75 None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:15.190402 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140026ba-b0af-466f-84e6-7d43d8203c75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:15.190704 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140026ba-b0af-466f-84e6-7d43d8203c75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:15.192083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140026ba-b0af-466f-84e6-7d43d8203c75 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:15.209078 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 18/33] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:41:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:15.209078 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140026ba-b0af-466f-84e6-7d43d8203c75 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:15.243023 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:15.265749 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 16/34] 10.222.0.62 () {60 vars in 1131 bytes} [Mon Sep 26 17:41:14 2022] POST /identity/v3/roles => generated 219 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:41:15.265749 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd0bdb-aea1-49c7-a448-044deec5713d None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:15.265749 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd0bdb-aea1-49c7-a448-044deec5713d None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:15.265749 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd0bdb-aea1-49c7-a448-044deec5713d None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:15.265749 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 17/35] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:41:15.265749 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd0bdb-aea1-49c7-a448-044deec5713d None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:15.349778 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:15.353921 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140026ba-b0af-466f-84e6-7d43d8203c75 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:15.403928 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c709d78-57c5-4495-9dbf-3f4061c748f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:15.404654 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c709d78-57c5-4495-9dbf-3f4061c748f0 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:15.404945 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c709d78-57c5-4495-9dbf-3f4061c748f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:15.405311 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c709d78-57c5-4495-9dbf-3f4061c748f0 None admin] PATH_INFO: `/v3/users/7155e9699cdb4b3f90bd34118e45f2bc` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:15.406939 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c709d78-57c5-4495-9dbf-3f4061c748f0 None admin] RBAC: Authorizing `identity:get_user(user_id=7155e9699cdb4b3f90bd34118e45f2bc)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:15.409207 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c709d78-57c5-4495-9dbf-3f4061c748f0 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:15.411304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 19/36] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:41:15 2022] GET /identity/v3/users/7155e9699cdb4b3f90bd34118e45f2bc => generated 247 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:15.416962 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c709d78-57c5-4495-9dbf-3f4061c748f0 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:15.429253 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd0bdb-aea1-49c7-a448-044deec5713d None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:15.473295 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420f5f1-5c0d-4673-b77c-4d9a673ce9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:15.474220 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420f5f1-5c0d-4673-b77c-4d9a673ce9b6 None admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:15.474503 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420f5f1-5c0d-4673-b77c-4d9a673ce9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:15.474776 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420f5f1-5c0d-4673-b77c-4d9a673ce9b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:15.475491 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f420f5f1-5c0d-4673-b77c-4d9a673ce9b6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:15.477058 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f420f5f1-5c0d-4673-b77c-4d9a673ce9b6 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:15.499927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 18/37] 10.222.0.62 () {60 vars in 1131 bytes} [Mon Sep 26 17:41:15 2022] POST /identity/v3/roles => generated 225 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:41:15.503154 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4a9fd-ec84-4c4c-9da0-662a352c8a16 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:15.503448 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4a9fd-ec84-4c4c-9da0-662a352c8a16 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:15.503956 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4a9fd-ec84-4c4c-9da0-662a352c8a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:15.526139 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-b9c4a9fd-ec84-4c4c-9da0-662a352c8a16 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:15.528479 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-b9c4a9fd-ec84-4c4c-9da0-662a352c8a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:15.547957 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:15.556742 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c709d78-57c5-4495-9dbf-3f4061c748f0 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:15.621480 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89e8ba-64eb-478d-b156-9ddc71157ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:15.622066 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89e8ba-64eb-478d-b156-9ddc71157ca6 None admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:15.624660 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89e8ba-64eb-478d-b156-9ddc71157ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:15.624660 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89e8ba-64eb-478d-b156-9ddc71157ca6 None admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:15.624660 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89e8ba-64eb-478d-b156-9ddc71157ca6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:15.624907 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89e8ba-64eb-478d-b156-9ddc71157ca6 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:15.636194 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 19/38] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:41:15.637426 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4a9fd-ec84-4c4c-9da0-662a352c8a16 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:15.688815 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:15.767149 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4a9fd-ec84-4c4c-9da0-662a352c8a16 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:15.773920 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 20/39] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Sep 26 17:41:15 2022] POST /identity/v3/projects => generated 301 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:41:15.775654 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77ccbf-3bd7-4225-93f4-d653774e6331 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:15.775820 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77ccbf-3bd7-4225-93f4-d653774e6331 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:15.776094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77ccbf-3bd7-4225-93f4-d653774e6331 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:15.777643 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 21/40] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:41:15.783332 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3490788-e192-4a7a-9ffb-32481582073d None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:15.783615 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3490788-e192-4a7a-9ffb-32481582073d None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:15.783893 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3490788-e192-4a7a-9ffb-32481582073d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:15.809374 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-c3490788-e192-4a7a-9ffb-32481582073d None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:15.810975 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-c3490788-e192-4a7a-9ffb-32481582073d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:15.811742 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e30105-c040-4c9f-a97a-c046cd132327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:15.812523 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e30105-c040-4c9f-a97a-c046cd132327 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:15.812911 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e30105-c040-4c9f-a97a-c046cd132327 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:15.813329 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e30105-c040-4c9f-a97a-c046cd132327 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:15.814687 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e30105-c040-4c9f-a97a-c046cd132327 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:15.816312 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e30105-c040-4c9f-a97a-c046cd132327 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:15.823808 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 20/41] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:41:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:15.825447 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e30105-c040-4c9f-a97a-c046cd132327 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:15.907145 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 22/42] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 17:41:15.954112 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3490788-e192-4a7a-9ffb-32481582073d None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:16.050099 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:16.071475 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e30105-c040-4c9f-a97a-c046cd132327 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:16.074476 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3490788-e192-4a7a-9ffb-32481582073d None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:16.074952 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:16.107642 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfe10e-5c09-4ea9-80cf-f264c39f4f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:16.108298 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfe10e-5c09-4ea9-80cf-f264c39f4f19 None admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:16.108576 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfe10e-5c09-4ea9-80cf-f264c39f4f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:16.108867 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfe10e-5c09-4ea9-80cf-f264c39f4f19 None admin] PATH_INFO: `/v3/domains/default/users/7155e9699cdb4b3f90bd34118e45f2bc/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:16.109989 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa022d-227e-4f60-8370-6311e74f34a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:16.110599 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa022d-227e-4f60-8370-6311e74f34a0 None admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:16.110857 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dfe10e-5c09-4ea9-80cf-f264c39f4f19 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7155e9699cdb4b3f90bd34118e45f2bc, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:16.110951 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa022d-227e-4f60-8370-6311e74f34a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:16.111137 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa022d-227e-4f60-8370-6311e74f34a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:16.111799 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa022d-227e-4f60-8370-6311e74f34a0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:16.112335 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dfe10e-5c09-4ea9-80cf-f264c39f4f19 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:16.113467 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa022d-227e-4f60-8370-6311e74f34a0 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:16.128666 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 21/43] 10.222.0.62 () {58 vars in 1361 bytes} [Mon Sep 26 17:41:15 2022] PUT /identity/v3/domains/default/users/7155e9699cdb4b3f90bd34118e45f2bc/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:41:16.133084 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 23/44] 10.222.0.62 () {60 vars in 1131 bytes} [Mon Sep 26 17:41:15 2022] POST /identity/v3/roles => generated 223 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 17:41:16.178699 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfe10e-5c09-4ea9-80cf-f264c39f4f19 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:16.301385 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfe10e-5c09-4ea9-80cf-f264c39f4f19 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:16.344511 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58447220-ba8b-4e26-8a40-6a5373ce8ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:16.345520 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58447220-ba8b-4e26-8a40-6a5373ce8ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:16.346008 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58447220-ba8b-4e26-8a40-6a5373ce8ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:16.346464 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58447220-ba8b-4e26-8a40-6a5373ce8ab5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:16.347620 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58447220-ba8b-4e26-8a40-6a5373ce8ab5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:16.349125 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58447220-ba8b-4e26-8a40-6a5373ce8ab5 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:16.351486 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 22/45] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:41:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:16.357120 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa022d-227e-4f60-8370-6311e74f34a0 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:16.463021 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa022d-227e-4f60-8370-6311e74f34a0 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:16.496280 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ed442-e7a6-4b78-8828-b62b1ba9c8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:16.496890 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ed442-e7a6-4b78-8828-b62b1ba9c8e5 None admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:16.497209 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ed442-e7a6-4b78-8828-b62b1ba9c8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:16.497485 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ed442-e7a6-4b78-8828-b62b1ba9c8e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:16.498133 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ed442-e7a6-4b78-8828-b62b1ba9c8e5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:16.499600 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ed442-e7a6-4b78-8828-b62b1ba9c8e5 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:16.510169 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:16.529301 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 24/46] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Sep 26 17:41:16 2022] POST /identity/v3/projects => generated 312 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:41:18.310286 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a331cb8-9bc1-4d3f-9f29-e2917aaf9cf2 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:18.310806 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a331cb8-9bc1-4d3f-9f29-e2917aaf9cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:18.310806 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a331cb8-9bc1-4d3f-9f29-e2917aaf9cf2 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:18.312170 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 23/47] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 17:41:18.317655 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ee9e2-13db-480b-b9df-b7f4cc514528 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:18.318293 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ee9e2-13db-480b-b9df-b7f4cc514528 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:18.318293 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ee9e2-13db-480b-b9df-b7f4cc514528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:18.336936 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-092ee9e2-13db-480b-b9df-b7f4cc514528 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:18.338153 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-092ee9e2-13db-480b-b9df-b7f4cc514528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:18.403835 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 25/48] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:41:18.679947 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a331cb8-9bc1-4d3f-9f29-e2917aaf9cf2 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:18.682349 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da8c7f-a81c-47fc-970f-0f9626d7b33f None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:18.682640 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da8c7f-a81c-47fc-970f-0f9626d7b33f None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:18.682919 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da8c7f-a81c-47fc-970f-0f9626d7b33f None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:18.684286 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 26/49] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 17:41:18.689354 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcc226-aa26-4a6c-a67a-905cd23ef416 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:18.689644 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcc226-aa26-4a6c-a67a-905cd23ef416 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:18.689924 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcc226-aa26-4a6c-a67a-905cd23ef416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:18.708201 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-0bbcc226-aa26-4a6c-a67a-905cd23ef416 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:18.709577 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-0bbcc226-aa26-4a6c-a67a-905cd23ef416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:18.713867 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:18.779333 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 27/50] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 17:41:18.786889 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a331cb8-9bc1-4d3f-9f29-e2917aaf9cf2 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:18.820185 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26adefee-242e-4c4a-b3ee-b3a6b8782b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:18.820804 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26adefee-242e-4c4a-b3ee-b3a6b8782b27 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:18.821117 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26adefee-242e-4c4a-b3ee-b3a6b8782b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:18.821394 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26adefee-242e-4c4a-b3ee-b3a6b8782b27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:18.831551 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26adefee-242e-4c4a-b3ee-b3a6b8782b27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:41:18.837057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-26adefee-242e-4c4a-b3ee-b3a6b8782b27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:41:18.837057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:41:18.837057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:41:18.837057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:41:18.837057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:41:18.837057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:41:18.837057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:41:18.837057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:41:18.837057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:41:18.837057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:41:18.837057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:41:18.837057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:41:18.837057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:41:18.837057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:41:18.837057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:41:18.837057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:41:18.837878 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:41:18.837878 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:41:18.837878 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:41:18.837878 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:41:18.837878 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:41:18.837878 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:41:18.837878 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:41:18.837878 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:41:18.837878 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:41:18.837878 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:41:18.837878 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:41:18.837878 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:41:18.837878 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:41:18.837878 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:41:18.837878 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:41:18.837878 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:41:18.838607 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:41:18.838607 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:41:18.838607 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:41:18.838607 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:41:18.838607 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:41:18.838607 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:41:18.838607 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:41:18.838607 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:41:18.838607 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:41:18.838607 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:41:18.838607 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:41:18.838607 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:41:18.838607 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 24/51] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Sep 26 17:41:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:41:18.843993 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcc226-aa26-4a6c-a67a-905cd23ef416 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:18.892091 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:18.942311 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcc226-aa26-4a6c-a67a-905cd23ef416 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:18.976538 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b27e7-a664-4e17-ae77-efe9033fe536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:18.977176 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b27e7-a664-4e17-ae77-efe9033fe536 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:18.977459 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b27e7-a664-4e17-ae77-efe9033fe536 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:18.977730 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b27e7-a664-4e17-ae77-efe9033fe536 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:18.978393 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b27e7-a664-4e17-ae77-efe9033fe536 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:18.978694 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b27e7-a664-4e17-ae77-efe9033fe536 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:18.980071 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b27e7-a664-4e17-ae77-efe9033fe536 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:18.988147 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 28/52] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:41:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:18.994361 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26adefee-242e-4c4a-b3ee-b3a6b8782b27 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:19.049884 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b27e7-a664-4e17-ae77-efe9033fe536 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:19.096282 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:19.105143 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26adefee-242e-4c4a-b3ee-b3a6b8782b27 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:19.138993 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90d248-e28e-4914-8cc6-75cb55180c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:19.139626 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90d248-e28e-4914-8cc6-75cb55180c93 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:19.139910 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90d248-e28e-4914-8cc6-75cb55180c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:19.140187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90d248-e28e-4914-8cc6-75cb55180c93 None admin] PATH_INFO: `/v3/users/7155e9699cdb4b3f90bd34118e45f2bc` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:19.141348 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e90d248-e28e-4914-8cc6-75cb55180c93 None admin] RBAC: Authorizing `identity:get_user(user_id=7155e9699cdb4b3f90bd34118e45f2bc)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:19.142816 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e90d248-e28e-4914-8cc6-75cb55180c93 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:19.144431 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 25/53] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:41:18 2022] GET /identity/v3/users/7155e9699cdb4b3f90bd34118e45f2bc => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:41:19.150468 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90d248-e28e-4914-8cc6-75cb55180c93 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:19.151036 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b27e7-a664-4e17-ae77-efe9033fe536 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:19.164219 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:19.187153 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afddcff-443d-40a4-b796-dac4582536e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:19.187778 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afddcff-443d-40a4-b796-dac4582536e5 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:19.188058 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afddcff-443d-40a4-b796-dac4582536e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:19.188331 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afddcff-443d-40a4-b796-dac4582536e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:19.189474 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afddcff-443d-40a4-b796-dac4582536e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:19.190929 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afddcff-443d-40a4-b796-dac4582536e5 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:19.192536 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 29/54] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:41:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:41:19.198120 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afddcff-443d-40a4-b796-dac4582536e5 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:19.252708 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90d248-e28e-4914-8cc6-75cb55180c93 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:19.293867 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03ef17-8729-4fa5-ae2b-22322466d685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:19.294517 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03ef17-8729-4fa5-ae2b-22322466d685 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:19.294801 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03ef17-8729-4fa5-ae2b-22322466d685 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:19.295082 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03ef17-8729-4fa5-ae2b-22322466d685 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:19.296240 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03ef17-8729-4fa5-ae2b-22322466d685 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:19.297752 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03ef17-8729-4fa5-ae2b-22322466d685 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:19.299339 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 26/55] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:41:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:41:19.305268 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03ef17-8729-4fa5-ae2b-22322466d685 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:19.332888 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:19.404160 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afddcff-443d-40a4-b796-dac4582536e5 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:19.409756 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03ef17-8729-4fa5-ae2b-22322466d685 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:19.438782 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e08d7e-8cfe-415c-a45f-5970833bf308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:19.439399 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e08d7e-8cfe-415c-a45f-5970833bf308 None admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:19.439683 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e08d7e-8cfe-415c-a45f-5970833bf308 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:19.439959 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e08d7e-8cfe-415c-a45f-5970833bf308 None admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:19.440624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e08d7e-8cfe-415c-a45f-5970833bf308 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:19.442116 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e08d7e-8cfe-415c-a45f-5970833bf308 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:19.444217 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140cd4b-d156-4d3f-beb2-56c0fe08f788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:19.444217 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140cd4b-d156-4d3f-beb2-56c0fe08f788 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:19.444976 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140cd4b-d156-4d3f-beb2-56c0fe08f788 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:19.446701 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140cd4b-d156-4d3f-beb2-56c0fe08f788 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:19.446701 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3140cd4b-d156-4d3f-beb2-56c0fe08f788 None admin] RBAC: Adding query filter params (role.id=be6ee971abf54b26be509c14823ece55, scope.domain.id=default, user.id=7155e9699cdb4b3f90bd34118e45f2bc) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:19.446701 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3140cd4b-d156-4d3f-beb2-56c0fe08f788 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:19.448439 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3140cd4b-d156-4d3f-beb2-56c0fe08f788 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:19.453843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 27/56] 10.222.0.62 () {56 vars in 1322 bytes} [Mon Sep 26 17:41:19 2022] GET /identity/v3/role_assignments?user.id=7155e9699cdb4b3f90bd34118e45f2bc&scope.domain.id=default&role.id=be6ee971abf54b26be509c14823ece55 => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:41:19.469762 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 30/57] 10.222.0.62 () {60 vars in 1140 bytes} [Mon Sep 26 17:41:19 2022] POST /identity/v3/projects => generated 298 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 17:41:21.642111 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a31429-cc31-4716-b2ef-4ece7bafcd27 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:21.642598 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a31429-cc31-4716-b2ef-4ece7bafcd27 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:21.642598 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a31429-cc31-4716-b2ef-4ece7bafcd27 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:21.643928 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 28/58] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:41:21.649062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb9f84-be95-4c9c-b5ac-936acdc208b6 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:21.649424 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb9f84-be95-4c9c-b5ac-936acdc208b6 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:21.649619 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb9f84-be95-4c9c-b5ac-936acdc208b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:21.667566 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-acbb9f84-be95-4c9c-b5ac-936acdc208b6 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:21.668742 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-acbb9f84-be95-4c9c-b5ac-936acdc208b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:21.693583 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:21.734056 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 31/59] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:41:21.998760 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a31429-cc31-4716-b2ef-4ece7bafcd27 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:22.089023 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:22.098303 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a31429-cc31-4716-b2ef-4ece7bafcd27 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:22.130413 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2f5e0-68b1-47a9-b803-b376be0c8267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:22.131025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2f5e0-68b1-47a9-b803-b376be0c8267 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:22.131301 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2f5e0-68b1-47a9-b803-b376be0c8267 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:22.131571 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2f5e0-68b1-47a9-b803-b376be0c8267 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:22.133229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2f5e0-68b1-47a9-b803-b376be0c8267 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:22.134673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2f5e0-68b1-47a9-b803-b376be0c8267 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:22.136199 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 29/60] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:41:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:22.141853 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb9f84-be95-4c9c-b5ac-936acdc208b6 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:22.235822 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb9f84-be95-4c9c-b5ac-936acdc208b6 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:22.268554 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582d1a4-49d3-4b6e-bd4f-f0bb4a488512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:22.269152 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582d1a4-49d3-4b6e-bd4f-f0bb4a488512 None admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:22.269400 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582d1a4-49d3-4b6e-bd4f-f0bb4a488512 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:22.269675 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582d1a4-49d3-4b6e-bd4f-f0bb4a488512 None admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:22.270347 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b582d1a4-49d3-4b6e-bd4f-f0bb4a488512 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:22.271771 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b582d1a4-49d3-4b6e-bd4f-f0bb4a488512 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:22.296922 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 32/61] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Sep 26 17:41:22 2022] POST /identity/v3/users => generated 275 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:41:25.469047 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d8fd0-70b2-4d47-9965-07f64f141eec None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:25.469047 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d8fd0-70b2-4d47-9965-07f64f141eec None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:25.469047 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d8fd0-70b2-4d47-9965-07f64f141eec None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:25.471735 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 30/62] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:41:25.477975 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30a0ea-efec-4dc0-b72b-ca7fc696779d None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:25.478847 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30a0ea-efec-4dc0-b72b-ca7fc696779d None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:25.479345 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30a0ea-efec-4dc0-b72b-ca7fc696779d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:25.506119 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-ec30a0ea-efec-4dc0-b72b-ca7fc696779d None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:25.508210 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-ec30a0ea-efec-4dc0-b72b-ca7fc696779d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:25.525833 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:25.602332 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 33/63] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:41:25.833884 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9eb9cb-1821-4e4a-94e2-a4b13b875afb None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:25.834476 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9eb9cb-1821-4e4a-94e2-a4b13b875afb None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:25.834935 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9eb9cb-1821-4e4a-94e2-a4b13b875afb None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:25.836993 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 31/64] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:41:25.840265 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5eec0-bd46-40a7-82cc-74c019a0284e None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:25.840559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5eec0-bd46-40a7-82cc-74c019a0284e None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:25.840840 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5eec0-bd46-40a7-82cc-74c019a0284e None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:25.842465 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 34/65] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:41:25.846977 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1d1a0-3cdf-4763-9c02-86044029528d None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:25.847337 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9a403-9324-4104-ae14-667e5e7bec02 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:25.847629 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9a403-9324-4104-ae14-667e5e7bec02 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:25.847911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9a403-9324-4104-ae14-667e5e7bec02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:25.848169 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1d1a0-3cdf-4763-9c02-86044029528d None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:25.848691 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1d1a0-3cdf-4763-9c02-86044029528d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:25.879616 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-ded1d1a0-3cdf-4763-9c02-86044029528d None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:25.881873 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-ded1d1a0-3cdf-4763-9c02-86044029528d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:25.883014 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-f9f9a403-9324-4104-ae14-667e5e7bec02 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:25.884354 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-f9f9a403-9324-4104-ae14-667e5e7bec02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:25.985719 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 35/66] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 17:41:25.986071 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 32/67] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:41:25.987045 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9a403-9324-4104-ae14-667e5e7bec02 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:26.073310 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:26.096961 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9a403-9324-4104-ae14-667e5e7bec02 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:26.136580 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb6984-d04a-4d4d-a306-42ea8746a4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:26.137570 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb6984-d04a-4d4d-a306-42ea8746a4b1 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:26.138032 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb6984-d04a-4d4d-a306-42ea8746a4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:26.138582 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb6984-d04a-4d4d-a306-42ea8746a4b1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:26.152115 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb6984-d04a-4d4d-a306-42ea8746a4b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:41:26.160704 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-ffcb6984-d04a-4d4d-a306-42ea8746a4b1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 17:41:26.160704 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:41:26.160704 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:41:26.160704 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:41:26.160704 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:41:26.160704 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:41:26.160704 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:41:26.160704 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:41:26.160704 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:41:26.160704 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:41:26.160704 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:41:26.160704 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:41:26.160704 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:41:26.160704 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:41:26.160704 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:41:26.160704 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:41:26.162094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:41:26.162094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:41:26.162094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:41:26.162094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:41:26.162094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:41:26.162094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:41:26.162094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:41:26.162094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:41:26.162094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:41:26.162094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:41:26.162094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:41:26.162094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:41:26.162094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:41:26.162094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:41:26.162094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:41:26.162094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:41:26.163376 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:41:26.163376 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:41:26.163376 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:41:26.163376 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:41:26.163376 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:41:26.163376 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:41:26.163376 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:41:26.163376 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:41:26.163376 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:41:26.163376 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:41:26.163376 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 17:41:26.163376 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:41:26.167002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 36/68] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:41:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:41:26.175534 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1d1a0-3cdf-4763-9c02-86044029528d None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:26.206739 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb736787-c84c-41e8-ae28-a5143601603f None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:26.207430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb736787-c84c-41e8-ae28-a5143601603f None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:26.207865 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb736787-c84c-41e8-ae28-a5143601603f None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:26.209542 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 37/69] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:41:26.216055 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc9d2b-36aa-41a8-b00a-2a1bfdd84a5f None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:26.216725 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc9d2b-36aa-41a8-b00a-2a1bfdd84a5f None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:26.217408 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc9d2b-36aa-41a8-b00a-2a1bfdd84a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:26.240359 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-36cc9d2b-36aa-41a8-b00a-2a1bfdd84a5f None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:26.241983 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-36cc9d2b-36aa-41a8-b00a-2a1bfdd84a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:26.320259 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 38/70] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 17:41:26.321489 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc9d2b-36aa-41a8-b00a-2a1bfdd84a5f None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:26.334103 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:26.345410 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1d1a0-3cdf-4763-9c02-86044029528d None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:26.405381 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c853c7-f774-4142-b928-339640b56420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:26.406064 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c853c7-f774-4142-b928-339640b56420 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:26.406387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c853c7-f774-4142-b928-339640b56420 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:26.406684 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c853c7-f774-4142-b928-339640b56420 None admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:26.410335 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c853c7-f774-4142-b928-339640b56420 None admin] RBAC: Adding query filter params (name=member) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:26.410897 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c853c7-f774-4142-b928-339640b56420 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:26.412494 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c853c7-f774-4142-b928-339640b56420 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:26.421666 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 33/71] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Sep 26 17:41:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:26.422747 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c853c7-f774-4142-b928-339640b56420 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:26.434643 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:26.476211 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc9d2b-36aa-41a8-b00a-2a1bfdd84a5f None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:26.519603 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7098e6-264f-4d90-81c7-ec6911176987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:26.520679 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7098e6-264f-4d90-81c7-ec6911176987 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:26.521249 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7098e6-264f-4d90-81c7-ec6911176987 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:26.521732 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7098e6-264f-4d90-81c7-ec6911176987 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:26.534529 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7098e6-264f-4d90-81c7-ec6911176987 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:41:26.537133 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c853c7-f774-4142-b928-339640b56420 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:26.540737 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-dd7098e6-264f-4d90-81c7-ec6911176987 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 17:41:26.540737 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:41:26.540737 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:41:26.540737 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:41:26.540737 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:41:26.540737 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:41:26.540737 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:41:26.540737 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:41:26.540737 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:41:26.540737 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:41:26.540737 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:41:26.540737 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:41:26.540737 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:41:26.540737 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:41:26.540737 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:41:26.540737 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:41:26.541634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:41:26.541634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:41:26.541634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:41:26.541634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:41:26.541634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:41:26.541634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:41:26.541634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:41:26.541634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:41:26.541634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:41:26.541634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:41:26.541634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:41:26.541634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:41:26.541634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:41:26.541634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:41:26.541634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:41:26.541634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:41:26.542395 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:41:26.542395 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:41:26.542395 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:41:26.542395 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:41:26.542395 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:41:26.542395 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:41:26.542395 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:41:26.542395 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:41:26.542395 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:41:26.542395 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:41:26.542395 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 17:41:26.542395 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:41:26.542395 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 39/72] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Sep 26 17:41:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:41:26.543006 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7098e6-264f-4d90-81c7-ec6911176987 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:26.578808 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ebc6a-84d6-49df-99b0-c7e46356b75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:26.579450 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ebc6a-84d6-49df-99b0-c7e46356b75d None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:26.579733 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ebc6a-84d6-49df-99b0-c7e46356b75d None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:26.580012 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ebc6a-84d6-49df-99b0-c7e46356b75d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:26.590766 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ebc6a-84d6-49df-99b0-c7e46356b75d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:41:26.596089 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-6f8ebc6a-84d6-49df-99b0-c7e46356b75d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:41:26.596089 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:41:26.596089 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:41:26.596089 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:41:26.596089 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:41:26.596089 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:41:26.596089 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:41:26.596089 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:41:26.596089 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:41:26.596089 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:41:26.596089 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:41:26.596089 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:41:26.596089 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:41:26.596089 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:41:26.596089 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:41:26.596089 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:41:26.596949 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:41:26.596949 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:41:26.596949 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:41:26.596949 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:41:26.596949 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:41:26.596949 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:41:26.596949 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:41:26.596949 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:41:26.596949 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:41:26.596949 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:41:26.596949 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:41:26.596949 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:41:26.596949 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:41:26.596949 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:41:26.596949 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:41:26.596949 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:41:26.597749 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:41:26.597749 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:41:26.597749 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:41:26.597749 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:41:26.597749 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:41:26.597749 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:41:26.597749 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:41:26.597749 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:41:26.597749 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:41:26.597749 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:41:26.597749 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:41:26.597749 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:41:26.597749 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 34/73] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Sep 26 17:41:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:41:26.598518 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484a906-b61f-4764-9f5a-f4a873e51099 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:26.598730 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484a906-b61f-4764-9f5a-f4a873e51099 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:26.599013 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484a906-b61f-4764-9f5a-f4a873e51099 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:26.600257 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 35/74] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:41:26.601000 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484a906-b61f-4764-9f5a-f4a873e51099 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:26.618770 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:26.660513 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7098e6-264f-4d90-81c7-ec6911176987 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:26.686245 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:26.695351 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3837b-f55b-49cd-9dbb-8a6d049dcce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:26.695991 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3837b-f55b-49cd-9dbb-8a6d049dcce9 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:26.696326 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3837b-f55b-49cd-9dbb-8a6d049dcce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:26.696606 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3837b-f55b-49cd-9dbb-8a6d049dcce9 None admin] PATH_INFO: `/v3/users/593a808ea3dc4b34b162c475e055673b` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:26.710947 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484a906-b61f-4764-9f5a-f4a873e51099 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:26.713337 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3837b-f55b-49cd-9dbb-8a6d049dcce9 None admin] RBAC: Authorizing `identity:get_user(user_id=593a808ea3dc4b34b162c475e055673b)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:26.714801 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3837b-f55b-49cd-9dbb-8a6d049dcce9 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:26.716437 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 40/75] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:41:26 2022] GET /identity/v3/users/593a808ea3dc4b34b162c475e055673b => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:26.717218 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3837b-f55b-49cd-9dbb-8a6d049dcce9 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:26.744757 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8c108-1854-481c-b326-1807fcffe5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:26.745411 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8c108-1854-481c-b326-1807fcffe5cc None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:26.745695 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8c108-1854-481c-b326-1807fcffe5cc None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:26.745972 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8c108-1854-481c-b326-1807fcffe5cc None admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:26.746639 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8c108-1854-481c-b326-1807fcffe5cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:26.746950 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8c108-1854-481c-b326-1807fcffe5cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:26.748347 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8c108-1854-481c-b326-1807fcffe5cc None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:26.756751 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 36/76] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:41:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:26.758516 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b62fff-57ee-4aa2-8e05-7c088f282d38 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:26.758804 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b62fff-57ee-4aa2-8e05-7c088f282d38 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:26.759079 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b62fff-57ee-4aa2-8e05-7c088f282d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:26.775957 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-18b62fff-57ee-4aa2-8e05-7c088f282d38 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:26.777198 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-18b62fff-57ee-4aa2-8e05-7c088f282d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:26.821135 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3837b-f55b-49cd-9dbb-8a6d049dcce9 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:26.842703 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 37/77] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:41:26.843559 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b62fff-57ee-4aa2-8e05-7c088f282d38 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:26.857152 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:26.860119 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98e9cd-f19c-4252-90ec-c68e3d39cad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:26.860743 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98e9cd-f19c-4252-90ec-c68e3d39cad6 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:26.861086 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98e9cd-f19c-4252-90ec-c68e3d39cad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:26.861365 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98e9cd-f19c-4252-90ec-c68e3d39cad6 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:26.862043 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98e9cd-f19c-4252-90ec-c68e3d39cad6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:26.862350 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98e9cd-f19c-4252-90ec-c68e3d39cad6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:26.863812 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98e9cd-f19c-4252-90ec-c68e3d39cad6 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:26.872712 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 41/78] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:41:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:26.873457 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98e9cd-f19c-4252-90ec-c68e3d39cad6 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:26.924455 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:26.961860 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b62fff-57ee-4aa2-8e05-7c088f282d38 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:26.982442 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98e9cd-f19c-4252-90ec-c68e3d39cad6 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:26.997308 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2ea02-a1a4-4c0f-9c83-b2a7a8ee9a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:26.997953 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2ea02-a1a4-4c0f-9c83-b2a7a8ee9a68 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:26.998229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2ea02-a1a4-4c0f-9c83-b2a7a8ee9a68 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:26.998503 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2ea02-a1a4-4c0f-9c83-b2a7a8ee9a68 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:27.011670 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2ea02-a1a4-4c0f-9c83-b2a7a8ee9a68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:41:27.016550 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-d7d2ea02-a1a4-4c0f-9c83-b2a7a8ee9a68 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 17:41:27.016550 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:41:27.016550 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:41:27.016550 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:41:27.016550 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:41:27.016550 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:41:27.016550 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:41:27.016550 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:41:27.016550 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:41:27.016550 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:41:27.016550 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:41:27.016550 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:41:27.016550 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:41:27.016550 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:41:27.016550 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:41:27.016550 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:41:27.017631 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:41:27.017631 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:41:27.017631 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:41:27.017631 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:41:27.017631 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:41:27.017631 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:41:27.017631 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:41:27.017631 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:41:27.017631 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:41:27.017631 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:41:27.017631 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:41:27.017631 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:41:27.017631 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:41:27.017631 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:41:27.017631 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:41:27.017631 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:41:27.018394 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:41:27.018394 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:41:27.018394 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:41:27.018394 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:41:27.018394 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:41:27.018394 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:41:27.018394 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:41:27.018394 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:41:27.018394 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:41:27.018394 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:41:27.018394 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 17:41:27.018394 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:41:27.018394 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 38/79] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:41:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:41:27.019018 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681e013-031f-4205-b3de-8496438a1ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:27.019018 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681e013-031f-4205-b3de-8496438a1ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:27.019164 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681e013-031f-4205-b3de-8496438a1ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:27.019744 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681e013-031f-4205-b3de-8496438a1ae7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:27.023959 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2ea02-a1a4-4c0f-9c83-b2a7a8ee9a68 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:27.089976 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:27.094298 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a681e013-031f-4205-b3de-8496438a1ae7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:27.095699 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a681e013-031f-4205-b3de-8496438a1ae7 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:27.131691 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2ea02-a1a4-4c0f-9c83-b2a7a8ee9a68 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:27.144848 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:27.165404 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5289d-000e-49df-8c0b-dd5638bfdc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:27.166032 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5289d-000e-49df-8c0b-dd5638bfdc62 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:27.166312 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5289d-000e-49df-8c0b-dd5638bfdc62 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:27.166585 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5289d-000e-49df-8c0b-dd5638bfdc62 None admin] PATH_INFO: `/v3/users/593a808ea3dc4b34b162c475e055673b` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:27.167739 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5289d-000e-49df-8c0b-dd5638bfdc62 None admin] RBAC: Authorizing `identity:get_user(user_id=593a808ea3dc4b34b162c475e055673b)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:27.169235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5289d-000e-49df-8c0b-dd5638bfdc62 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:27.170822 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 39/80] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:41:27 2022] GET /identity/v3/users/593a808ea3dc4b34b162c475e055673b => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:27.171585 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5289d-000e-49df-8c0b-dd5638bfdc62 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:27.202247 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 42/81] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:41:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 17:41:27.203013 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681e013-031f-4205-b3de-8496438a1ae7 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:27.269353 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5289d-000e-49df-8c0b-dd5638bfdc62 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:27.298080 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:27.300915 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681e013-031f-4205-b3de-8496438a1ae7 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:27.303850 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271748ef-181d-4d74-b1c2-24e4e2521f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:27.305062 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271748ef-181d-4d74-b1c2-24e4e2521f95 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:27.305351 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271748ef-181d-4d74-b1c2-24e4e2521f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:27.305629 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271748ef-181d-4d74-b1c2-24e4e2521f95 None admin] PATH_INFO: `/v3/users/7155e9699cdb4b3f90bd34118e45f2bc` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:27.306804 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271748ef-181d-4d74-b1c2-24e4e2521f95 None admin] RBAC: Authorizing `identity:get_user(user_id=7155e9699cdb4b3f90bd34118e45f2bc)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:27.308285 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271748ef-181d-4d74-b1c2-24e4e2521f95 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:27.309913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 40/82] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:41:27 2022] GET /identity/v3/users/7155e9699cdb4b3f90bd34118e45f2bc => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:27.310850 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271748ef-181d-4d74-b1c2-24e4e2521f95 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:27.336140 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7f3a0-8879-4f1e-972c-a9e1993c482b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:27.336995 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7f3a0-8879-4f1e-972c-a9e1993c482b None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:27.337384 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7f3a0-8879-4f1e-972c-a9e1993c482b None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:27.337756 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7f3a0-8879-4f1e-972c-a9e1993c482b None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:27.338532 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7f3a0-8879-4f1e-972c-a9e1993c482b None admin] RBAC: Adding query filter params (name=member) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:27.338897 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7f3a0-8879-4f1e-972c-a9e1993c482b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:27.340390 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7f3a0-8879-4f1e-972c-a9e1993c482b None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:27.349161 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 43/83] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Sep 26 17:41:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:27.349817 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7f3a0-8879-4f1e-972c-a9e1993c482b None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:27.362700 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:27.416520 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271748ef-181d-4d74-b1c2-24e4e2521f95 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:27.450515 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5bf032-5d94-4409-ab31-733e3f3d2ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:27.450769 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7f3a0-8879-4f1e-972c-a9e1993c482b None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:27.451144 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bf032-5d94-4409-ab31-733e3f3d2ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:27.451426 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bf032-5d94-4409-ab31-733e3f3d2ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:27.451702 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bf032-5d94-4409-ab31-733e3f3d2ed5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:27.452867 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5bf032-5d94-4409-ab31-733e3f3d2ed5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:27.454299 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5bf032-5d94-4409-ab31-733e3f3d2ed5 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:27.455857 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 41/84] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:41:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:27.456622 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5bf032-5d94-4409-ab31-733e3f3d2ed5 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:27.491622 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094f09e-cd40-44f0-b66c-1b61abffbd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:27.492216 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094f09e-cd40-44f0-b66c-1b61abffbd75 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:27.492495 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094f09e-cd40-44f0-b66c-1b61abffbd75 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:27.492770 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094f09e-cd40-44f0-b66c-1b61abffbd75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:27.524449 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:27.556618 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5bf032-5d94-4409-ab31-733e3f3d2ed5 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:27.560691 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094f09e-cd40-44f0-b66c-1b61abffbd75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:27.562317 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094f09e-cd40-44f0-b66c-1b61abffbd75 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:27.573779 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:27.590616 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310cb19-6f13-4373-9e5b-e166b04d5412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:27.591276 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310cb19-6f13-4373-9e5b-e166b04d5412 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:27.591557 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310cb19-6f13-4373-9e5b-e166b04d5412 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:27.591832 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310cb19-6f13-4373-9e5b-e166b04d5412 None admin] PATH_INFO: `/v3/projects/00fef40581d54f69b20ec6565c3cf274` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:27.592952 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310cb19-6f13-4373-9e5b-e166b04d5412 None admin] RBAC: Authorizing `identity:get_project(project_id=00fef40581d54f69b20ec6565c3cf274)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:27.594426 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310cb19-6f13-4373-9e5b-e166b04d5412 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:27.596060 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 42/85] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:41:27 2022] GET /identity/v3/projects/00fef40581d54f69b20ec6565c3cf274 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:27.596831 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310cb19-6f13-4373-9e5b-e166b04d5412 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:27.683879 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 44/86] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:41:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 17:41:27.684849 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094f09e-cd40-44f0-b66c-1b61abffbd75 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:27.704743 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310cb19-6f13-4373-9e5b-e166b04d5412 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:27.739468 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94ea5f-8c70-49cc-95d4-43a179657fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:27.740075 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94ea5f-8c70-49cc-95d4-43a179657fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:27.740357 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94ea5f-8c70-49cc-95d4-43a179657fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:27.740635 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94ea5f-8c70-49cc-95d4-43a179657fb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:27.745417 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:27.786257 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094f09e-cd40-44f0-b66c-1b61abffbd75 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:27.796558 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:27.811616 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94ea5f-8c70-49cc-95d4-43a179657fb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:27.813127 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94ea5f-8c70-49cc-95d4-43a179657fb1 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:27.820371 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edefde8-e311-496d-829c-43af16db4080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:27.821026 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edefde8-e311-496d-829c-43af16db4080 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:27.821319 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edefde8-e311-496d-829c-43af16db4080 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:27.821592 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edefde8-e311-496d-829c-43af16db4080 None admin] PATH_INFO: `/v3/users/593a808ea3dc4b34b162c475e055673b` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:27.822712 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edefde8-e311-496d-829c-43af16db4080 None admin] RBAC: Authorizing `identity:get_user(user_id=593a808ea3dc4b34b162c475e055673b)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:27.824152 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edefde8-e311-496d-829c-43af16db4080 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:27.826010 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 45/87] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:41:27 2022] GET /identity/v3/users/593a808ea3dc4b34b162c475e055673b => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:27.826755 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edefde8-e311-496d-829c-43af16db4080 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:27.914991 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 43/88] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:41:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 17:41:27.919818 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94ea5f-8c70-49cc-95d4-43a179657fb1 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:27.927749 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edefde8-e311-496d-829c-43af16db4080 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:27.951491 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:27.963949 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252b252-0eb2-4fef-815f-98ed5cc380f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:27.964491 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252b252-0eb2-4fef-815f-98ed5cc380f1 None admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:27.964767 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252b252-0eb2-4fef-815f-98ed5cc380f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:27.965062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252b252-0eb2-4fef-815f-98ed5cc380f1 None admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:27.965717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252b252-0eb2-4fef-815f-98ed5cc380f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:27.967149 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252b252-0eb2-4fef-815f-98ed5cc380f1 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:27.987538 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 46/89] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Sep 26 17:41:27 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:41:27.988444 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252b252-0eb2-4fef-815f-98ed5cc380f1 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:28.021582 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94ea5f-8c70-49cc-95d4-43a179657fb1 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:28.037664 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:28.061280 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607c458-2111-4a0f-a536-28c5c8e78ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:28.061928 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607c458-2111-4a0f-a536-28c5c8e78ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:28.062334 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607c458-2111-4a0f-a536-28c5c8e78ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:28.062498 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607c458-2111-4a0f-a536-28c5c8e78ca8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:28.063287 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8607c458-2111-4a0f-a536-28c5c8e78ca8 None admin] RBAC: Adding query filter params (role.id=b4593720c06e4a0db655f8e33079a15f, scope.project.id=00fef40581d54f69b20ec6565c3cf274, user.id=593a808ea3dc4b34b162c475e055673b) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:28.063603 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8607c458-2111-4a0f-a536-28c5c8e78ca8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:28.065153 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8607c458-2111-4a0f-a536-28c5c8e78ca8 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:28.071976 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 44/90] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:41:27 2022] GET /identity/v3/role_assignments?user.id=593a808ea3dc4b34b162c475e055673b&scope.project.id=00fef40581d54f69b20ec6565c3cf274&role.id=b4593720c06e4a0db655f8e33079a15f => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:28.072658 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607c458-2111-4a0f-a536-28c5c8e78ca8 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:28.131097 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252b252-0eb2-4fef-815f-98ed5cc380f1 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:28.187771 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187270f-74cd-46f3-8b73-8ca6d32f5c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:28.188804 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187270f-74cd-46f3-8b73-8ca6d32f5c06 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:28.189342 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187270f-74cd-46f3-8b73-8ca6d32f5c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:28.189618 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187270f-74cd-46f3-8b73-8ca6d32f5c06 None admin] PATH_INFO: `/v3/projects/00fef40581d54f69b20ec6565c3cf274` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:28.191178 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187270f-74cd-46f3-8b73-8ca6d32f5c06 None admin] RBAC: Authorizing `identity:get_project(project_id=00fef40581d54f69b20ec6565c3cf274)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:28.192740 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187270f-74cd-46f3-8b73-8ca6d32f5c06 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:28.194744 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 47/91] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:41:27 2022] GET /identity/v3/projects/00fef40581d54f69b20ec6565c3cf274 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:28.198630 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187270f-74cd-46f3-8b73-8ca6d32f5c06 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:28.212720 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:28.219573 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607c458-2111-4a0f-a536-28c5c8e78ca8 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:28.277650 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac17f4-215b-4e05-afca-16d150da291e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:28.277650 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac17f4-215b-4e05-afca-16d150da291e None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:28.277650 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac17f4-215b-4e05-afca-16d150da291e None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:28.277650 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac17f4-215b-4e05-afca-16d150da291e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:28.349216 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187270f-74cd-46f3-8b73-8ca6d32f5c06 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:28.353397 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:28.376816 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac17f4-215b-4e05-afca-16d150da291e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:28.378360 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac17f4-215b-4e05-afca-16d150da291e None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:28.409732 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e3403-657e-484c-ade2-841eba346981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:28.410392 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e3403-657e-484c-ade2-841eba346981 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:28.411072 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e3403-657e-484c-ade2-841eba346981 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:28.411358 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e3403-657e-484c-ade2-841eba346981 None admin] PATH_INFO: `/v3/projects/00fef40581d54f69b20ec6565c3cf274` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:28.412886 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e3403-657e-484c-ade2-841eba346981 None admin] RBAC: Authorizing `identity:get_project(project_id=00fef40581d54f69b20ec6565c3cf274)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:28.414532 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e3403-657e-484c-ade2-841eba346981 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:28.416365 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 48/92] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:41:28 2022] GET /identity/v3/projects/00fef40581d54f69b20ec6565c3cf274 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:28.417831 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e3403-657e-484c-ade2-841eba346981 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:28.500648 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:28.506520 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 45/93] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:41:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 17:41:28.508297 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac17f4-215b-4e05-afca-16d150da291e None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:28.541120 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e3403-657e-484c-ade2-841eba346981 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:28.584701 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7b771-63d7-4598-8a02-a9e4d159fa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:28.585463 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7b771-63d7-4598-8a02-a9e4d159fa09 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:28.585732 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7b771-63d7-4598-8a02-a9e4d159fa09 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:28.586010 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7b771-63d7-4598-8a02-a9e4d159fa09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:28.586900 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df7b771-63d7-4598-8a02-a9e4d159fa09 None admin] RBAC: Adding query filter params (role.id=1d93df17fd9a4d92b8c9966cc9deacde, scope.project.id=00fef40581d54f69b20ec6565c3cf274, user.id=593a808ea3dc4b34b162c475e055673b) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:28.587371 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df7b771-63d7-4598-8a02-a9e4d159fa09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:28.589061 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df7b771-63d7-4598-8a02-a9e4d159fa09 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:28.605358 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 49/94] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:41:28 2022] GET /identity/v3/role_assignments?user.id=593a808ea3dc4b34b162c475e055673b&scope.project.id=00fef40581d54f69b20ec6565c3cf274&role.id=1d93df17fd9a4d92b8c9966cc9deacde => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:28.607172 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7b771-63d7-4598-8a02-a9e4d159fa09 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:28.677430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac17f4-215b-4e05-afca-16d150da291e None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:28.680038 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:28.753040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3404d7-bcbe-4e95-ab30-3752cb8eaeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:28.755132 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3404d7-bcbe-4e95-ab30-3752cb8eaeaa None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:28.755435 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3404d7-bcbe-4e95-ab30-3752cb8eaeaa None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:28.755712 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3404d7-bcbe-4e95-ab30-3752cb8eaeaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:28.756469 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3404d7-bcbe-4e95-ab30-3752cb8eaeaa None admin] RBAC: Adding query filter params (role.id=be6ee971abf54b26be509c14823ece55, scope.project.id=00fef40581d54f69b20ec6565c3cf274, user.id=7155e9699cdb4b3f90bd34118e45f2bc) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:28.756789 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3404d7-bcbe-4e95-ab30-3752cb8eaeaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:28.758356 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3404d7-bcbe-4e95-ab30-3752cb8eaeaa None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:28.769913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 46/95] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:41:28 2022] GET /identity/v3/role_assignments?user.id=7155e9699cdb4b3f90bd34118e45f2bc&scope.project.id=00fef40581d54f69b20ec6565c3cf274&role.id=be6ee971abf54b26be509c14823ece55 => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:28.795722 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7b771-63d7-4598-8a02-a9e4d159fa09 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:28.847626 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03413b7-8203-4661-8668-0a415acebaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:28.848684 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03413b7-8203-4661-8668-0a415acebaa8 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:28.849210 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03413b7-8203-4661-8668-0a415acebaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:28.849723 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03413b7-8203-4661-8668-0a415acebaa8 None admin] PATH_INFO: `/v3/projects/db17102092c3487b8775cebba2be7d8a` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:28.851458 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03413b7-8203-4661-8668-0a415acebaa8 None admin] RBAC: Authorizing `identity:get_project(project_id=db17102092c3487b8775cebba2be7d8a)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:28.857389 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03413b7-8203-4661-8668-0a415acebaa8 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:28.859595 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 50/96] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:41:28 2022] GET /identity/v3/projects/db17102092c3487b8775cebba2be7d8a => generated 312 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:28.867102 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3404d7-bcbe-4e95-ab30-3752cb8eaeaa None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:28.960882 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:29.010536 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3404d7-bcbe-4e95-ab30-3752cb8eaeaa None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:29.052712 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204e92c-6471-47e6-b41b-332240ba0df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:29.053400 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204e92c-6471-47e6-b41b-332240ba0df4 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:29.053687 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204e92c-6471-47e6-b41b-332240ba0df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:29.053966 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204e92c-6471-47e6-b41b-332240ba0df4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:29.055520 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5204e92c-6471-47e6-b41b-332240ba0df4 None admin] RBAC: Adding query filter params (role.id=b4593720c06e4a0db655f8e33079a15f, scope.project.id=db17102092c3487b8775cebba2be7d8a, user.id=593a808ea3dc4b34b162c475e055673b) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:29.055836 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5204e92c-6471-47e6-b41b-332240ba0df4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:29.057331 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5204e92c-6471-47e6-b41b-332240ba0df4 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:29.063236 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 47/97] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:41:28 2022] GET /identity/v3/role_assignments?user.id=593a808ea3dc4b34b162c475e055673b&scope.project.id=db17102092c3487b8775cebba2be7d8a&role.id=b4593720c06e4a0db655f8e33079a15f => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:30.895946 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfafa0-a00c-4dc4-b739-eb33c346acf3 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:30.896448 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfafa0-a00c-4dc4-b739-eb33c346acf3 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:30.896521 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfafa0-a00c-4dc4-b739-eb33c346acf3 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:30.898092 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 51/98] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:41:30.903250 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82774976-90ad-446f-83a5-154fff2e1812 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:30.903641 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82774976-90ad-446f-83a5-154fff2e1812 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:30.903801 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82774976-90ad-446f-83a5-154fff2e1812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:30.926635 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-82774976-90ad-446f-83a5-154fff2e1812 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:30.927821 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-82774976-90ad-446f-83a5-154fff2e1812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:31.012086 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 48/99] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:41:31.162612 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4061ae9-62a9-48bb-b9e5-857d1ef4d085 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:31.162897 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4061ae9-62a9-48bb-b9e5-857d1ef4d085 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:31.163094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4061ae9-62a9-48bb-b9e5-857d1ef4d085 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:31.165002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 52/100] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 17:41:31.170559 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64704842-4c84-4f41-a6d5-5f07b31ee7d5 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:31.170855 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64704842-4c84-4f41-a6d5-5f07b31ee7d5 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:31.171131 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64704842-4c84-4f41-a6d5-5f07b31ee7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:31.198020 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-64704842-4c84-4f41-a6d5-5f07b31ee7d5 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:31.199224 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-64704842-4c84-4f41-a6d5-5f07b31ee7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:31.261499 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:31.277514 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 49/101] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:41:31.580650 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4061ae9-62a9-48bb-b9e5-857d1ef4d085 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:31.616045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64704842-4c84-4f41-a6d5-5f07b31ee7d5 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:31.794684 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4061ae9-62a9-48bb-b9e5-857d1ef4d085 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:31.797306 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:31.818102 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64704842-4c84-4f41-a6d5-5f07b31ee7d5 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:31.862525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2841970-6436-4ffe-94d8-d896f7f1be95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:31.863100 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2841970-6436-4ffe-94d8-d896f7f1be95 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:31.863379 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2841970-6436-4ffe-94d8-d896f7f1be95 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:31.863649 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2841970-6436-4ffe-94d8-d896f7f1be95 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:31.876106 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2841970-6436-4ffe-94d8-d896f7f1be95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:41:31.881047 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-b2841970-6436-4ffe-94d8-d896f7f1be95 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 17:41:31.881047 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:41:31.881047 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:41:31.881047 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:41:31.881047 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:41:31.881047 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:41:31.881047 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:41:31.881047 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:41:31.881047 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:41:31.881047 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:41:31.881047 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:41:31.881047 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:41:31.881047 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:41:31.881047 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:41:31.881047 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:41:31.881047 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:41:31.881983 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:41:31.881983 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:41:31.881983 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:41:31.881983 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:41:31.881983 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:41:31.881983 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:41:31.881983 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:41:31.881983 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:41:31.881983 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:41:31.881983 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:41:31.881983 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:41:31.881983 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:41:31.881983 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:41:31.881983 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:41:31.881983 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:41:31.881983 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:41:31.883309 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:41:31.883309 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:41:31.883309 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:41:31.883309 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:41:31.883309 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:41:31.883309 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:41:31.883309 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:41:31.883309 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:41:31.883309 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:41:31.883309 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:41:31.883309 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 17:41:31.883309 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:41:31.883309 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 50/102] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:41:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:41:31.884410 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a4f17-35bd-4910-97c7-50edac6051fc None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:31.884577 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a4f17-35bd-4910-97c7-50edac6051fc None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:31.885038 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a4f17-35bd-4910-97c7-50edac6051fc None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:31.886809 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 51/103] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:41:31.891559 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a4f17-35bd-4910-97c7-50edac6051fc None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:31.897758 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f150a9-78a9-45ef-b4fd-9af514a198df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:31.898453 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f150a9-78a9-45ef-b4fd-9af514a198df None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:31.898718 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f150a9-78a9-45ef-b4fd-9af514a198df None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:31.898994 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f150a9-78a9-45ef-b4fd-9af514a198df None admin] PATH_INFO: `/v3/roles/member` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:31.930669 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f150a9-78a9-45ef-b4fd-9af514a198df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:41:31.935843 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-40f150a9-78a9-45ef-b4fd-9af514a198df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 17:41:31.935843 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:41:31.935843 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:41:31.935843 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:41:31.935843 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:41:31.935843 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:41:31.935843 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:41:31.935843 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:41:31.935843 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:41:31.935843 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:41:31.935843 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:41:31.935843 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:41:31.935843 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:41:31.935843 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:41:31.935843 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:41:31.935843 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:41:31.936766 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:41:31.936766 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:41:31.936766 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:41:31.936766 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:41:31.936766 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:41:31.936766 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:41:31.936766 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:41:31.936766 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:41:31.936766 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:41:31.936766 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:41:31.936766 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:41:31.936766 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:41:31.936766 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:41:31.936766 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:41:31.936766 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:41:31.936766 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:41:31.937574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:41:31.937574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:41:31.937574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:41:31.937574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:41:31.937574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:41:31.937574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:41:31.937574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:41:31.937574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:41:31.937574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:41:31.937574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:41:31.937574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 17:41:31.937574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:41:31.937574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 53/104] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:41:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:41:31.938678 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a37b54-1826-4217-9d49-efab4653cb19 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:31.938931 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a37b54-1826-4217-9d49-efab4653cb19 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:31.939775 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a37b54-1826-4217-9d49-efab4653cb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:31.954852 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:31.967840 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-44a37b54-1826-4217-9d49-efab4653cb19 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:31.969101 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-44a37b54-1826-4217-9d49-efab4653cb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:32.045003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a4f17-35bd-4910-97c7-50edac6051fc None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:32.077836 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 54/105] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:41:32.078803 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a37b54-1826-4217-9d49-efab4653cb19 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:32.115820 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e08ad8-928b-49de-9694-59b048f40b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:32.116364 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e08ad8-928b-49de-9694-59b048f40b8a None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:32.116645 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e08ad8-928b-49de-9694-59b048f40b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:32.116961 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e08ad8-928b-49de-9694-59b048f40b8a None admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:32.117681 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e08ad8-928b-49de-9694-59b048f40b8a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:32.118234 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e08ad8-928b-49de-9694-59b048f40b8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:32.119712 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e08ad8-928b-49de-9694-59b048f40b8a None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:32.141865 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 52/106] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Sep 26 17:41:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:32.142992 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cba3d4-f8ea-4ac4-afa1-c52cccb5add6 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:32.144960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cba3d4-f8ea-4ac4-afa1-c52cccb5add6 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:32.145270 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cba3d4-f8ea-4ac4-afa1-c52cccb5add6 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:32.147670 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 53/107] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:41:32.152685 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b499277-e24c-4a30-b1ee-d9f4c6ecd619 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:32.152969 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b499277-e24c-4a30-b1ee-d9f4c6ecd619 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:32.153314 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b499277-e24c-4a30-b1ee-d9f4c6ecd619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:32.194118 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-3b499277-e24c-4a30-b1ee-d9f4c6ecd619 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:32.195659 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-3b499277-e24c-4a30-b1ee-d9f4c6ecd619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:32.217476 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:32.227943 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a37b54-1826-4217-9d49-efab4653cb19 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:32.298489 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f30a44-66c8-4144-94e3-207bda3a3d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:32.299452 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f30a44-66c8-4144-94e3-207bda3a3d70 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:32.299912 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f30a44-66c8-4144-94e3-207bda3a3d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:32.300361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f30a44-66c8-4144-94e3-207bda3a3d70 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:32.301438 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f30a44-66c8-4144-94e3-207bda3a3d70 None admin] RBAC: Adding query filter params (name=member) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:32.302258 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f30a44-66c8-4144-94e3-207bda3a3d70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:32.304326 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f30a44-66c8-4144-94e3-207bda3a3d70 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:32.310923 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 54/108] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:41:32.317053 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b499277-e24c-4a30-b1ee-d9f4c6ecd619 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:32.321226 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 55/109] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Sep 26 17:41:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:32.323873 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261b26f-d921-4cce-b4b4-03628e3e0114 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:32.324161 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261b26f-d921-4cce-b4b4-03628e3e0114 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:32.324437 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261b26f-d921-4cce-b4b4-03628e3e0114 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:32.328923 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 56/110] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:41:32.329673 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261b26f-d921-4cce-b4b4-03628e3e0114 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:32.381496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:32.446561 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b499277-e24c-4a30-b1ee-d9f4c6ecd619 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:32.484779 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261b26f-d921-4cce-b4b4-03628e3e0114 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:32.486147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9eed0f-5dbf-41bb-b753-997e511f3035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:32.486771 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9eed0f-5dbf-41bb-b753-997e511f3035 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:32.487047 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9eed0f-5dbf-41bb-b753-997e511f3035 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:32.487951 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9eed0f-5dbf-41bb-b753-997e511f3035 None admin] PATH_INFO: `/v3/users/e51b340c576249b8ad0d4fe08df42a2f` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:32.501805 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9eed0f-5dbf-41bb-b753-997e511f3035 None admin] RBAC: Authorizing `identity:get_user(user_id=e51b340c576249b8ad0d4fe08df42a2f)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:32.503268 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9eed0f-5dbf-41bb-b753-997e511f3035 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:32.505073 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 55/111] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:41:32 2022] GET /identity/v3/users/e51b340c576249b8ad0d4fe08df42a2f => generated 289 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:32.506194 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692fb8bc-1de7-4ae2-9f7e-ebae4460ab8b None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:32.506479 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692fb8bc-1de7-4ae2-9f7e-ebae4460ab8b None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:32.506751 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692fb8bc-1de7-4ae2-9f7e-ebae4460ab8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:32.522592 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4e050-b616-4074-81fa-07dc6ea7d0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:32.523256 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4e050-b616-4074-81fa-07dc6ea7d0c4 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:32.523540 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4e050-b616-4074-81fa-07dc6ea7d0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:32.523813 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4e050-b616-4074-81fa-07dc6ea7d0c4 None admin] PATH_INFO: `/v3/users/593a808ea3dc4b34b162c475e055673b` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:32.524981 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4e050-b616-4074-81fa-07dc6ea7d0c4 None admin] RBAC: Authorizing `identity:get_user(user_id=593a808ea3dc4b34b162c475e055673b)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:32.526616 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4e050-b616-4074-81fa-07dc6ea7d0c4 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:32.528385 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 57/112] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:41:32 2022] GET /identity/v3/users/593a808ea3dc4b34b162c475e055673b => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:32.529529 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-692fb8bc-1de7-4ae2-9f7e-ebae4460ab8b None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:32.530548 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18949528-8aa9-42b2-942a-88d68671d881 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:32.530721 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-692fb8bc-1de7-4ae2-9f7e-ebae4460ab8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:32.531193 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18949528-8aa9-42b2-942a-88d68671d881 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:32.531665 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18949528-8aa9-42b2-942a-88d68671d881 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:32.533275 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 58/113] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:41:32.534244 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18949528-8aa9-42b2-942a-88d68671d881 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:32.561204 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:32.609106 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 56/114] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:41:32.610070 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692fb8bc-1de7-4ae2-9f7e-ebae4460ab8b None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:32.639742 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:32.645211 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18949528-8aa9-42b2-942a-88d68671d881 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:32.682507 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3826ee7-ef5e-4461-a6e7-cdcc7a924a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:32.683228 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3826ee7-ef5e-4461-a6e7-cdcc7a924a8b None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:32.683579 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3826ee7-ef5e-4461-a6e7-cdcc7a924a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:32.683855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3826ee7-ef5e-4461-a6e7-cdcc7a924a8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:32.694560 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3826ee7-ef5e-4461-a6e7-cdcc7a924a8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:41:32.700420 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-d3826ee7-ef5e-4461-a6e7-cdcc7a924a8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:41:32.700420 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:41:32.700420 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:41:32.700420 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:41:32.700420 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:41:32.700420 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:41:32.700420 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:41:32.700420 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:41:32.700420 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:41:32.700420 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:41:32.700420 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:41:32.700420 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:41:32.700420 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:41:32.700420 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:41:32.700420 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:41:32.700420 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:41:32.701277 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:41:32.701277 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:41:32.701277 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:41:32.701277 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:41:32.701277 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:41:32.701277 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:41:32.701277 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:41:32.701277 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:41:32.701277 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:41:32.701277 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:41:32.701277 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:41:32.701277 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:41:32.701277 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:41:32.701277 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:41:32.701277 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:41:32.701277 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:41:32.702073 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:41:32.702073 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:41:32.702073 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:41:32.702073 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:41:32.702073 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:41:32.702073 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:41:32.702073 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:41:32.702073 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:41:32.702073 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:41:32.702073 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:41:32.702073 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:41:32.702073 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:41:32.702073 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 59/115] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Sep 26 17:41:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:41:32.702073 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3826ee7-ef5e-4461-a6e7-cdcc7a924a8b None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:32.724334 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692fb8bc-1de7-4ae2-9f7e-ebae4460ab8b None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:32.758393 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c734e7c-e9f9-474f-8a47-d41d1add7476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:32.759000 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c734e7c-e9f9-474f-8a47-d41d1add7476 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:32.759298 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c734e7c-e9f9-474f-8a47-d41d1add7476 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:32.759563 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c734e7c-e9f9-474f-8a47-d41d1add7476 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:32.794573 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:32.817063 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3826ee7-ef5e-4461-a6e7-cdcc7a924a8b None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:32.825376 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c734e7c-e9f9-474f-8a47-d41d1add7476 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:32.826860 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c734e7c-e9f9-474f-8a47-d41d1add7476 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:32.853940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:32.856651 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44971f-8623-4c09-ad0d-c7351b1d8142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:32.857648 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44971f-8623-4c09-ad0d-c7351b1d8142 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:32.858372 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44971f-8623-4c09-ad0d-c7351b1d8142 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:32.858664 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44971f-8623-4c09-ad0d-c7351b1d8142 None admin] PATH_INFO: `/v3/projects/00fef40581d54f69b20ec6565c3cf274` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:32.859803 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44971f-8623-4c09-ad0d-c7351b1d8142 None admin] RBAC: Authorizing `identity:get_project(project_id=00fef40581d54f69b20ec6565c3cf274)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:32.861884 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44971f-8623-4c09-ad0d-c7351b1d8142 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:32.868633 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 60/116] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:41:32 2022] GET /identity/v3/projects/00fef40581d54f69b20ec6565c3cf274 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:32.868633 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c6317-4bd5-454a-a4fd-2eda3e3e1bcf None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:32.868633 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c6317-4bd5-454a-a4fd-2eda3e3e1bcf None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:32.868633 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c6317-4bd5-454a-a4fd-2eda3e3e1bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:32.884264 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-e72c6317-4bd5-454a-a4fd-2eda3e3e1bcf None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:32.885493 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-e72c6317-4bd5-454a-a4fd-2eda3e3e1bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:32.939708 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 57/117] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:41:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 17:41:32.940563 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c734e7c-e9f9-474f-8a47-d41d1add7476 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:32.955613 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 61/118] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:41:32.956444 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c6317-4bd5-454a-a4fd-2eda3e3e1bcf None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:33.043731 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:33.051887 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c734e7c-e9f9-474f-8a47-d41d1add7476 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:33.063276 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c6317-4bd5-454a-a4fd-2eda3e3e1bcf None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:33.080064 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:33.090135 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cbe49c-8b3f-49f4-9f1a-0c174680c2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:33.090770 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbe49c-8b3f-49f4-9f1a-0c174680c2c2 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:33.091169 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbe49c-8b3f-49f4-9f1a-0c174680c2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:33.091512 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbe49c-8b3f-49f4-9f1a-0c174680c2c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:33.092732 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cbe49c-8b3f-49f4-9f1a-0c174680c2c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:33.094331 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cbe49c-8b3f-49f4-9f1a-0c174680c2c2 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:33.096227 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 58/119] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:41:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:33.099885 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ea4f4-418c-442a-8774-d260e16bcad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:33.100601 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ea4f4-418c-442a-8774-d260e16bcad2 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:33.100822 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ea4f4-418c-442a-8774-d260e16bcad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:33.101159 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ea4f4-418c-442a-8774-d260e16bcad2 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:33.101664 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cbe49c-8b3f-49f4-9f1a-0c174680c2c2 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:33.101834 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ea4f4-418c-442a-8774-d260e16bcad2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:33.102131 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ea4f4-418c-442a-8774-d260e16bcad2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:33.103508 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ea4f4-418c-442a-8774-d260e16bcad2 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:33.114506 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 62/120] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:41:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:33.114506 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ea4f4-418c-442a-8774-d260e16bcad2 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:33.216888 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cbe49c-8b3f-49f4-9f1a-0c174680c2c2 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:33.221747 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ea4f4-418c-442a-8774-d260e16bcad2 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:33.250987 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9497565-5e3c-489d-8552-3c77a26b9ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:33.251649 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9497565-5e3c-489d-8552-3c77a26b9ee8 None admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:33.251932 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9497565-5e3c-489d-8552-3c77a26b9ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:33.252212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9497565-5e3c-489d-8552-3c77a26b9ee8 None admin] PATH_INFO: `/v3/projects/00fef40581d54f69b20ec6565c3cf274/users/593a808ea3dc4b34b162c475e055673b/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:33.254152 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9497565-5e3c-489d-8552-3c77a26b9ee8 None admin] RBAC: Authorizing `identity:create_grant(project_id=00fef40581d54f69b20ec6565c3cf274, user_id=593a808ea3dc4b34b162c475e055673b, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:33.255707 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9497565-5e3c-489d-8552-3c77a26b9ee8 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:33.256182 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1759f3-6215-46ac-8003-f6bce911ab4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:33.256824 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1759f3-6215-46ac-8003-f6bce911ab4b None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:33.257145 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1759f3-6215-46ac-8003-f6bce911ab4b None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:33.257947 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1759f3-6215-46ac-8003-f6bce911ab4b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:33.268684 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 59/121] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Sep 26 17:41:33 2022] PUT /identity/v3/projects/00fef40581d54f69b20ec6565c3cf274/users/593a808ea3dc4b34b162c475e055673b/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:41:33.268814 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1759f3-6215-46ac-8003-f6bce911ab4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:41:33.273773 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9497565-5e3c-489d-8552-3c77a26b9ee8 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:33.274243 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-af1759f3-6215-46ac-8003-f6bce911ab4b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 17:41:33.274243 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:41:33.274243 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:41:33.274243 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:41:33.274243 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:41:33.274243 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:41:33.274243 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:41:33.274243 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:41:33.274243 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:41:33.274243 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:41:33.274243 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:41:33.274243 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:41:33.274243 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:41:33.274243 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:41:33.274243 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:41:33.274243 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:41:33.275075 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:41:33.275075 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:41:33.275075 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:41:33.275075 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:41:33.275075 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:41:33.275075 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:41:33.275075 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:41:33.275075 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:41:33.275075 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:41:33.275075 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:41:33.275075 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:41:33.275075 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:41:33.275075 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:41:33.275075 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:41:33.275075 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:41:33.275075 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:41:33.275883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:41:33.275883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:41:33.275883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:41:33.275883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:41:33.275883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:41:33.275883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:41:33.275883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:41:33.275883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:41:33.275883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:41:33.275883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:41:33.275883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 17:41:33.275883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:41:33.275883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 63/122] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:41:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:41:33.276535 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1759f3-6215-46ac-8003-f6bce911ab4b None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:33.279387 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:33.344547 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:33.405252 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9497565-5e3c-489d-8552-3c77a26b9ee8 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:33.405454 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1759f3-6215-46ac-8003-f6bce911ab4b None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:33.447735 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1d182-e00c-4e53-a18d-a242ea16f6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:33.448362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1d182-e00c-4e53-a18d-a242ea16f6be None admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:33.448644 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1d182-e00c-4e53-a18d-a242ea16f6be None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:33.448909 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1d182-e00c-4e53-a18d-a242ea16f6be None admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:33.449499 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b42934-c17a-472c-8b4d-a6b1ea166db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:33.449613 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e1d182-e00c-4e53-a18d-a242ea16f6be None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:33.450406 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b42934-c17a-472c-8b4d-a6b1ea166db8 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:33.450689 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b42934-c17a-472c-8b4d-a6b1ea166db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:33.450968 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b42934-c17a-472c-8b4d-a6b1ea166db8 None admin] PATH_INFO: `/v3/projects/00fef40581d54f69b20ec6565c3cf274` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:33.451292 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e1d182-e00c-4e53-a18d-a242ea16f6be None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:33.452202 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b42934-c17a-472c-8b4d-a6b1ea166db8 None admin] RBAC: Authorizing `identity:get_project(project_id=00fef40581d54f69b20ec6565c3cf274)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:33.453708 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b42934-c17a-472c-8b4d-a6b1ea166db8 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:33.455696 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 60/123] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:41:33 2022] GET /identity/v3/projects/00fef40581d54f69b20ec6565c3cf274 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:33.456976 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b42934-c17a-472c-8b4d-a6b1ea166db8 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:33.494822 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 64/124] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Sep 26 17:41:33 2022] POST /identity/v3/projects => generated 302 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:41:33.496002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1d182-e00c-4e53-a18d-a242ea16f6be None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:33.576396 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:33.614922 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b42934-c17a-472c-8b4d-a6b1ea166db8 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:33.635710 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1d182-e00c-4e53-a18d-a242ea16f6be None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:33.652923 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:33.675306 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c920e29-8c01-42b3-aaf8-bece2c3496c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:33.675997 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c920e29-8c01-42b3-aaf8-bece2c3496c8 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:33.676278 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c920e29-8c01-42b3-aaf8-bece2c3496c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:33.676549 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c920e29-8c01-42b3-aaf8-bece2c3496c8 None admin] PATH_INFO: `/v3/users/7155e9699cdb4b3f90bd34118e45f2bc` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:33.677807 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c920e29-8c01-42b3-aaf8-bece2c3496c8 None admin] RBAC: Authorizing `identity:get_user(user_id=7155e9699cdb4b3f90bd34118e45f2bc)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:33.679878 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c920e29-8c01-42b3-aaf8-bece2c3496c8 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:33.681594 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 61/125] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:41:33 2022] GET /identity/v3/users/7155e9699cdb4b3f90bd34118e45f2bc => generated 247 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:33.682430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c920e29-8c01-42b3-aaf8-bece2c3496c8 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:33.690200 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833251e-d291-4185-8b30-3fc1cb0a5567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:33.691242 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833251e-d291-4185-8b30-3fc1cb0a5567 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:33.691727 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833251e-d291-4185-8b30-3fc1cb0a5567 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:33.692199 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833251e-d291-4185-8b30-3fc1cb0a5567 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:33.708064 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833251e-d291-4185-8b30-3fc1cb0a5567 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:41:33.714588 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-e833251e-d291-4185-8b30-3fc1cb0a5567 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 17:41:33.714588 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:41:33.714588 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:41:33.714588 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:41:33.714588 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:41:33.714588 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:41:33.714588 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:41:33.714588 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:41:33.714588 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:41:33.714588 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:41:33.714588 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:41:33.714588 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:41:33.714588 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:41:33.714588 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:41:33.714588 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:41:33.714588 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:41:33.715465 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:41:33.715465 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:41:33.715465 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:41:33.715465 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:41:33.715465 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:41:33.715465 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:41:33.715465 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:41:33.715465 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:41:33.715465 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:41:33.715465 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:41:33.715465 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:41:33.715465 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:41:33.715465 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:41:33.715465 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:41:33.715465 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:41:33.715465 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:41:33.716239 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:41:33.716239 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:41:33.716239 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:41:33.716239 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:41:33.716239 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:41:33.716239 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:41:33.716239 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:41:33.716239 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:41:33.716239 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:41:33.716239 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:41:33.716239 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 17:41:33.716239 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:41:33.716239 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 65/126] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Sep 26 17:41:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:41:33.716891 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833251e-d291-4185-8b30-3fc1cb0a5567 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:33.803348 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c920e29-8c01-42b3-aaf8-bece2c3496c8 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:33.846942 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24458c35-658d-4324-81d5-d95932c12044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:33.847979 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24458c35-658d-4324-81d5-d95932c12044 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:33.848430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24458c35-658d-4324-81d5-d95932c12044 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:33.848867 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24458c35-658d-4324-81d5-d95932c12044 None admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:33.849453 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833251e-d291-4185-8b30-3fc1cb0a5567 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:33.849922 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24458c35-658d-4324-81d5-d95932c12044 None admin] RBAC: Adding query filter params (name=member) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:33.850393 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24458c35-658d-4324-81d5-d95932c12044 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:33.853320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24458c35-658d-4324-81d5-d95932c12044 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:33.865894 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 62/127] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Sep 26 17:41:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:33.868004 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24458c35-658d-4324-81d5-d95932c12044 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:33.868240 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:33.894106 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5328225-6893-4392-86e5-3fef7fd59fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:33.894726 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5328225-6893-4392-86e5-3fef7fd59fbc None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:33.895018 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5328225-6893-4392-86e5-3fef7fd59fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:33.895291 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5328225-6893-4392-86e5-3fef7fd59fbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:33.896585 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5328225-6893-4392-86e5-3fef7fd59fbc None admin] RBAC: Adding query filter params (role.id=def729f162f44f65b2e2bf261dde9b39, scope.project.id=00fef40581d54f69b20ec6565c3cf274, user.id=e51b340c576249b8ad0d4fe08df42a2f) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:33.896892 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5328225-6893-4392-86e5-3fef7fd59fbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:33.898757 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5328225-6893-4392-86e5-3fef7fd59fbc None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:33.906405 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 66/128] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:41:33 2022] GET /identity/v3/role_assignments?user.id=e51b340c576249b8ad0d4fe08df42a2f&scope.project.id=00fef40581d54f69b20ec6565c3cf274&role.id=def729f162f44f65b2e2bf261dde9b39 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:33.909208 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5328225-6893-4392-86e5-3fef7fd59fbc None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:33.975583 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:34.070848 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24458c35-658d-4324-81d5-d95932c12044 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:34.126537 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5328225-6893-4392-86e5-3fef7fd59fbc None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:34.127671 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f480f-f38f-4618-9e61-68d9e12459d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:34.128793 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f480f-f38f-4618-9e61-68d9e12459d2 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:34.129907 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f480f-f38f-4618-9e61-68d9e12459d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:34.129907 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f480f-f38f-4618-9e61-68d9e12459d2 None admin] PATH_INFO: `/v3/projects/00fef40581d54f69b20ec6565c3cf274` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:34.131472 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283f480f-f38f-4618-9e61-68d9e12459d2 None admin] RBAC: Authorizing `identity:get_project(project_id=00fef40581d54f69b20ec6565c3cf274)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:34.133626 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283f480f-f38f-4618-9e61-68d9e12459d2 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:34.135285 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 63/129] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:41:33 2022] GET /identity/v3/projects/00fef40581d54f69b20ec6565c3cf274 => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:34.140830 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f480f-f38f-4618-9e61-68d9e12459d2 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:34.169267 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5120a-cdfc-413d-b19b-1851dcc630a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:34.172765 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5120a-cdfc-413d-b19b-1851dcc630a8 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:34.173216 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5120a-cdfc-413d-b19b-1851dcc630a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:34.173694 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5120a-cdfc-413d-b19b-1851dcc630a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:34.174505 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5120a-cdfc-413d-b19b-1851dcc630a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:34.175183 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5120a-cdfc-413d-b19b-1851dcc630a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:34.177779 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5120a-cdfc-413d-b19b-1851dcc630a8 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:34.192489 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 67/130] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:41:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:34.197249 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5120a-cdfc-413d-b19b-1851dcc630a8 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:34.258088 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:34.344928 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f480f-f38f-4618-9e61-68d9e12459d2 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:34.357054 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5120a-cdfc-413d-b19b-1851dcc630a8 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:34.389399 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:34.399829 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6871c15-9c34-4fd9-ba30-a57210ffd89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:34.400718 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6871c15-9c34-4fd9-ba30-a57210ffd89c None admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:34.401185 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6871c15-9c34-4fd9-ba30-a57210ffd89c None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:34.401623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6871c15-9c34-4fd9-ba30-a57210ffd89c None admin] PATH_INFO: `/v3/projects/00fef40581d54f69b20ec6565c3cf274/users/7155e9699cdb4b3f90bd34118e45f2bc/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:34.403915 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6871c15-9c34-4fd9-ba30-a57210ffd89c None admin] RBAC: Authorizing `identity:create_grant(project_id=00fef40581d54f69b20ec6565c3cf274, user_id=7155e9699cdb4b3f90bd34118e45f2bc, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:34.405578 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6871c15-9c34-4fd9-ba30-a57210ffd89c None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:34.413306 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf7283-011c-42f1-913d-7138d0fe20b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:34.415142 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf7283-011c-42f1-913d-7138d0fe20b3 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:34.415142 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf7283-011c-42f1-913d-7138d0fe20b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:34.415142 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf7283-011c-42f1-913d-7138d0fe20b3 None admin] PATH_INFO: `/v3/users/593a808ea3dc4b34b162c475e055673b` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:34.417864 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf7283-011c-42f1-913d-7138d0fe20b3 None admin] RBAC: Authorizing `identity:get_user(user_id=593a808ea3dc4b34b162c475e055673b)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:34.422262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf7283-011c-42f1-913d-7138d0fe20b3 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:34.425060 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 64/131] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:41:34 2022] GET /identity/v3/users/593a808ea3dc4b34b162c475e055673b => generated 275 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:34.428305 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf7283-011c-42f1-913d-7138d0fe20b3 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:34.431760 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 68/132] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Sep 26 17:41:34 2022] PUT /identity/v3/projects/00fef40581d54f69b20ec6565c3cf274/users/7155e9699cdb4b3f90bd34118e45f2bc/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:41:34.432727 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6871c15-9c34-4fd9-ba30-a57210ffd89c None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:34.627559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:34.632182 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6871c15-9c34-4fd9-ba30-a57210ffd89c None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:34.640644 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf7283-011c-42f1-913d-7138d0fe20b3 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:34.689804 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f20d3-adb1-4f90-8bea-465c08edc0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:34.690461 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f20d3-adb1-4f90-8bea-465c08edc0ec None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:34.690748 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f20d3-adb1-4f90-8bea-465c08edc0ec None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:34.691029 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f20d3-adb1-4f90-8bea-465c08edc0ec None admin] PATH_INFO: `/v3/users/593a808ea3dc4b34b162c475e055673b` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:34.692245 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f20d3-adb1-4f90-8bea-465c08edc0ec None admin] RBAC: Authorizing `identity:get_user(user_id=593a808ea3dc4b34b162c475e055673b)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:34.693942 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f20d3-adb1-4f90-8bea-465c08edc0ec None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:34.696194 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 65/133] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:41:34 2022] GET /identity/v3/users/593a808ea3dc4b34b162c475e055673b => generated 275 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:34.702102 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f20d3-adb1-4f90-8bea-465c08edc0ec None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:34.712036 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d32dd-14c4-4599-a2fa-9f3a31d9b397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:34.712696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d32dd-14c4-4599-a2fa-9f3a31d9b397 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:34.712982 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d32dd-14c4-4599-a2fa-9f3a31d9b397 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:34.713285 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d32dd-14c4-4599-a2fa-9f3a31d9b397 None admin] PATH_INFO: `/v3/projects/db17102092c3487b8775cebba2be7d8a` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:34.714439 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d32dd-14c4-4599-a2fa-9f3a31d9b397 None admin] RBAC: Authorizing `identity:get_project(project_id=db17102092c3487b8775cebba2be7d8a)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:34.715906 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d32dd-14c4-4599-a2fa-9f3a31d9b397 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:34.724351 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 69/134] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:41:34 2022] GET /identity/v3/projects/db17102092c3487b8775cebba2be7d8a => generated 312 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:34.730452 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d32dd-14c4-4599-a2fa-9f3a31d9b397 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:34.794847 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:34.847653 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f20d3-adb1-4f90-8bea-465c08edc0ec None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:34.874551 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d32dd-14c4-4599-a2fa-9f3a31d9b397 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:34.904908 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c78fa-9708-4e8d-ae09-a568bdc59111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:34.905845 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c78fa-9708-4e8d-ae09-a568bdc59111 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:34.907246 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c78fa-9708-4e8d-ae09-a568bdc59111 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:34.907697 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c78fa-9708-4e8d-ae09-a568bdc59111 None admin] PATH_INFO: `/v3/projects/00fef40581d54f69b20ec6565c3cf274` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:34.910464 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c78fa-9708-4e8d-ae09-a568bdc59111 None admin] RBAC: Authorizing `identity:get_project(project_id=00fef40581d54f69b20ec6565c3cf274)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:34.912206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c78fa-9708-4e8d-ae09-a568bdc59111 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:34.915472 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 66/135] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:41:34 2022] GET /identity/v3/projects/00fef40581d54f69b20ec6565c3cf274 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:41:34.921244 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c78fa-9708-4e8d-ae09-a568bdc59111 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:34.936579 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda39f2-f13d-4b46-850d-4e1401d57346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:34.937572 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda39f2-f13d-4b46-850d-4e1401d57346 None admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:34.938052 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda39f2-f13d-4b46-850d-4e1401d57346 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:34.938497 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda39f2-f13d-4b46-850d-4e1401d57346 None admin] PATH_INFO: `/v3/projects/db17102092c3487b8775cebba2be7d8a/users/593a808ea3dc4b34b162c475e055673b/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:34.940843 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda39f2-f13d-4b46-850d-4e1401d57346 None admin] RBAC: Authorizing `identity:create_grant(project_id=db17102092c3487b8775cebba2be7d8a, user_id=593a808ea3dc4b34b162c475e055673b, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:34.944337 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda39f2-f13d-4b46-850d-4e1401d57346 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:34.966703 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 70/136] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Sep 26 17:41:34 2022] PUT /identity/v3/projects/db17102092c3487b8775cebba2be7d8a/users/593a808ea3dc4b34b162c475e055673b/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:41:35.081135 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c78fa-9708-4e8d-ae09-a568bdc59111 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:35.111057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:35.126061 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3469849-02e7-4111-b031-6bd5a8eb709d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:35.127026 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3469849-02e7-4111-b031-6bd5a8eb709d None admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:35.127484 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3469849-02e7-4111-b031-6bd5a8eb709d None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:35.127963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3469849-02e7-4111-b031-6bd5a8eb709d None admin] PATH_INFO: `/v3/projects/00fef40581d54f69b20ec6565c3cf274/users/593a808ea3dc4b34b162c475e055673b/roles/1d93df17fd9a4d92b8c9966cc9deacde` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:35.130432 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3469849-02e7-4111-b031-6bd5a8eb709d None admin] RBAC: Authorizing `identity:create_grant(project_id=00fef40581d54f69b20ec6565c3cf274, user_id=593a808ea3dc4b34b162c475e055673b, role_id=1d93df17fd9a4d92b8c9966cc9deacde)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:35.132142 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3469849-02e7-4111-b031-6bd5a8eb709d None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:35.151120 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 67/137] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Sep 26 17:41:34 2022] PUT /identity/v3/projects/00fef40581d54f69b20ec6565c3cf274/users/593a808ea3dc4b34b162c475e055673b/roles/1d93df17fd9a4d92b8c9966cc9deacde => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:41:36.033542 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57f045-c078-4c5f-87c8-cde5c6ec197f None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:36.034214 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57f045-c078-4c5f-87c8-cde5c6ec197f None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:36.034214 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57f045-c078-4c5f-87c8-cde5c6ec197f None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:36.036061 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 71/138] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:41:36.041845 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f4a46-f613-4836-89c6-0f1d3e57fa18 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:36.042133 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f4a46-f613-4836-89c6-0f1d3e57fa18 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:36.042412 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f4a46-f613-4836-89c6-0f1d3e57fa18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:36.064697 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-242f4a46-f613-4836-89c6-0f1d3e57fa18 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:36.065909 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-242f4a46-f613-4836-89c6-0f1d3e57fa18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:36.161261 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 68/139] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:41:36.659022 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587eeea-5351-436b-abac-1d8669777042 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:36.659384 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587eeea-5351-436b-abac-1d8669777042 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:36.659492 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587eeea-5351-436b-abac-1d8669777042 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:36.660841 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 72/140] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:41:36.670961 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb61f47-b7ca-4e2e-877b-6ddb2c5f63f8 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:36.671293 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb61f47-b7ca-4e2e-877b-6ddb2c5f63f8 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:36.671573 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb61f47-b7ca-4e2e-877b-6ddb2c5f63f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:36.698012 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-0eb61f47-b7ca-4e2e-877b-6ddb2c5f63f8 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:36.699190 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-0eb61f47-b7ca-4e2e-877b-6ddb2c5f63f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:36.713205 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587eeea-5351-436b-abac-1d8669777042 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:36.762427 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:36.795173 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 69/141] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:41:36.870372 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587eeea-5351-436b-abac-1d8669777042 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:36.911096 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2147641-7eb5-4a01-8b40-1abc2323a588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:36.911659 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2147641-7eb5-4a01-8b40-1abc2323a588 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:36.911939 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2147641-7eb5-4a01-8b40-1abc2323a588 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:36.912211 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2147641-7eb5-4a01-8b40-1abc2323a588 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:36.927765 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2147641-7eb5-4a01-8b40-1abc2323a588 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:41:36.933736 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-a2147641-7eb5-4a01-8b40-1abc2323a588 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 17:41:36.933736 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:41:36.933736 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:41:36.933736 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:41:36.933736 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:41:36.933736 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:41:36.933736 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:41:36.933736 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:41:36.933736 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:41:36.933736 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:41:36.933736 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:41:36.933736 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:41:36.933736 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:41:36.933736 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:41:36.933736 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:41:36.933736 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:41:36.934624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:41:36.934624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:41:36.934624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:41:36.934624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:41:36.934624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:41:36.934624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:41:36.934624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:41:36.934624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:41:36.934624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:41:36.934624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:41:36.934624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:41:36.934624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:41:36.934624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:41:36.934624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:41:36.934624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:41:36.934624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:41:36.935491 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:41:36.935491 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:41:36.935491 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:41:36.935491 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:41:36.935491 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:41:36.935491 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:41:36.935491 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:41:36.935491 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:41:36.935491 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:41:36.935491 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:41:36.935491 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 17:41:36.935491 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:41:36.935491 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 73/142] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:41:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:41:36.943526 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb61f47-b7ca-4e2e-877b-6ddb2c5f63f8 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:37.005727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:37.071543 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb61f47-b7ca-4e2e-877b-6ddb2c5f63f8 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:37.106469 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bafc534-7e1f-406f-bca3-986e621792d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:37.107075 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafc534-7e1f-406f-bca3-986e621792d2 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:37.107363 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafc534-7e1f-406f-bca3-986e621792d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:37.107632 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafc534-7e1f-406f-bca3-986e621792d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:37.108296 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bafc534-7e1f-406f-bca3-986e621792d2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:37.108592 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bafc534-7e1f-406f-bca3-986e621792d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:37.109997 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bafc534-7e1f-406f-bca3-986e621792d2 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:37.119274 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 70/143] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Sep 26 17:41:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:41:37.125001 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2147641-7eb5-4a01-8b40-1abc2323a588 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:37.154314 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8953a-014a-4dfe-87c6-8572a5484a5d None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:37.154621 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8953a-014a-4dfe-87c6-8572a5484a5d None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:37.154858 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8953a-014a-4dfe-87c6-8572a5484a5d None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:37.156389 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 71/144] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:41:37.165801 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb65e3-8bc3-40d9-8d1d-6b9cc6ba706f None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:37.166389 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb65e3-8bc3-40d9-8d1d-6b9cc6ba706f None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:37.166389 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb65e3-8bc3-40d9-8d1d-6b9cc6ba706f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:37.185273 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-b1cb65e3-8bc3-40d9-8d1d-6b9cc6ba706f None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:37.186451 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-b1cb65e3-8bc3-40d9-8d1d-6b9cc6ba706f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:37.261897 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 72/145] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 17:41:37.269236 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb65e3-8bc3-40d9-8d1d-6b9cc6ba706f None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:37.270411 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:37.294404 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2147641-7eb5-4a01-8b40-1abc2323a588 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:37.330075 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:37.381935 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080642b5-d193-471a-908c-f35456ed442e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:37.382954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080642b5-d193-471a-908c-f35456ed442e None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:37.383485 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080642b5-d193-471a-908c-f35456ed442e None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:37.384010 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080642b5-d193-471a-908c-f35456ed442e None admin] PATH_INFO: `/v3/users/593a808ea3dc4b34b162c475e055673b` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:37.387250 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080642b5-d193-471a-908c-f35456ed442e None admin] RBAC: Authorizing `identity:get_user(user_id=593a808ea3dc4b34b162c475e055673b)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:37.394053 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080642b5-d193-471a-908c-f35456ed442e None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:37.396484 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 74/146] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:41:37 2022] GET /identity/v3/users/593a808ea3dc4b34b162c475e055673b => generated 275 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:37.416881 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080642b5-d193-471a-908c-f35456ed442e None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:37.423935 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb65e3-8bc3-40d9-8d1d-6b9cc6ba706f None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:37.464297 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec180f-78f8-44ff-a8f5-cdb94780e757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:37.464927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec180f-78f8-44ff-a8f5-cdb94780e757 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:37.465231 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec180f-78f8-44ff-a8f5-cdb94780e757 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:37.465501 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec180f-78f8-44ff-a8f5-cdb94780e757 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:37.467033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec180f-78f8-44ff-a8f5-cdb94780e757 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:37.468738 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec180f-78f8-44ff-a8f5-cdb94780e757 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:37.470804 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 73/147] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:41:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:41:37.477856 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec180f-78f8-44ff-a8f5-cdb94780e757 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:37.594549 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec180f-78f8-44ff-a8f5-cdb94780e757 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:37.603486 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:37.620923 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080642b5-d193-471a-908c-f35456ed442e None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:37.635284 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78c6c0-c961-41b6-9267-4f681766337a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:37.636026 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78c6c0-c961-41b6-9267-4f681766337a None admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:37.636512 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78c6c0-c961-41b6-9267-4f681766337a None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:37.636879 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78c6c0-c961-41b6-9267-4f681766337a None admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:37.637653 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78c6c0-c961-41b6-9267-4f681766337a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:37.640108 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78c6c0-c961-41b6-9267-4f681766337a None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:37.675745 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 74/148] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Sep 26 17:41:37 2022] POST /identity/v3/users => generated 283 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 17:41:37.682915 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb504125-2e87-49f5-b2f4-487be6486799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:37.683905 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb504125-2e87-49f5-b2f4-487be6486799 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:37.684348 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb504125-2e87-49f5-b2f4-487be6486799 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:37.684906 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb504125-2e87-49f5-b2f4-487be6486799 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:37.716715 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:37.725084 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78c6c0-c961-41b6-9267-4f681766337a None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:37.777824 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb504125-2e87-49f5-b2f4-487be6486799 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:37.779613 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb504125-2e87-49f5-b2f4-487be6486799 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:37.907201 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 75/149] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:41:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 26 17:41:37.918912 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb504125-2e87-49f5-b2f4-487be6486799 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:37.925120 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78c6c0-c961-41b6-9267-4f681766337a None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:38.000804 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fadba-1167-49ef-bc48-72082abdbcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:38.002394 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fadba-1167-49ef-bc48-72082abdbcce None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:38.002919 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fadba-1167-49ef-bc48-72082abdbcce None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:38.003866 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fadba-1167-49ef-bc48-72082abdbcce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:38.020163 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9fadba-1167-49ef-bc48-72082abdbcce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:41:38.021379 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:38.032480 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-2f9fadba-1167-49ef-bc48-72082abdbcce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 17:41:38.032480 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:41:38.032480 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:41:38.032480 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:41:38.032480 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:41:38.032480 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:41:38.032480 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:41:38.032480 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:41:38.032480 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:41:38.032480 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:41:38.032480 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:41:38.032480 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:41:38.032480 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:41:38.032480 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:41:38.032480 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:41:38.032480 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:41:38.033481 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:41:38.033481 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:41:38.033481 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:41:38.033481 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:41:38.033481 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:41:38.033481 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:41:38.033481 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:41:38.033481 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:41:38.033481 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:41:38.033481 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:41:38.033481 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:41:38.033481 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:41:38.033481 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:41:38.033481 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:41:38.033481 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:41:38.033481 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:41:38.034315 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:41:38.034315 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:41:38.034315 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:41:38.034315 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:41:38.034315 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:41:38.034315 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:41:38.034315 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:41:38.034315 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:41:38.034315 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:41:38.034315 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:41:38.034315 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 17:41:38.034315 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:41:38.038651 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 75/150] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:41:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:41:38.046828 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fadba-1167-49ef-bc48-72082abdbcce None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:38.076622 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:38.090392 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb504125-2e87-49f5-b2f4-487be6486799 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:38.132827 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3e146-ce1f-459b-8015-96fb80d2fc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:38.134943 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3e146-ce1f-459b-8015-96fb80d2fc8f None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:38.135402 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3e146-ce1f-459b-8015-96fb80d2fc8f None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:38.135869 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3e146-ce1f-459b-8015-96fb80d2fc8f None admin] PATH_INFO: `/v3/projects/00fef40581d54f69b20ec6565c3cf274` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:38.137894 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3e146-ce1f-459b-8015-96fb80d2fc8f None admin] RBAC: Authorizing `identity:get_project(project_id=00fef40581d54f69b20ec6565c3cf274)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:38.140258 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3e146-ce1f-459b-8015-96fb80d2fc8f None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:38.142278 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 76/151] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:41:37 2022] GET /identity/v3/projects/00fef40581d54f69b20ec6565c3cf274 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:41:38.149894 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3e146-ce1f-459b-8015-96fb80d2fc8f None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:38.168975 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fadba-1167-49ef-bc48-72082abdbcce None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:38.213590 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d1db1-072a-4fbb-95af-a7a6392a94ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:38.214467 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d1db1-072a-4fbb-95af-a7a6392a94ce None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:38.214942 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d1db1-072a-4fbb-95af-a7a6392a94ce None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:38.215356 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d1db1-072a-4fbb-95af-a7a6392a94ce None admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:38.216324 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d1db1-072a-4fbb-95af-a7a6392a94ce None admin] RBAC: Adding query filter params (name=reader) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:38.216805 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d1db1-072a-4fbb-95af-a7a6392a94ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:38.219235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d1db1-072a-4fbb-95af-a7a6392a94ce None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:38.229600 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 76/152] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Sep 26 17:41:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:38.231126 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda77eb-1247-4f32-85e3-47ff86d9a268 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:38.231609 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda77eb-1247-4f32-85e3-47ff86d9a268 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:38.232093 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda77eb-1247-4f32-85e3-47ff86d9a268 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:38.235036 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 77/153] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:41:38.239878 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda77eb-1247-4f32-85e3-47ff86d9a268 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:38.298050 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3e146-ce1f-459b-8015-96fb80d2fc8f None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:38.334976 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:38.351808 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f1f58-33a7-41d3-9efd-4b8008c732e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:38.352458 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f1f58-33a7-41d3-9efd-4b8008c732e9 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:38.352736 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f1f58-33a7-41d3-9efd-4b8008c732e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:38.353393 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f1f58-33a7-41d3-9efd-4b8008c732e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:38.354469 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f1f58-33a7-41d3-9efd-4b8008c732e9 None admin] RBAC: Adding query filter params (role.id=b4593720c06e4a0db655f8e33079a15f, scope.project.id=00fef40581d54f69b20ec6565c3cf274, user.id=593a808ea3dc4b34b162c475e055673b) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:38.354789 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f1f58-33a7-41d3-9efd-4b8008c732e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:38.357035 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f1f58-33a7-41d3-9efd-4b8008c732e9 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:38.363161 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:38.365577 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 77/154] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:41:38 2022] GET /identity/v3/role_assignments?user.id=593a808ea3dc4b34b162c475e055673b&scope.project.id=00fef40581d54f69b20ec6565c3cf274&role.id=b4593720c06e4a0db655f8e33079a15f => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:38.366714 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5171a4-ea7a-42f8-b4ee-db7493eae6ca None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:38.367052 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5171a4-ea7a-42f8-b4ee-db7493eae6ca None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:38.367326 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5171a4-ea7a-42f8-b4ee-db7493eae6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:38.403698 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-af5171a4-ea7a-42f8-b4ee-db7493eae6ca None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:38.405357 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-af5171a4-ea7a-42f8-b4ee-db7493eae6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:38.425847 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda77eb-1247-4f32-85e3-47ff86d9a268 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:38.519267 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 78/155] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:41:38.520488 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11ba74-9353-419e-8f1f-f83c162a65ef None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:38.520799 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11ba74-9353-419e-8f1f-f83c162a65ef None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:38.524208 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753da46-e598-402c-85f9-0177634fad3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:38.525075 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11ba74-9353-419e-8f1f-f83c162a65ef None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:38.525480 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753da46-e598-402c-85f9-0177634fad3c None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:38.525958 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753da46-e598-402c-85f9-0177634fad3c None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:38.526448 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753da46-e598-402c-85f9-0177634fad3c None admin] PATH_INFO: `/v3/users/e51b340c576249b8ad0d4fe08df42a2f` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:38.526617 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 79/156] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:41:38.528062 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753da46-e598-402c-85f9-0177634fad3c None admin] RBAC: Authorizing `identity:get_user(user_id=e51b340c576249b8ad0d4fe08df42a2f)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:38.529851 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753da46-e598-402c-85f9-0177634fad3c None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:38.532237 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 78/157] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:41:38 2022] GET /identity/v3/users/e51b340c576249b8ad0d4fe08df42a2f => generated 289 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:41:38.537853 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a77293-1e5b-48bb-b3c9-7eaa01de0a61 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:38.537995 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753da46-e598-402c-85f9-0177634fad3c None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:38.538192 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a77293-1e5b-48bb-b3c9-7eaa01de0a61 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:38.538411 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a77293-1e5b-48bb-b3c9-7eaa01de0a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:38.566975 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-80a77293-1e5b-48bb-b3c9-7eaa01de0a61 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:38.568119 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-80a77293-1e5b-48bb-b3c9-7eaa01de0a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:38.654418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 80/158] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:41:38.739812 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753da46-e598-402c-85f9-0177634fad3c None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:38.756180 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1e62a-fc77-48f9-9119-49f83dab8136 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:38.756562 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1e62a-fc77-48f9-9119-49f83dab8136 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:38.756757 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1e62a-fc77-48f9-9119-49f83dab8136 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:38.759451 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 81/159] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 17:41:38.764795 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04032182-63ab-4d74-9a54-b600a938bb07 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:38.765112 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04032182-63ab-4d74-9a54-b600a938bb07 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:38.765393 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04032182-63ab-4d74-9a54-b600a938bb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:38.792139 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304019d5-feff-42a5-8043-ad4ec5143001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:38.793340 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304019d5-feff-42a5-8043-ad4ec5143001 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:38.793866 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304019d5-feff-42a5-8043-ad4ec5143001 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:38.794366 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304019d5-feff-42a5-8043-ad4ec5143001 None admin] PATH_INFO: `/v3/projects/00fef40581d54f69b20ec6565c3cf274` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:38.795686 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304019d5-feff-42a5-8043-ad4ec5143001 None admin] RBAC: Authorizing `identity:get_project(project_id=00fef40581d54f69b20ec6565c3cf274)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:38.797466 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304019d5-feff-42a5-8043-ad4ec5143001 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:38.797992 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-04032182-63ab-4d74-9a54-b600a938bb07 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:38.799191 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-04032182-63ab-4d74-9a54-b600a938bb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:38.799960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 79/160] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:41:38 2022] GET /identity/v3/projects/00fef40581d54f69b20ec6565c3cf274 => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:41:38.809489 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304019d5-feff-42a5-8043-ad4ec5143001 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:38.852290 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:38.863429 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:38.899462 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 82/161] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:41:38.926532 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04032182-63ab-4d74-9a54-b600a938bb07 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:38.988333 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304019d5-feff-42a5-8043-ad4ec5143001 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:39.046798 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04032182-63ab-4d74-9a54-b600a938bb07 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:39.049438 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b90e4a-93b9-4cfd-9588-10c46d4a1195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:39.050113 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b90e4a-93b9-4cfd-9588-10c46d4a1195 None admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:39.050393 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b90e4a-93b9-4cfd-9588-10c46d4a1195 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:39.050668 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b90e4a-93b9-4cfd-9588-10c46d4a1195 None admin] PATH_INFO: `/v3/projects/00fef40581d54f69b20ec6565c3cf274/users/e51b340c576249b8ad0d4fe08df42a2f/roles/def729f162f44f65b2e2bf261dde9b39` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:39.052767 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b90e4a-93b9-4cfd-9588-10c46d4a1195 None admin] RBAC: Authorizing `identity:create_grant(project_id=00fef40581d54f69b20ec6565c3cf274, user_id=e51b340c576249b8ad0d4fe08df42a2f, role_id=def729f162f44f65b2e2bf261dde9b39)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:39.060302 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b90e4a-93b9-4cfd-9588-10c46d4a1195 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:39.080142 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 80/162] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Sep 26 17:41:38 2022] PUT /identity/v3/projects/00fef40581d54f69b20ec6565c3cf274/users/e51b340c576249b8ad0d4fe08df42a2f/roles/def729f162f44f65b2e2bf261dde9b39 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:41:39.085977 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2cc48-28a7-4bc9-b277-30ace9ad49df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:39.086678 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2cc48-28a7-4bc9-b277-30ace9ad49df None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:39.086961 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2cc48-28a7-4bc9-b277-30ace9ad49df None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:39.087229 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2cc48-28a7-4bc9-b277-30ace9ad49df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:39.099264 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e2cc48-28a7-4bc9-b277-30ace9ad49df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:41:39.105086 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-f6e2cc48-28a7-4bc9-b277-30ace9ad49df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:41:39.105086 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:41:39.105086 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:41:39.105086 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:41:39.105086 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:41:39.105086 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:41:39.105086 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:41:39.105086 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:41:39.105086 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:41:39.105086 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:41:39.105086 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:41:39.105086 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:41:39.105086 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:41:39.105086 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:41:39.105086 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:41:39.105086 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:41:39.106130 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:41:39.106130 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:41:39.106130 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:41:39.106130 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:41:39.106130 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:41:39.106130 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:41:39.106130 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:41:39.106130 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:41:39.106130 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:41:39.106130 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:41:39.106130 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:41:39.106130 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:41:39.106130 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:41:39.106130 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:41:39.106130 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:41:39.106130 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:41:39.107140 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:41:39.107140 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:41:39.107140 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:41:39.107140 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:41:39.107140 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:41:39.107140 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:41:39.107140 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:41:39.107140 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:41:39.107140 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:41:39.107140 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:41:39.107140 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:41:39.107140 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:41:39.107140 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 83/163] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Sep 26 17:41:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:41:39.115177 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b90e4a-93b9-4cfd-9588-10c46d4a1195 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:39.175344 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2cc48-28a7-4bc9-b277-30ace9ad49df None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:39.241383 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:39.242483 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:39.297071 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b90e4a-93b9-4cfd-9588-10c46d4a1195 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:39.369702 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbfa79-f5c0-4944-badc-23c031a20053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:39.370234 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbfa79-f5c0-4944-badc-23c031a20053 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:39.370516 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbfa79-f5c0-4944-badc-23c031a20053 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:39.370787 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbfa79-f5c0-4944-badc-23c031a20053 None admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:39.371471 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dbfa79-f5c0-4944-badc-23c031a20053 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:39.371768 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dbfa79-f5c0-4944-badc-23c031a20053 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:39.373275 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dbfa79-f5c0-4944-badc-23c031a20053 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:39.386255 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 81/164] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:41:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:39.387124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbfa79-f5c0-4944-badc-23c031a20053 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:39.397653 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2cc48-28a7-4bc9-b277-30ace9ad49df None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:39.471051 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787603f-a152-474c-9dce-1ce55ea67a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:39.472874 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787603f-a152-474c-9dce-1ce55ea67a29 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:39.473606 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787603f-a152-474c-9dce-1ce55ea67a29 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:39.475305 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787603f-a152-474c-9dce-1ce55ea67a29 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:39.495826 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787603f-a152-474c-9dce-1ce55ea67a29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:41:39.508670 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-9787603f-a152-474c-9dce-1ce55ea67a29 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 17:41:39.508670 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:41:39.508670 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:41:39.508670 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:41:39.508670 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:41:39.508670 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:41:39.508670 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:41:39.508670 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:41:39.508670 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:41:39.508670 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:41:39.508670 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:41:39.508670 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:41:39.508670 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:41:39.508670 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:41:39.508670 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:41:39.508670 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:41:39.509658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:41:39.509658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:41:39.509658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:41:39.509658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:41:39.509658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:41:39.509658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:41:39.509658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:41:39.509658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:41:39.509658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:41:39.509658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:41:39.509658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:41:39.509658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:41:39.509658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:41:39.509658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:41:39.509658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:41:39.509658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:41:39.510430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:41:39.510430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:41:39.510430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:41:39.510430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:41:39.510430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:41:39.510430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:41:39.510430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:41:39.510430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:41:39.510430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:41:39.510430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:41:39.510430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 17:41:39.510430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:41:39.514964 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 84/165] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Sep 26 17:41:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:41:39.516457 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787603f-a152-474c-9dce-1ce55ea67a29 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:39.559081 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbfa79-f5c0-4944-badc-23c031a20053 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:39.629816 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80af4c-8bf1-415c-b4f5-72ee12cf794d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:39.630418 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80af4c-8bf1-415c-b4f5-72ee12cf794d None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:39.630697 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80af4c-8bf1-415c-b4f5-72ee12cf794d None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:39.630968 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80af4c-8bf1-415c-b4f5-72ee12cf794d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:39.653938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d80af4c-8bf1-415c-b4f5-72ee12cf794d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:41:39.659271 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-0d80af4c-8bf1-415c-b4f5-72ee12cf794d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 17:41:39.659271 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:41:39.659271 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:41:39.659271 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:41:39.659271 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:41:39.659271 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:41:39.659271 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:41:39.659271 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:41:39.659271 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:41:39.659271 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:41:39.659271 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:41:39.659271 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:41:39.659271 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:41:39.659271 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:41:39.659271 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:41:39.659271 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:41:39.660158 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:41:39.660158 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:41:39.660158 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:41:39.660158 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:41:39.660158 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:41:39.660158 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:41:39.660158 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:41:39.660158 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:41:39.660158 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:41:39.660158 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:41:39.660158 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:41:39.660158 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:41:39.660158 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:41:39.660158 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:41:39.660158 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:41:39.660158 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:41:39.661605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:41:39.661605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:41:39.661605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:41:39.661605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:41:39.661605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:41:39.661605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:41:39.661605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:41:39.661605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:41:39.661605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:41:39.661605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:41:39.661605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 17:41:39.661605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:41:39.661605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 82/166] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:41:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:41:39.665928 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80af4c-8bf1-415c-b4f5-72ee12cf794d None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:39.677766 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:39.737888 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:39.748962 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787603f-a152-474c-9dce-1ce55ea67a29 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:39.846171 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36947a7-94da-467e-989a-7309c78918e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:39.848286 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36947a7-94da-467e-989a-7309c78918e7 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:39.848900 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36947a7-94da-467e-989a-7309c78918e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:39.849976 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36947a7-94da-467e-989a-7309c78918e7 None admin] PATH_INFO: `/v3/users/7155e9699cdb4b3f90bd34118e45f2bc` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:39.853632 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36947a7-94da-467e-989a-7309c78918e7 None admin] RBAC: Authorizing `identity:get_user(user_id=7155e9699cdb4b3f90bd34118e45f2bc)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:39.857224 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36947a7-94da-467e-989a-7309c78918e7 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:39.862112 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 85/167] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:41:39 2022] GET /identity/v3/users/7155e9699cdb4b3f90bd34118e45f2bc => generated 247 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:39.863098 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36947a7-94da-467e-989a-7309c78918e7 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:39.936345 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80af4c-8bf1-415c-b4f5-72ee12cf794d None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:39.997800 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc6c1d-aab4-4857-8cd2-970bb810aa88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:39.998432 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc6c1d-aab4-4857-8cd2-970bb810aa88 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:39.998721 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc6c1d-aab4-4857-8cd2-970bb810aa88 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:39.998984 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc6c1d-aab4-4857-8cd2-970bb810aa88 None admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:39.999667 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cc6c1d-aab4-4857-8cd2-970bb810aa88 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:39.999972 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cc6c1d-aab4-4857-8cd2-970bb810aa88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:40.001397 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cc6c1d-aab4-4857-8cd2-970bb810aa88 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:40.016314 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 83/168] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:41:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:40.017245 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc6c1d-aab4-4857-8cd2-970bb810aa88 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:40.048735 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36947a7-94da-467e-989a-7309c78918e7 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:40.089772 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682cb64-8cea-4165-b7a9-645d90767d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:40.090741 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682cb64-8cea-4165-b7a9-645d90767d5c None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:40.091200 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682cb64-8cea-4165-b7a9-645d90767d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:40.091691 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682cb64-8cea-4165-b7a9-645d90767d5c None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:40.092554 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682cb64-8cea-4165-b7a9-645d90767d5c None admin] RBAC: Adding query filter params (name=member) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:40.093044 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682cb64-8cea-4165-b7a9-645d90767d5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:40.094668 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682cb64-8cea-4165-b7a9-645d90767d5c None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:40.105197 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 86/169] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Sep 26 17:41:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:40.106342 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682cb64-8cea-4165-b7a9-645d90767d5c None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:40.130015 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:40.154696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:40.211204 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc6c1d-aab4-4857-8cd2-970bb810aa88 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:40.284171 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682cb64-8cea-4165-b7a9-645d90767d5c None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:40.289746 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33dbe1d-5185-4860-bb27-ba2d5278e153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:40.290383 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33dbe1d-5185-4860-bb27-ba2d5278e153 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:40.290666 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33dbe1d-5185-4860-bb27-ba2d5278e153 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:40.290941 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33dbe1d-5185-4860-bb27-ba2d5278e153 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:40.328547 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d91f4-0126-4722-afa2-9d7ab86b0efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:40.329993 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d91f4-0126-4722-afa2-9d7ab86b0efc None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:40.330661 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d91f4-0126-4722-afa2-9d7ab86b0efc None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:40.331377 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d91f4-0126-4722-afa2-9d7ab86b0efc None admin] PATH_INFO: `/v3/users/593a808ea3dc4b34b162c475e055673b` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:40.333735 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d91f4-0126-4722-afa2-9d7ab86b0efc None admin] RBAC: Authorizing `identity:get_user(user_id=593a808ea3dc4b34b162c475e055673b)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:40.337313 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d91f4-0126-4722-afa2-9d7ab86b0efc None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:40.340617 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 87/170] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:41:40 2022] GET /identity/v3/users/593a808ea3dc4b34b162c475e055673b => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:40.342226 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d91f4-0126-4722-afa2-9d7ab86b0efc None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:40.440755 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33dbe1d-5185-4860-bb27-ba2d5278e153 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:40.442317 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33dbe1d-5185-4860-bb27-ba2d5278e153 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:40.528457 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d91f4-0126-4722-afa2-9d7ab86b0efc None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:40.543915 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:40.561142 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:40.586831 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c36e12-6277-48da-aaa7-fde3bc02a598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:40.587497 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c36e12-6277-48da-aaa7-fde3bc02a598 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:40.587824 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c36e12-6277-48da-aaa7-fde3bc02a598 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:40.588108 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c36e12-6277-48da-aaa7-fde3bc02a598 None admin] PATH_INFO: `/v3/users/593a808ea3dc4b34b162c475e055673b` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:40.589374 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c36e12-6277-48da-aaa7-fde3bc02a598 None admin] RBAC: Authorizing `identity:get_user(user_id=593a808ea3dc4b34b162c475e055673b)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:40.590963 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c36e12-6277-48da-aaa7-fde3bc02a598 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:40.592848 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 88/171] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:41:40 2022] GET /identity/v3/users/593a808ea3dc4b34b162c475e055673b => generated 275 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:40.600780 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c36e12-6277-48da-aaa7-fde3bc02a598 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:40.653924 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 84/172] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:41:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 17:41:40.654848 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33dbe1d-5185-4860-bb27-ba2d5278e153 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:40.776936 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c36e12-6277-48da-aaa7-fde3bc02a598 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:40.842142 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb1148-5de2-42c9-ab7f-684ab3635e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:40.842695 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb1148-5de2-42c9-ab7f-684ab3635e67 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:40.842982 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb1148-5de2-42c9-ab7f-684ab3635e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:40.843261 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb1148-5de2-42c9-ab7f-684ab3635e67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:40.894261 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:40.927156 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33dbe1d-5185-4860-bb27-ba2d5278e153 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:40.943520 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb1148-5de2-42c9-ab7f-684ab3635e67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:40.945725 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb1148-5de2-42c9-ab7f-684ab3635e67 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:41.077767 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7b7cc-9881-4ecf-ac97-f67c3928aa3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:41.078374 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7b7cc-9881-4ecf-ac97-f67c3928aa3d None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:41.078655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7b7cc-9881-4ecf-ac97-f67c3928aa3d None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:41.078930 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7b7cc-9881-4ecf-ac97-f67c3928aa3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:41.141513 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 89/173] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:41:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 17:41:41.142753 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb1148-5de2-42c9-ab7f-684ab3635e67 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:41.160198 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:41.232247 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7b7cc-9881-4ecf-ac97-f67c3928aa3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:41.233763 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7b7cc-9881-4ecf-ac97-f67c3928aa3d None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:41.257353 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:41.305281 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb1148-5de2-42c9-ab7f-684ab3635e67 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:41.342609 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b661a068-6e72-49ad-a84b-6eca7742acb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:41.343256 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661a068-6e72-49ad-a84b-6eca7742acb7 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:41.343540 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661a068-6e72-49ad-a84b-6eca7742acb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:41.343819 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661a068-6e72-49ad-a84b-6eca7742acb7 None admin] PATH_INFO: `/v3/projects/00fef40581d54f69b20ec6565c3cf274` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:41.344962 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b661a068-6e72-49ad-a84b-6eca7742acb7 None admin] RBAC: Authorizing `identity:get_project(project_id=00fef40581d54f69b20ec6565c3cf274)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:41.346513 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b661a068-6e72-49ad-a84b-6eca7742acb7 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:41.348470 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 90/174] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:41:41 2022] GET /identity/v3/projects/00fef40581d54f69b20ec6565c3cf274 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:41.348961 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b661a068-6e72-49ad-a84b-6eca7742acb7 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:41.480507 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 85/175] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:41:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 826 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 17:41:41.481808 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19cd5f2-69b9-4a5e-beba-04cd627dc534 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:41.482095 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19cd5f2-69b9-4a5e-beba-04cd627dc534 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:41.482366 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19cd5f2-69b9-4a5e-beba-04cd627dc534 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:41.490549 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 86/176] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:41:41.491346 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19cd5f2-69b9-4a5e-beba-04cd627dc534 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:41.516119 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b661a068-6e72-49ad-a84b-6eca7742acb7 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:41.556564 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebead96-59af-4706-ad93-6247a3f1080e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:41.557234 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebead96-59af-4706-ad93-6247a3f1080e None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:41.557518 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebead96-59af-4706-ad93-6247a3f1080e None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:41.557796 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebead96-59af-4706-ad93-6247a3f1080e None admin] PATH_INFO: `/v3/projects/00fef40581d54f69b20ec6565c3cf274` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:41.558926 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebead96-59af-4706-ad93-6247a3f1080e None admin] RBAC: Authorizing `identity:get_project(project_id=00fef40581d54f69b20ec6565c3cf274)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:41.560396 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebead96-59af-4706-ad93-6247a3f1080e None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:41.562241 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 91/177] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:41:41 2022] GET /identity/v3/projects/00fef40581d54f69b20ec6565c3cf274 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:41.563119 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebead96-59af-4706-ad93-6247a3f1080e None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:41.567281 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:41.666362 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:41.672197 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebead96-59af-4706-ad93-6247a3f1080e None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:41.710252 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc45c7a-0947-4d12-8302-f982692aa831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:41.711418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc45c7a-0947-4d12-8302-f982692aa831 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:41.711871 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc45c7a-0947-4d12-8302-f982692aa831 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:41.712383 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc45c7a-0947-4d12-8302-f982692aa831 None admin] PATH_INFO: `/v3/projects/db17102092c3487b8775cebba2be7d8a` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:41.714987 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc45c7a-0947-4d12-8302-f982692aa831 None admin] RBAC: Authorizing `identity:get_project(project_id=db17102092c3487b8775cebba2be7d8a)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:41.716588 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc45c7a-0947-4d12-8302-f982692aa831 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:41.719496 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 92/178] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:41:41 2022] GET /identity/v3/projects/db17102092c3487b8775cebba2be7d8a => generated 312 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:41.721615 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8082be-de4e-4ac8-a8b4-995f5662ea1a None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:41.722200 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8082be-de4e-4ac8-a8b4-995f5662ea1a None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:41.725371 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8082be-de4e-4ac8-a8b4-995f5662ea1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:41.759815 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19cd5f2-69b9-4a5e-beba-04cd627dc534 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:41.762945 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-5b8082be-de4e-4ac8-a8b4-995f5662ea1a None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:41.769701 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-5b8082be-de4e-4ac8-a8b4-995f5662ea1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:41.814650 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a98c3-0aa9-4840-ae4a-4e02d3847b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:41.815524 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a98c3-0aa9-4840-ae4a-4e02d3847b2d None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:41.815944 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a98c3-0aa9-4840-ae4a-4e02d3847b2d None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:41.816379 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a98c3-0aa9-4840-ae4a-4e02d3847b2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:41.817884 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a98c3-0aa9-4840-ae4a-4e02d3847b2d None admin] RBAC: Adding query filter params (role.id=be6ee971abf54b26be509c14823ece55, scope.project.id=00fef40581d54f69b20ec6565c3cf274, user.id=7155e9699cdb4b3f90bd34118e45f2bc) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:41.818351 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a98c3-0aa9-4840-ae4a-4e02d3847b2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:41.820652 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a98c3-0aa9-4840-ae4a-4e02d3847b2d None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:41.828278 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 87/179] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:41:41 2022] GET /identity/v3/role_assignments?user.id=7155e9699cdb4b3f90bd34118e45f2bc&scope.project.id=00fef40581d54f69b20ec6565c3cf274&role.id=be6ee971abf54b26be509c14823ece55 => generated 608 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:41.833721 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a98c3-0aa9-4840-ae4a-4e02d3847b2d None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:41.921393 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:41.935377 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 93/180] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:41:41.936281 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8082be-de4e-4ac8-a8b4-995f5662ea1a None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:42.059430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a98c3-0aa9-4840-ae4a-4e02d3847b2d None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:42.119658 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:42.137441 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5600c-8940-40d6-95a3-e6b0e9b478be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:42.138072 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5600c-8940-40d6-95a3-e6b0e9b478be None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:42.138345 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5600c-8940-40d6-95a3-e6b0e9b478be None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:42.138610 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5600c-8940-40d6-95a3-e6b0e9b478be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:42.139349 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5600c-8940-40d6-95a3-e6b0e9b478be None admin] RBAC: Adding query filter params (role.id=1d93df17fd9a4d92b8c9966cc9deacde, scope.project.id=00fef40581d54f69b20ec6565c3cf274, user.id=593a808ea3dc4b34b162c475e055673b) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:42.139653 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5600c-8940-40d6-95a3-e6b0e9b478be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:42.141154 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5600c-8940-40d6-95a3-e6b0e9b478be None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:42.155507 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 88/181] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:41:41 2022] GET /identity/v3/role_assignments?user.id=593a808ea3dc4b34b162c475e055673b&scope.project.id=00fef40581d54f69b20ec6565c3cf274&role.id=1d93df17fd9a4d92b8c9966cc9deacde => generated 608 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:42.159796 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8082be-de4e-4ac8-a8b4-995f5662ea1a None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:42.162637 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f245922-39dc-43f0-9100-90c44f29d9e8 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:42.162928 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f245922-39dc-43f0-9100-90c44f29d9e8 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:42.163176 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f245922-39dc-43f0-9100-90c44f29d9e8 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:42.169177 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 89/182] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:42 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:41:42.170533 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e3b3a-1c6d-4d0e-8ec2-9b54ef1436be None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:42.170823 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e3b3a-1c6d-4d0e-8ec2-9b54ef1436be None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:42.171100 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e3b3a-1c6d-4d0e-8ec2-9b54ef1436be None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:42.172471 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 90/183] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:41:42.173653 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6472580-8dec-4134-a76f-e6af147eeabe None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:42.173935 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6472580-8dec-4134-a76f-e6af147eeabe None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:42.174215 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6472580-8dec-4134-a76f-e6af147eeabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:42.208009 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-b6472580-8dec-4134-a76f-e6af147eeabe None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:42.209286 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-b6472580-8dec-4134-a76f-e6af147eeabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:42.221855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40fc8fe-5ef8-4dab-b37a-145d155865f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:42.222487 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40fc8fe-5ef8-4dab-b37a-145d155865f6 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:42.222765 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40fc8fe-5ef8-4dab-b37a-145d155865f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:42.223038 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40fc8fe-5ef8-4dab-b37a-145d155865f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:42.223786 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40fc8fe-5ef8-4dab-b37a-145d155865f6 None admin] RBAC: Adding query filter params (role.id=b4593720c06e4a0db655f8e33079a15f, scope.project.id=db17102092c3487b8775cebba2be7d8a, user.id=593a808ea3dc4b34b162c475e055673b) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:42.224093 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40fc8fe-5ef8-4dab-b37a-145d155865f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:42.225621 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40fc8fe-5ef8-4dab-b37a-145d155865f6 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:42.248498 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 94/184] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:41:41 2022] GET /identity/v3/role_assignments?user.id=593a808ea3dc4b34b162c475e055673b&scope.project.id=db17102092c3487b8775cebba2be7d8a&role.id=b4593720c06e4a0db655f8e33079a15f => generated 608 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:42.250240 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92694ae9-00d4-47e3-8231-fcc00bc77bfa None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:42.253809 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92694ae9-00d4-47e3-8231-fcc00bc77bfa None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:42.254654 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92694ae9-00d4-47e3-8231-fcc00bc77bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:42.298159 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-92694ae9-00d4-47e3-8231-fcc00bc77bfa None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:42.301971 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-92694ae9-00d4-47e3-8231-fcc00bc77bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:42.370578 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 91/185] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:41:42.385600 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6472580-8dec-4134-a76f-e6af147eeabe None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:42.440099 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:42.467068 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 95/186] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:41:42.550829 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6472580-8dec-4134-a76f-e6af147eeabe None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:42.577564 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:42.592012 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dc852-f64d-4eb9-b65c-1f16ae829e9c None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:42.592342 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dc852-f64d-4eb9-b65c-1f16ae829e9c None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:42.592613 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dc852-f64d-4eb9-b65c-1f16ae829e9c None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:42.594426 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 96/187] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 17:41:42.598457 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ee9ef-c0ba-47eb-9276-83163c4d44e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:42.598457 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ee9ef-c0ba-47eb-9276-83163c4d44e7 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:42.598457 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ee9ef-c0ba-47eb-9276-83163c4d44e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:42.598457 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ee9ef-c0ba-47eb-9276-83163c4d44e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:42.599537 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce39b4-b3e2-4fc0-8727-e3292c10a018 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:42.599822 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce39b4-b3e2-4fc0-8727-e3292c10a018 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:42.600090 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce39b4-b3e2-4fc0-8727-e3292c10a018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:42.612046 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ee9ef-c0ba-47eb-9276-83163c4d44e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:41:42.620156 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-32ce39b4-b3e2-4fc0-8727-e3292c10a018 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:42.621221 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-5b7ee9ef-c0ba-47eb-9276-83163c4d44e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:41:42.621221 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:41:42.621221 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:41:42.621221 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:41:42.621221 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:41:42.621221 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:41:42.621221 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:41:42.621221 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:41:42.621221 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:41:42.621221 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:41:42.621221 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:41:42.621221 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:41:42.621221 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:41:42.621221 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:41:42.621221 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:41:42.621221 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:41:42.622070 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:41:42.622070 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:41:42.622070 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:41:42.622070 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:41:42.622070 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:41:42.622070 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:41:42.622070 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:41:42.622070 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:41:42.622070 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:41:42.622070 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:41:42.622070 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:41:42.622070 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:41:42.622070 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:41:42.622070 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:41:42.622070 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:41:42.622070 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:41:42.622926 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:41:42.622926 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:41:42.622926 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:41:42.622926 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:41:42.622926 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:41:42.622926 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:41:42.622926 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:41:42.622926 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:41:42.622926 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:41:42.622926 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:41:42.622926 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:41:42.622926 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:41:42.623512 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-32ce39b4-b3e2-4fc0-8727-e3292c10a018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:42.625290 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 92/188] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Sep 26 17:41:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:41:42.631024 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ee9ef-c0ba-47eb-9276-83163c4d44e7 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:42.706728 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 97/189] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:41:42.767192 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ee9ef-c0ba-47eb-9276-83163c4d44e7 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:42.769353 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce39b4-b3e2-4fc0-8727-e3292c10a018 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:42.821568 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8e52e-dfaf-48bb-b524-167cac462a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:42.822184 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8e52e-dfaf-48bb-b524-167cac462a7c None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:42.822462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8e52e-dfaf-48bb-b524-167cac462a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:42.822736 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8e52e-dfaf-48bb-b524-167cac462a7c None admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:42.823411 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c8e52e-dfaf-48bb-b524-167cac462a7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:42.823718 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c8e52e-dfaf-48bb-b524-167cac462a7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:42.825429 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c8e52e-dfaf-48bb-b524-167cac462a7c None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:42.835750 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 93/190] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:41:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:42.841077 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8e52e-dfaf-48bb-b524-167cac462a7c None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:42.902924 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:42.909640 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce39b4-b3e2-4fc0-8727-e3292c10a018 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:42.934713 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:42.948845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47074192-1ec4-4dfd-b124-3c3e8bb031a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:42.949535 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47074192-1ec4-4dfd-b124-3c3e8bb031a2 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:42.949819 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47074192-1ec4-4dfd-b124-3c3e8bb031a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:42.950090 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47074192-1ec4-4dfd-b124-3c3e8bb031a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:42.951840 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47074192-1ec4-4dfd-b124-3c3e8bb031a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:42.953324 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47074192-1ec4-4dfd-b124-3c3e8bb031a2 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:42.955047 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 98/191] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:41:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:42.955648 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47074192-1ec4-4dfd-b124-3c3e8bb031a2 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:42.969313 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8e52e-dfaf-48bb-b524-167cac462a7c None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:43.006242 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30afe90-533a-4eca-ab0a-75d1a95ca33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:43.006911 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30afe90-533a-4eca-ab0a-75d1a95ca33a None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:43.007196 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30afe90-533a-4eca-ab0a-75d1a95ca33a None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:43.007468 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30afe90-533a-4eca-ab0a-75d1a95ca33a None admin] PATH_INFO: `/v3/users/d139027996f248f5b957be881e5c0c36` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:43.021661 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30afe90-533a-4eca-ab0a-75d1a95ca33a None admin] RBAC: Authorizing `identity:get_user(user_id=d139027996f248f5b957be881e5c0c36)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:43.023336 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30afe90-533a-4eca-ab0a-75d1a95ca33a None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:43.025605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 94/192] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:41:42 2022] GET /identity/v3/users/d139027996f248f5b957be881e5c0c36 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:43.029903 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30afe90-533a-4eca-ab0a-75d1a95ca33a None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:43.057918 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47074192-1ec4-4dfd-b124-3c3e8bb031a2 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:43.094813 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4418cea-3ae4-48d2-9784-581c9ac57bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:43.095511 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4418cea-3ae4-48d2-9784-581c9ac57bcf None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:43.095825 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4418cea-3ae4-48d2-9784-581c9ac57bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:43.096136 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4418cea-3ae4-48d2-9784-581c9ac57bcf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:43.107032 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4418cea-3ae4-48d2-9784-581c9ac57bcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:41:43.112466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-c4418cea-3ae4-48d2-9784-581c9ac57bcf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 17:41:43.112466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:41:43.112466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:41:43.112466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:41:43.112466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:41:43.112466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:41:43.112466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:41:43.112466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:41:43.112466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:41:43.112466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:41:43.112466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:41:43.112466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:41:43.112466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:41:43.112466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:41:43.112466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:41:43.112466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:41:43.113624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:41:43.113624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:41:43.113624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:41:43.113624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:41:43.113624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:41:43.113624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:41:43.113624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:41:43.113624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:41:43.113624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:41:43.113624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:41:43.113624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:41:43.113624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:41:43.113624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:41:43.113624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:41:43.113624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:41:43.113624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:41:43.114394 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:41:43.114394 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:41:43.114394 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:41:43.114394 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:41:43.114394 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:41:43.114394 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:41:43.114394 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:41:43.114394 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:41:43.114394 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:41:43.114394 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:41:43.114394 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 17:41:43.114394 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:41:43.114394 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 99/193] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Sep 26 17:41:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:41:43.115025 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4418cea-3ae4-48d2-9784-581c9ac57bcf None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:43.128149 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30afe90-533a-4eca-ab0a-75d1a95ca33a None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:43.129786 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:43.163980 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac97198-a879-478b-acf6-3a2798ae033d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:43.164593 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac97198-a879-478b-acf6-3a2798ae033d None admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:43.164875 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac97198-a879-478b-acf6-3a2798ae033d None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:43.165190 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac97198-a879-478b-acf6-3a2798ae033d None admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:43.165841 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac97198-a879-478b-acf6-3a2798ae033d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:43.166554 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:43.167294 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac97198-a879-478b-acf6-3a2798ae033d None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:43.188181 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 95/194] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Sep 26 17:41:43 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:41:43.188181 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac97198-a879-478b-acf6-3a2798ae033d None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:43.227937 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4418cea-3ae4-48d2-9784-581c9ac57bcf None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:43.267260 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63cfd8-6970-4717-a1ea-f94788e937a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:43.267917 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63cfd8-6970-4717-a1ea-f94788e937a1 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:43.268200 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63cfd8-6970-4717-a1ea-f94788e937a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:43.268471 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63cfd8-6970-4717-a1ea-f94788e937a1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:43.280730 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d63cfd8-6970-4717-a1ea-f94788e937a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:41:43.285827 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-1d63cfd8-6970-4717-a1ea-f94788e937a1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 17:41:43.285827 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:41:43.285827 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:41:43.285827 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:41:43.285827 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:41:43.285827 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:41:43.285827 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:41:43.285827 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:41:43.285827 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:41:43.285827 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:41:43.285827 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:41:43.285827 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:41:43.285827 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:41:43.285827 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:41:43.285827 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:41:43.285827 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:41:43.286809 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:41:43.286809 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:41:43.286809 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:41:43.286809 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:41:43.286809 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:41:43.286809 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:41:43.286809 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:41:43.286809 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:41:43.286809 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:41:43.286809 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:41:43.286809 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:41:43.286809 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:41:43.286809 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:41:43.286809 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:41:43.286809 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:41:43.286809 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:41:43.293083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:41:43.293083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:41:43.293083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:41:43.293083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:41:43.293083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:41:43.293083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:41:43.293083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:41:43.293083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:41:43.293083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:41:43.293083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:41:43.293083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 17:41:43.293083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:41:43.293083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 100/195] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:41:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:41:43.293083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63cfd8-6970-4717-a1ea-f94788e937a1 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:43.316839 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac97198-a879-478b-acf6-3a2798ae033d None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:43.356349 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16d6c8-1d45-4d89-bdc2-7bcef41a7d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:43.356962 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16d6c8-1d45-4d89-bdc2-7bcef41a7d4e None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:43.357353 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16d6c8-1d45-4d89-bdc2-7bcef41a7d4e None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:43.357620 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16d6c8-1d45-4d89-bdc2-7bcef41a7d4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:43.395246 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:43.415709 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63cfd8-6970-4717-a1ea-f94788e937a1 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:43.428565 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:43.448954 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e16d6c8-1d45-4d89-bdc2-7bcef41a7d4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:43.451175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e16d6c8-1d45-4d89-bdc2-7bcef41a7d4e None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:43.463027 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf974f-8edc-46b1-9f6a-c1a8942f8820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:43.463652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf974f-8edc-46b1-9f6a-c1a8942f8820 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:43.463931 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf974f-8edc-46b1-9f6a-c1a8942f8820 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:43.464202 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf974f-8edc-46b1-9f6a-c1a8942f8820 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:43.464870 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf974f-8edc-46b1-9f6a-c1a8942f8820 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:43.465211 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf974f-8edc-46b1-9f6a-c1a8942f8820 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:43.466779 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf974f-8edc-46b1-9f6a-c1a8942f8820 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:43.476060 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 101/196] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:41:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:43.477523 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf974f-8edc-46b1-9f6a-c1a8942f8820 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:43.574088 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 96/197] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:41:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 17:41:43.575497 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16d6c8-1d45-4d89-bdc2-7bcef41a7d4e None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:43.599660 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf974f-8edc-46b1-9f6a-c1a8942f8820 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:43.644024 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37af07-64e3-437b-a02d-5b79760bffd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:43.644638 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37af07-64e3-437b-a02d-5b79760bffd2 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:43.645040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37af07-64e3-437b-a02d-5b79760bffd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:43.645306 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37af07-64e3-437b-a02d-5b79760bffd2 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:43.645979 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c37af07-64e3-437b-a02d-5b79760bffd2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:43.646280 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c37af07-64e3-437b-a02d-5b79760bffd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:43.647860 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c37af07-64e3-437b-a02d-5b79760bffd2 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:43.651518 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:43.658307 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 102/198] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Sep 26 17:41:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:43.661983 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37af07-64e3-437b-a02d-5b79760bffd2 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:43.708753 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:43.717717 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16d6c8-1d45-4d89-bdc2-7bcef41a7d4e None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:43.755884 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdff931-47c6-4582-8cdc-ad46bf8369ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:43.756518 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdff931-47c6-4582-8cdc-ad46bf8369ae None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:43.756793 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdff931-47c6-4582-8cdc-ad46bf8369ae None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:43.757090 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdff931-47c6-4582-8cdc-ad46bf8369ae None admin] PATH_INFO: `/v3/users/d139027996f248f5b957be881e5c0c36` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:43.759431 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdff931-47c6-4582-8cdc-ad46bf8369ae None admin] RBAC: Authorizing `identity:get_user(user_id=d139027996f248f5b957be881e5c0c36)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:43.761152 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdff931-47c6-4582-8cdc-ad46bf8369ae None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:43.768481 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 97/199] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:41:43 2022] GET /identity/v3/users/d139027996f248f5b957be881e5c0c36 => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:43.769374 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdff931-47c6-4582-8cdc-ad46bf8369ae None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:43.793555 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37af07-64e3-437b-a02d-5b79760bffd2 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:43.837709 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fba275-c090-4634-9b22-884a0babb891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:43.838687 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fba275-c090-4634-9b22-884a0babb891 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:43.839284 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fba275-c090-4634-9b22-884a0babb891 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:43.839745 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fba275-c090-4634-9b22-884a0babb891 None admin] PATH_INFO: `/v3/projects/5f86051201ae444796f8bf9e49c1b888` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:43.841261 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fba275-c090-4634-9b22-884a0babb891 None admin] RBAC: Authorizing `identity:get_project(project_id=5f86051201ae444796f8bf9e49c1b888)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:43.842905 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fba275-c090-4634-9b22-884a0babb891 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:43.852598 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 103/200] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:41:43 2022] GET /identity/v3/projects/5f86051201ae444796f8bf9e49c1b888 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:43.853963 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fba275-c090-4634-9b22-884a0babb891 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:43.890362 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdff931-47c6-4582-8cdc-ad46bf8369ae None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:43.917788 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:43.928285 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8accf-241d-4813-bab3-7b421036795d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:43.928910 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8accf-241d-4813-bab3-7b421036795d None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:43.929217 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8accf-241d-4813-bab3-7b421036795d None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:43.930010 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8accf-241d-4813-bab3-7b421036795d None admin] PATH_INFO: `/v3/users/e51b340c576249b8ad0d4fe08df42a2f` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:43.931148 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b8accf-241d-4813-bab3-7b421036795d None admin] RBAC: Authorizing `identity:get_user(user_id=e51b340c576249b8ad0d4fe08df42a2f)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:43.932651 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b8accf-241d-4813-bab3-7b421036795d None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:43.938927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 98/201] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:41:43 2022] GET /identity/v3/users/e51b340c576249b8ad0d4fe08df42a2f => generated 289 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:43.939844 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8accf-241d-4813-bab3-7b421036795d None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:43.984682 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fba275-c090-4634-9b22-884a0babb891 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:43.987146 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:44.026939 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff8afe-a151-4bd9-a3f3-2043628d1e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:44.027559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff8afe-a151-4bd9-a3f3-2043628d1e30 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:44.027838 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff8afe-a151-4bd9-a3f3-2043628d1e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:44.028108 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff8afe-a151-4bd9-a3f3-2043628d1e30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:44.064437 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8accf-241d-4813-bab3-7b421036795d None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:44.107918 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff8afe-a151-4bd9-a3f3-2043628d1e30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:44.109445 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff8afe-a151-4bd9-a3f3-2043628d1e30 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:44.111641 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef1085-a650-4d29-9124-19de761b9756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:44.113613 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef1085-a650-4d29-9124-19de761b9756 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:44.114112 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef1085-a650-4d29-9124-19de761b9756 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:44.114576 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef1085-a650-4d29-9124-19de761b9756 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:44.115500 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef1085-a650-4d29-9124-19de761b9756 None admin] RBAC: Adding query filter params (role.id=be6ee971abf54b26be509c14823ece55, scope.project.id=5f86051201ae444796f8bf9e49c1b888, user.id=d139027996f248f5b957be881e5c0c36) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:44.116011 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef1085-a650-4d29-9124-19de761b9756 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:44.119024 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef1085-a650-4d29-9124-19de761b9756 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:44.127061 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 99/202] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:41:43 2022] GET /identity/v3/role_assignments?user.id=d139027996f248f5b957be881e5c0c36&scope.project.id=5f86051201ae444796f8bf9e49c1b888&role.id=be6ee971abf54b26be509c14823ece55 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:44.133829 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef1085-a650-4d29-9124-19de761b9756 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:44.237226 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:44.312950 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef1085-a650-4d29-9124-19de761b9756 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:44.348631 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 104/203] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:41:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 17:41:44.355634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff8afe-a151-4bd9-a3f3-2043628d1e30 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:44.358761 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:44.360582 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea79214-5efb-43d5-8b60-bcc80748131d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:44.362226 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea79214-5efb-43d5-8b60-bcc80748131d None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:44.362482 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea79214-5efb-43d5-8b60-bcc80748131d None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:44.362757 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea79214-5efb-43d5-8b60-bcc80748131d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:44.453200 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea79214-5efb-43d5-8b60-bcc80748131d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:44.454984 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea79214-5efb-43d5-8b60-bcc80748131d None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:44.552721 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff8afe-a151-4bd9-a3f3-2043628d1e30 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:44.566149 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:44.628600 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 100/204] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:41:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 17:41:44.635821 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea79214-5efb-43d5-8b60-bcc80748131d None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:44.651880 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a0f99-41cf-4f7f-94fd-d828293ee80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:44.652578 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a0f99-41cf-4f7f-94fd-d828293ee80c None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:44.652884 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a0f99-41cf-4f7f-94fd-d828293ee80c None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:44.653306 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a0f99-41cf-4f7f-94fd-d828293ee80c None admin] PATH_INFO: `/v3/projects/5f86051201ae444796f8bf9e49c1b888` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:44.656325 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a0f99-41cf-4f7f-94fd-d828293ee80c None admin] RBAC: Authorizing `identity:get_project(project_id=5f86051201ae444796f8bf9e49c1b888)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:44.657822 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a0f99-41cf-4f7f-94fd-d828293ee80c None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:44.659613 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 105/205] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:41:44 2022] GET /identity/v3/projects/5f86051201ae444796f8bf9e49c1b888 => generated 302 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:44.665777 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a0f99-41cf-4f7f-94fd-d828293ee80c None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:44.743104 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea79214-5efb-43d5-8b60-bcc80748131d None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:44.779848 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ede66-7626-48c4-976d-0e987d5a5514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:44.780821 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ede66-7626-48c4-976d-0e987d5a5514 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:44.781322 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ede66-7626-48c4-976d-0e987d5a5514 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:44.781934 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ede66-7626-48c4-976d-0e987d5a5514 None admin] PATH_INFO: `/v3/projects/00fef40581d54f69b20ec6565c3cf274` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:44.783243 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ede66-7626-48c4-976d-0e987d5a5514 None admin] RBAC: Authorizing `identity:get_project(project_id=00fef40581d54f69b20ec6565c3cf274)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:44.785150 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ede66-7626-48c4-976d-0e987d5a5514 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:44.787224 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 101/206] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:41:44 2022] GET /identity/v3/projects/00fef40581d54f69b20ec6565c3cf274 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:41:44.793658 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ede66-7626-48c4-976d-0e987d5a5514 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:44.801493 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:44.829469 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:44.859596 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a0f99-41cf-4f7f-94fd-d828293ee80c None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:44.902852 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ede66-7626-48c4-976d-0e987d5a5514 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:44.930807 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f9a1fb-d9d9-434e-abdb-6b12cea9e1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:44.931496 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9a1fb-d9d9-434e-abdb-6b12cea9e1ac None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:44.931712 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9a1fb-d9d9-434e-abdb-6b12cea9e1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:44.931986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9a1fb-d9d9-434e-abdb-6b12cea9e1ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:44.932957 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f9a1fb-d9d9-434e-abdb-6b12cea9e1ac None admin] RBAC: Adding query filter params (role.id=1d93df17fd9a4d92b8c9966cc9deacde, scope.project.id=5f86051201ae444796f8bf9e49c1b888, user.id=d139027996f248f5b957be881e5c0c36) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:44.933094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f9a1fb-d9d9-434e-abdb-6b12cea9e1ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:44.934482 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f9a1fb-d9d9-434e-abdb-6b12cea9e1ac None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:44.941202 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddadb55-93ef-4ee7-9423-7581d6c13fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:44.942160 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddadb55-93ef-4ee7-9423-7581d6c13fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:44.942632 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddadb55-93ef-4ee7-9423-7581d6c13fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:44.943090 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddadb55-93ef-4ee7-9423-7581d6c13fe4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:44.944080 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddadb55-93ef-4ee7-9423-7581d6c13fe4 None admin] RBAC: Adding query filter params (role.id=def729f162f44f65b2e2bf261dde9b39, scope.project.id=00fef40581d54f69b20ec6565c3cf274, user.id=e51b340c576249b8ad0d4fe08df42a2f) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:44.944578 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddadb55-93ef-4ee7-9423-7581d6c13fe4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:44.946420 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddadb55-93ef-4ee7-9423-7581d6c13fe4 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:44.953459 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 102/208] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:41:44 2022] GET /identity/v3/role_assignments?user.id=e51b340c576249b8ad0d4fe08df42a2f&scope.project.id=00fef40581d54f69b20ec6565c3cf274&role.id=def729f162f44f65b2e2bf261dde9b39 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:41:44.953752 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 106/208] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:41:44 2022] GET /identity/v3/role_assignments?user.id=d139027996f248f5b957be881e5c0c36&scope.project.id=5f86051201ae444796f8bf9e49c1b888&role.id=1d93df17fd9a4d92b8c9966cc9deacde => generated 259 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:45.888903 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dd48d-92bb-47f0-bcb9-267c107182d0 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:45.889574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dd48d-92bb-47f0-bcb9-267c107182d0 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:45.889574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dd48d-92bb-47f0-bcb9-267c107182d0 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:45.891080 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 107/209] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:41:45.899898 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2da4d-4b59-4b87-acb2-119caaba1ea4 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:45.899898 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2da4d-4b59-4b87-acb2-119caaba1ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:45.899898 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2da4d-4b59-4b87-acb2-119caaba1ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:45.916869 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-c3e2da4d-4b59-4b87-acb2-119caaba1ea4 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:45.918850 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-c3e2da4d-4b59-4b87-acb2-119caaba1ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:45.919644 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ac417-db9c-46f3-847c-ad11ca8ee42c None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:45.919930 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ac417-db9c-46f3-847c-ad11ca8ee42c None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:45.920208 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ac417-db9c-46f3-847c-ad11ca8ee42c None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:45.921716 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 108/210] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 17:41:45.926799 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6469b4-ab88-4c5f-9036-555c3c6ce5c4 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:45.927080 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6469b4-ab88-4c5f-9036-555c3c6ce5c4 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:45.927355 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6469b4-ab88-4c5f-9036-555c3c6ce5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:45.945777 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-1c6469b4-ab88-4c5f-9036-555c3c6ce5c4 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:45.946963 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-1c6469b4-ab88-4c5f-9036-555c3c6ce5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:45.994091 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 103/211] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:41:46.017313 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 109/212] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 17:41:46.271478 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2da4d-4b59-4b87-acb2-119caaba1ea4 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:46.285834 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6469b4-ab88-4c5f-9036-555c3c6ce5c4 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:46.295084 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:46.348736 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:46.384066 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2da4d-4b59-4b87-acb2-119caaba1ea4 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:46.393295 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6469b4-ab88-4c5f-9036-555c3c6ce5c4 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:46.425094 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba35118-66d8-4bd1-b2f1-661f27df60fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:46.426121 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba35118-66d8-4bd1-b2f1-661f27df60fd None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:46.426610 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba35118-66d8-4bd1-b2f1-661f27df60fd None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:46.427118 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba35118-66d8-4bd1-b2f1-661f27df60fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:46.428697 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba35118-66d8-4bd1-b2f1-661f27df60fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:46.429393 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4122c-c843-4237-acdf-13915106a82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:46.430310 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4122c-c843-4237-acdf-13915106a82f None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:46.430661 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba35118-66d8-4bd1-b2f1-661f27df60fd None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:46.430771 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4122c-c843-4237-acdf-13915106a82f None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:46.431097 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4122c-c843-4237-acdf-13915106a82f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:46.432898 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 104/213] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:41:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:46.438686 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba35118-66d8-4bd1-b2f1-661f27df60fd None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:46.443133 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a4122c-c843-4237-acdf-13915106a82f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:41:46.447887 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-89a4122c-c843-4237-acdf-13915106a82f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 17:41:46.447887 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:41:46.447887 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:41:46.447887 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:41:46.447887 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:41:46.447887 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:41:46.447887 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:41:46.447887 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:41:46.447887 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:41:46.447887 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:41:46.447887 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:41:46.447887 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:41:46.447887 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:41:46.447887 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:41:46.447887 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:41:46.447887 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:41:46.448783 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:41:46.448783 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:41:46.448783 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:41:46.448783 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:41:46.448783 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:41:46.448783 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:41:46.448783 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:41:46.448783 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:41:46.448783 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:41:46.448783 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:41:46.448783 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:41:46.448783 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:41:46.448783 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:41:46.448783 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:41:46.448783 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:41:46.448783 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:41:46.449592 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:41:46.449592 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:41:46.449592 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:41:46.449592 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:41:46.449592 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:41:46.449592 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:41:46.449592 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:41:46.449592 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:41:46.449592 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:41:46.449592 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:41:46.449592 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 17:41:46.449592 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:41:46.454241 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 110/214] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:41:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:41:46.455389 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4122c-c843-4237-acdf-13915106a82f None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:46.552440 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:46.565197 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4122c-c843-4237-acdf-13915106a82f None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:46.571152 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba35118-66d8-4bd1-b2f1-661f27df60fd None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:46.592991 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:46.605424 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516d087-de13-4bf7-92a7-12f60679c76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:46.606058 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516d087-de13-4bf7-92a7-12f60679c76e None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:46.606405 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516d087-de13-4bf7-92a7-12f60679c76e None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:46.606743 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516d087-de13-4bf7-92a7-12f60679c76e None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:46.607472 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516d087-de13-4bf7-92a7-12f60679c76e None admin] RBAC: Adding query filter params (name=member) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:46.607839 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516d087-de13-4bf7-92a7-12f60679c76e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:46.609501 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516d087-de13-4bf7-92a7-12f60679c76e None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:46.618383 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe92ad1-5272-4b3e-9608-e58e09a388dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:46.619441 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe92ad1-5272-4b3e-9608-e58e09a388dd None admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:46.619897 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe92ad1-5272-4b3e-9608-e58e09a388dd None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:46.620319 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe92ad1-5272-4b3e-9608-e58e09a388dd None admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:46.621153 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe92ad1-5272-4b3e-9608-e58e09a388dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:46.622725 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 111/215] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Sep 26 17:41:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:46.622902 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe92ad1-5272-4b3e-9608-e58e09a388dd None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:46.624061 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516d087-de13-4bf7-92a7-12f60679c76e None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:46.651986 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 105/216] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Sep 26 17:41:46 2022] POST /identity/v3/users => generated 297 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:41:46.669756 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519ed34-18c0-4f0b-b725-9da0fd3904c0 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:46.670057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519ed34-18c0-4f0b-b725-9da0fd3904c0 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:46.670313 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519ed34-18c0-4f0b-b725-9da0fd3904c0 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:46.671724 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 106/217] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 17:41:46.677462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a46de-66ec-458d-aeac-8f75ee5aad60 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:46.677822 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a46de-66ec-458d-aeac-8f75ee5aad60 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:46.678173 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a46de-66ec-458d-aeac-8f75ee5aad60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:46.699558 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-495a46de-66ec-458d-aeac-8f75ee5aad60 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:46.701184 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-495a46de-66ec-458d-aeac-8f75ee5aad60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:46.763444 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516d087-de13-4bf7-92a7-12f60679c76e None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:46.785104 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 107/218] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 17:41:46.810559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2717496-6136-4c91-8778-bb1b2f0707f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:46.811610 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2717496-6136-4c91-8778-bb1b2f0707f6 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:46.812119 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2717496-6136-4c91-8778-bb1b2f0707f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:46.812630 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2717496-6136-4c91-8778-bb1b2f0707f6 None admin] PATH_INFO: `/v3/users/57837d131a4d4ccdb7b1046bb81142cb` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:46.829496 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2717496-6136-4c91-8778-bb1b2f0707f6 None admin] RBAC: Authorizing `identity:get_user(user_id=57837d131a4d4ccdb7b1046bb81142cb)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:46.831371 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2717496-6136-4c91-8778-bb1b2f0707f6 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:46.833332 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 112/219] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:41:46 2022] GET /identity/v3/users/57837d131a4d4ccdb7b1046bb81142cb => generated 297 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:46.841509 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a46de-66ec-458d-aeac-8f75ee5aad60 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:46.928717 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:46.956036 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a46de-66ec-458d-aeac-8f75ee5aad60 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:46.992964 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309924fd-b694-4e19-b0e4-09fd42855400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:46.993596 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309924fd-b694-4e19-b0e4-09fd42855400 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:46.993876 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309924fd-b694-4e19-b0e4-09fd42855400 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:46.994147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309924fd-b694-4e19-b0e4-09fd42855400 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:47.065298 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2717496-6136-4c91-8778-bb1b2f0707f6 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:47.073494 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309924fd-b694-4e19-b0e4-09fd42855400 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:47.074985 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309924fd-b694-4e19-b0e4-09fd42855400 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:47.121096 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:47.176655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:47.188767 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2717496-6136-4c91-8778-bb1b2f0707f6 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:47.216680 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 108/220] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:41:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 17:41:47.223136 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309924fd-b694-4e19-b0e4-09fd42855400 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:47.242595 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62858441-7b3b-4a2a-a177-f36b4537aadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:47.243638 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62858441-7b3b-4a2a-a177-f36b4537aadd None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:47.244111 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62858441-7b3b-4a2a-a177-f36b4537aadd None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:47.244576 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62858441-7b3b-4a2a-a177-f36b4537aadd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:47.258182 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62858441-7b3b-4a2a-a177-f36b4537aadd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:41:47.273798 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-62858441-7b3b-4a2a-a177-f36b4537aadd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:41:47.273798 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:41:47.273798 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:41:47.273798 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:41:47.273798 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:41:47.273798 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:41:47.273798 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:41:47.273798 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:41:47.273798 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:41:47.273798 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:41:47.273798 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:41:47.273798 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:41:47.273798 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:41:47.273798 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:41:47.273798 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:41:47.273798 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:41:47.274741 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:41:47.274741 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:41:47.274741 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:41:47.274741 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:41:47.274741 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:41:47.274741 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:41:47.274741 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:41:47.274741 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:41:47.274741 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:41:47.274741 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:41:47.274741 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:41:47.274741 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:41:47.274741 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:41:47.274741 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:41:47.274741 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:41:47.274741 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:41:47.275516 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:41:47.275516 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:41:47.275516 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:41:47.275516 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:41:47.275516 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:41:47.275516 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:41:47.275516 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:41:47.275516 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:41:47.275516 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:41:47.275516 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:41:47.275516 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:41:47.275516 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:41:47.275516 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 113/221] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Sep 26 17:41:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:41:47.282667 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62858441-7b3b-4a2a-a177-f36b4537aadd None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:47.404238 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309924fd-b694-4e19-b0e4-09fd42855400 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:47.431279 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62858441-7b3b-4a2a-a177-f36b4537aadd None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:47.433962 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:47.444082 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a42ca6-23ec-4844-bb0c-e59de7584ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:47.444788 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a42ca6-23ec-4844-bb0c-e59de7584ad8 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:47.445612 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a42ca6-23ec-4844-bb0c-e59de7584ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:47.445889 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a42ca6-23ec-4844-bb0c-e59de7584ad8 None admin] PATH_INFO: `/v3/projects/5f86051201ae444796f8bf9e49c1b888` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:47.447066 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a42ca6-23ec-4844-bb0c-e59de7584ad8 None admin] RBAC: Authorizing `identity:get_project(project_id=5f86051201ae444796f8bf9e49c1b888)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:47.448833 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a42ca6-23ec-4844-bb0c-e59de7584ad8 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:47.451095 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 109/222] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:41:47 2022] GET /identity/v3/projects/5f86051201ae444796f8bf9e49c1b888 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:41:47.452359 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f78029-b44f-4173-b0d2-d7080277c64e None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:47.452577 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f78029-b44f-4173-b0d2-d7080277c64e None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:47.452837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f78029-b44f-4173-b0d2-d7080277c64e None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:47.458431 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 110/223] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:41:47.459760 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f78029-b44f-4173-b0d2-d7080277c64e None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:47.475438 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72061d36-8087-4390-898a-9c9cb7d2c463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:47.476817 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72061d36-8087-4390-898a-9c9cb7d2c463 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:47.477620 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72061d36-8087-4390-898a-9c9cb7d2c463 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:47.477904 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72061d36-8087-4390-898a-9c9cb7d2c463 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:47.478847 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72061d36-8087-4390-898a-9c9cb7d2c463 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:47.479152 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72061d36-8087-4390-898a-9c9cb7d2c463 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:47.480769 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72061d36-8087-4390-898a-9c9cb7d2c463 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:47.490829 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 114/224] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:41:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:41:47.492339 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58796932-6570-4d15-880d-2b66cc29a9ac None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:47.492630 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58796932-6570-4d15-880d-2b66cc29a9ac None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:47.492901 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58796932-6570-4d15-880d-2b66cc29a9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:47.513144 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:47.518218 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-58796932-6570-4d15-880d-2b66cc29a9ac None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:47.519700 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-58796932-6570-4d15-880d-2b66cc29a9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:47.590887 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f78029-b44f-4173-b0d2-d7080277c64e None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:47.601205 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 115/225] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:41:47.602119 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58796932-6570-4d15-880d-2b66cc29a9ac None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:47.662003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd9fbb-3b61-435c-8305-60de1363a0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:47.662529 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd9fbb-3b61-435c-8305-60de1363a0de None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:47.662804 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd9fbb-3b61-435c-8305-60de1363a0de None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:47.663064 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd9fbb-3b61-435c-8305-60de1363a0de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:47.663788 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd9fbb-3b61-435c-8305-60de1363a0de None admin] RBAC: Adding query filter params (role.id=b4593720c06e4a0db655f8e33079a15f, scope.project.id=5f86051201ae444796f8bf9e49c1b888, user.id=57837d131a4d4ccdb7b1046bb81142cb) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:47.664640 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd9fbb-3b61-435c-8305-60de1363a0de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:47.666111 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd9fbb-3b61-435c-8305-60de1363a0de None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:47.681129 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 111/226] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:41:47 2022] GET /identity/v3/role_assignments?user.id=57837d131a4d4ccdb7b1046bb81142cb&scope.project.id=5f86051201ae444796f8bf9e49c1b888&role.id=b4593720c06e4a0db655f8e33079a15f => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:41:47.746899 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:47.753877 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58796932-6570-4d15-880d-2b66cc29a9ac None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:47.800738 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e016204-eeb6-45f3-aa0d-3b72f1217bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:47.801633 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e016204-eeb6-45f3-aa0d-3b72f1217bbf None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:47.801911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e016204-eeb6-45f3-aa0d-3b72f1217bbf None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:47.802178 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e016204-eeb6-45f3-aa0d-3b72f1217bbf None admin] PATH_INFO: `/v3/users/d139027996f248f5b957be881e5c0c36` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:47.803422 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e016204-eeb6-45f3-aa0d-3b72f1217bbf None admin] RBAC: Authorizing `identity:get_user(user_id=d139027996f248f5b957be881e5c0c36)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:47.805477 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e016204-eeb6-45f3-aa0d-3b72f1217bbf None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:47.807253 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 116/227] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:41:47 2022] GET /identity/v3/users/d139027996f248f5b957be881e5c0c36 => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:47.813065 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd9fbb-3b61-435c-8305-60de1363a0de None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:47.936365 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e016204-eeb6-45f3-aa0d-3b72f1217bbf None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:47.949125 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd9fbb-3b61-435c-8305-60de1363a0de None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:47.957438 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:47.990159 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ad16f-1708-45e7-8712-b8d04700db53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:47.991096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ad16f-1708-45e7-8712-b8d04700db53 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:47.991377 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ad16f-1708-45e7-8712-b8d04700db53 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:47.992107 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ad16f-1708-45e7-8712-b8d04700db53 None admin] PATH_INFO: `/v3/projects/5f86051201ae444796f8bf9e49c1b888` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:47.993267 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ad16f-1708-45e7-8712-b8d04700db53 None admin] RBAC: Authorizing `identity:get_project(project_id=5f86051201ae444796f8bf9e49c1b888)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:47.995260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ad16f-1708-45e7-8712-b8d04700db53 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:47.997152 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 112/228] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:41:47 2022] GET /identity/v3/projects/5f86051201ae444796f8bf9e49c1b888 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:48.003139 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ad16f-1708-45e7-8712-b8d04700db53 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:48.120799 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ad16f-1708-45e7-8712-b8d04700db53 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:48.160691 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e016204-eeb6-45f3-aa0d-3b72f1217bbf None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:48.193619 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3afefe-c816-42cd-8983-f45feb74512f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:48.194209 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3afefe-c816-42cd-8983-f45feb74512f None admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:48.194492 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3afefe-c816-42cd-8983-f45feb74512f None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:48.194767 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3afefe-c816-42cd-8983-f45feb74512f None admin] PATH_INFO: `/v3/projects/5f86051201ae444796f8bf9e49c1b888/users/d139027996f248f5b957be881e5c0c36/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:48.197289 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3afefe-c816-42cd-8983-f45feb74512f None admin] RBAC: Authorizing `identity:create_grant(project_id=5f86051201ae444796f8bf9e49c1b888, user_id=d139027996f248f5b957be881e5c0c36, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:48.198759 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3afefe-c816-42cd-8983-f45feb74512f None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:48.206660 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648f85c-06ee-48f0-842c-c2580f0f8f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:48.207399 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648f85c-06ee-48f0-842c-c2580f0f8f9f None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:48.207723 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648f85c-06ee-48f0-842c-c2580f0f8f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:48.207991 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648f85c-06ee-48f0-842c-c2580f0f8f9f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:48.220263 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 113/229] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Sep 26 17:41:48 2022] PUT /identity/v3/projects/5f86051201ae444796f8bf9e49c1b888/users/d139027996f248f5b957be881e5c0c36/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:41:48.231773 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648f85c-06ee-48f0-842c-c2580f0f8f9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:41:48.236868 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-9648f85c-06ee-48f0-842c-c2580f0f8f9f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 17:41:48.236868 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:41:48.236868 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:41:48.236868 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:41:48.236868 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:41:48.236868 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:41:48.236868 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:41:48.236868 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:41:48.236868 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:41:48.236868 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:41:48.236868 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:41:48.236868 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:41:48.236868 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:41:48.236868 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:41:48.236868 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:41:48.236868 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:41:48.237773 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:41:48.237773 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:41:48.237773 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:41:48.237773 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:41:48.237773 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:41:48.237773 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:41:48.237773 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:41:48.237773 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:41:48.237773 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:41:48.237773 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:41:48.237773 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:41:48.237773 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:41:48.237773 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:41:48.237773 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:41:48.237773 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:41:48.237773 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:41:48.238537 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:41:48.238537 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:41:48.238537 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:41:48.238537 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:41:48.238537 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:41:48.238537 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:41:48.238537 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:41:48.238537 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:41:48.238537 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:41:48.238537 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:41:48.238537 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 17:41:48.238537 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:41:48.238537 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 117/230] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Sep 26 17:41:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:41:48.244239 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3afefe-c816-42cd-8983-f45feb74512f None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:48.313676 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:48.410805 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3afefe-c816-42cd-8983-f45feb74512f None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:48.447748 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba569e4-9e29-4dfc-bf19-289c0da342dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:48.448292 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba569e4-9e29-4dfc-bf19-289c0da342dc None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:48.448573 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba569e4-9e29-4dfc-bf19-289c0da342dc None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:48.448843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba569e4-9e29-4dfc-bf19-289c0da342dc None admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:48.449557 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba569e4-9e29-4dfc-bf19-289c0da342dc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:48.449861 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba569e4-9e29-4dfc-bf19-289c0da342dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:48.451510 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba569e4-9e29-4dfc-bf19-289c0da342dc None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:48.460319 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 114/231] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:41:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:48.466307 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648f85c-06ee-48f0-842c-c2580f0f8f9f None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:48.494959 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:48.587203 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648f85c-06ee-48f0-842c-c2580f0f8f9f None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:48.636536 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c89c63-d8a1-4246-b3ff-e54161e993cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:48.637270 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c89c63-d8a1-4246-b3ff-e54161e993cb None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:48.637553 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c89c63-d8a1-4246-b3ff-e54161e993cb None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:48.637826 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c89c63-d8a1-4246-b3ff-e54161e993cb None admin] PATH_INFO: `/v3/users/d139027996f248f5b957be881e5c0c36` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:48.639016 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c89c63-d8a1-4246-b3ff-e54161e993cb None admin] RBAC: Authorizing `identity:get_user(user_id=d139027996f248f5b957be881e5c0c36)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:48.640483 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c89c63-d8a1-4246-b3ff-e54161e993cb None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:48.642429 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 118/232] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:41:48 2022] GET /identity/v3/users/d139027996f248f5b957be881e5c0c36 => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:48.647735 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba569e4-9e29-4dfc-bf19-289c0da342dc None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:48.805377 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:48.811583 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba569e4-9e29-4dfc-bf19-289c0da342dc None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:48.856592 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a0215-5e40-476d-bcab-237aa84743c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:48.857581 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a0215-5e40-476d-bcab-237aa84743c7 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:48.858036 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a0215-5e40-476d-bcab-237aa84743c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:48.858479 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a0215-5e40-476d-bcab-237aa84743c7 None admin] PATH_INFO: `/v3/projects/5f86051201ae444796f8bf9e49c1b888` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:48.866015 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a0215-5e40-476d-bcab-237aa84743c7 None admin] RBAC: Authorizing `identity:get_project(project_id=5f86051201ae444796f8bf9e49c1b888)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:48.867990 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a0215-5e40-476d-bcab-237aa84743c7 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:48.870412 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 115/233] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:41:48 2022] GET /identity/v3/projects/5f86051201ae444796f8bf9e49c1b888 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:48.876719 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c89c63-d8a1-4246-b3ff-e54161e993cb None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:48.981652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:48.991524 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c89c63-d8a1-4246-b3ff-e54161e993cb None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:49.033707 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25885c12-1510-4b40-a24c-3a9a50606030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:49.034711 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25885c12-1510-4b40-a24c-3a9a50606030 None admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:49.035171 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25885c12-1510-4b40-a24c-3a9a50606030 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:49.035623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25885c12-1510-4b40-a24c-3a9a50606030 None admin] PATH_INFO: `/v3/projects/5f86051201ae444796f8bf9e49c1b888/users/d139027996f248f5b957be881e5c0c36/roles/1d93df17fd9a4d92b8c9966cc9deacde` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:49.038152 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25885c12-1510-4b40-a24c-3a9a50606030 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f86051201ae444796f8bf9e49c1b888, user_id=d139027996f248f5b957be881e5c0c36, role_id=1d93df17fd9a4d92b8c9966cc9deacde)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:49.040330 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25885c12-1510-4b40-a24c-3a9a50606030 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:49.071804 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 119/234] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Sep 26 17:41:48 2022] PUT /identity/v3/projects/5f86051201ae444796f8bf9e49c1b888/users/d139027996f248f5b957be881e5c0c36/roles/1d93df17fd9a4d92b8c9966cc9deacde => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:41:49.474230 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1043f8c-2715-45e5-9c6d-57cfb832dd4a None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:49.474751 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1043f8c-2715-45e5-9c6d-57cfb832dd4a None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:49.474751 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1043f8c-2715-45e5-9c6d-57cfb832dd4a None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:49.476108 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 116/235] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:41:49.481612 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba79a3-4aa8-4638-865a-4e9ddee99f38 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:49.481999 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba79a3-4aa8-4638-865a-4e9ddee99f38 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:49.482160 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba79a3-4aa8-4638-865a-4e9ddee99f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:49.501631 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-e5ba79a3-4aa8-4638-865a-4e9ddee99f38 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:49.502819 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-e5ba79a3-4aa8-4638-865a-4e9ddee99f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:49.592264 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 120/236] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:41:49.893316 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281b2ad-c958-4532-b03b-4ff0e7e8fa0f None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:49.893686 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281b2ad-c958-4532-b03b-4ff0e7e8fa0f None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:49.893860 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281b2ad-c958-4532-b03b-4ff0e7e8fa0f None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:49.895273 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 117/237] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:41:49.901088 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb267c-8527-4091-b3e3-4a2cea6fd46b None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:49.901373 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb267c-8527-4091-b3e3-4a2cea6fd46b None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:49.901642 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb267c-8527-4091-b3e3-4a2cea6fd46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:49.930602 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-b6fb267c-8527-4091-b3e3-4a2cea6fd46b None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:49.931796 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-b6fb267c-8527-4091-b3e3-4a2cea6fd46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:50.020504 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7281b2ad-c958-4532-b03b-4ff0e7e8fa0f None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:50.020712 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 121/238] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:41:50.127009 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7281b2ad-c958-4532-b03b-4ff0e7e8fa0f None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:50.165679 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aebe017-af15-4808-8ad9-8432e6d1b539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:50.166705 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebe017-af15-4808-8ad9-8432e6d1b539 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:50.167180 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebe017-af15-4808-8ad9-8432e6d1b539 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:50.167645 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebe017-af15-4808-8ad9-8432e6d1b539 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:50.180211 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aebe017-af15-4808-8ad9-8432e6d1b539 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:41:50.186066 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-7aebe017-af15-4808-8ad9-8432e6d1b539 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 17:41:50.186066 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:41:50.186066 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:41:50.186066 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:41:50.186066 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:41:50.186066 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:41:50.186066 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:41:50.186066 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:41:50.186066 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:41:50.186066 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:41:50.186066 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:41:50.186066 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:41:50.186066 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:41:50.186066 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:41:50.186066 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:41:50.186066 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:41:50.186963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:41:50.186963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:41:50.186963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:41:50.186963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:41:50.186963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:41:50.186963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:41:50.186963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:41:50.186963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:41:50.186963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:41:50.186963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:41:50.186963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:41:50.186963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:41:50.186963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:41:50.186963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:41:50.186963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:41:50.186963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:41:50.187762 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:41:50.187762 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:41:50.187762 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:41:50.187762 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:41:50.187762 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:41:50.187762 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:41:50.187762 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:41:50.187762 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:41:50.187762 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:41:50.187762 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:41:50.187762 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 17:41:50.187762 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:41:50.190038 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 118/239] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:41:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:41:50.202123 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb267c-8527-4091-b3e3-4a2cea6fd46b None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:50.223473 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:50.269070 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ce0ac-a83a-44e5-8ecf-8a3cf5e826f2 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:50.269944 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ce0ac-a83a-44e5-8ecf-8a3cf5e826f2 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:50.270470 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ce0ac-a83a-44e5-8ecf-8a3cf5e826f2 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:50.272602 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 119/240] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:41:50.278577 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe98a37-13ec-4d9c-b3b0-f4b2080a1ee9 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:50.279288 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe98a37-13ec-4d9c-b3b0-f4b2080a1ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:50.280087 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe98a37-13ec-4d9c-b3b0-f4b2080a1ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:50.314653 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-9fe98a37-13ec-4d9c-b3b0-f4b2080a1ee9 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:50.316053 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-9fe98a37-13ec-4d9c-b3b0-f4b2080a1ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:50.353053 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:50.371458 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb267c-8527-4091-b3e3-4a2cea6fd46b None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:50.434325 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764a306-cd91-4d1a-bbd6-79c5584422d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:50.435586 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764a306-cd91-4d1a-bbd6-79c5584422d8 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:50.436191 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764a306-cd91-4d1a-bbd6-79c5584422d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:50.436792 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764a306-cd91-4d1a-bbd6-79c5584422d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:50.438229 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764a306-cd91-4d1a-bbd6-79c5584422d8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:50.438800 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764a306-cd91-4d1a-bbd6-79c5584422d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:50.440570 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764a306-cd91-4d1a-bbd6-79c5584422d8 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:50.445072 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 120/241] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:41:50.446613 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe98a37-13ec-4d9c-b3b0-f4b2080a1ee9 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:50.452556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 122/242] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Sep 26 17:41:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:50.461490 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764a306-cd91-4d1a-bbd6-79c5584422d8 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:50.607494 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:50.636606 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe98a37-13ec-4d9c-b3b0-f4b2080a1ee9 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:50.655943 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764a306-cd91-4d1a-bbd6-79c5584422d8 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:50.708052 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d35943-bda3-4a1d-9161-0c13310004f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:50.708610 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d35943-bda3-4a1d-9161-0c13310004f7 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:50.708883 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d35943-bda3-4a1d-9161-0c13310004f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:50.709180 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d35943-bda3-4a1d-9161-0c13310004f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:50.710459 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d35943-bda3-4a1d-9161-0c13310004f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:50.712635 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d35943-bda3-4a1d-9161-0c13310004f7 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:50.714969 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 121/243] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:41:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:50.720828 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d35943-bda3-4a1d-9161-0c13310004f7 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:50.726303 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81311a1-3c84-4f01-ab3e-09284984202a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:50.727800 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81311a1-3c84-4f01-ab3e-09284984202a None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:50.728410 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81311a1-3c84-4f01-ab3e-09284984202a None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:50.728862 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81311a1-3c84-4f01-ab3e-09284984202a None admin] PATH_INFO: `/v3/users/fdfb276b6fc946168ea9c8be53109d31` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:50.745121 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81311a1-3c84-4f01-ab3e-09284984202a None admin] RBAC: Authorizing `identity:get_user(user_id=fdfb276b6fc946168ea9c8be53109d31)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:50.746915 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81311a1-3c84-4f01-ab3e-09284984202a None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:50.748977 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 123/244] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:41:50 2022] GET /identity/v3/users/fdfb276b6fc946168ea9c8be53109d31 => generated 297 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:50.749759 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81311a1-3c84-4f01-ab3e-09284984202a None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:50.753759 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:50.858360 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d35943-bda3-4a1d-9161-0c13310004f7 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:50.869633 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81311a1-3c84-4f01-ab3e-09284984202a None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:50.906109 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:50.909394 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fc997-22f3-4939-a730-97a0ffb0ac2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:50.910372 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fc997-22f3-4939-a730-97a0ffb0ac2b None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:50.910940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fc997-22f3-4939-a730-97a0ffb0ac2b None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:50.911395 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fc997-22f3-4939-a730-97a0ffb0ac2b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:50.913281 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100c10c-86f6-4663-80d7-fa4af8f1f012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:50.913946 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100c10c-86f6-4663-80d7-fa4af8f1f012 None admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:50.914768 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100c10c-86f6-4663-80d7-fa4af8f1f012 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:50.915038 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100c10c-86f6-4663-80d7-fa4af8f1f012 None admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:50.915791 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100c10c-86f6-4663-80d7-fa4af8f1f012 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:50.917170 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100c10c-86f6-4663-80d7-fa4af8f1f012 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:50.924412 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4fc997-22f3-4939-a730-97a0ffb0ac2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:41:50.932128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-aa4fc997-22f3-4939-a730-97a0ffb0ac2b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 17:41:50.932128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:41:50.932128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:41:50.932128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:41:50.932128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:41:50.932128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:41:50.932128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:41:50.932128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:41:50.932128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:41:50.932128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:41:50.932128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:41:50.932128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:41:50.932128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:41:50.932128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:41:50.932128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:41:50.932128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:41:50.933263 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:41:50.933263 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:41:50.933263 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:41:50.933263 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:41:50.933263 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:41:50.933263 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:41:50.933263 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:41:50.933263 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:41:50.933263 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:41:50.933263 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:41:50.933263 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:41:50.933263 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:41:50.933263 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:41:50.933263 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:41:50.933263 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:41:50.933263 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:41:50.934291 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:41:50.934291 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:41:50.934291 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:41:50.934291 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:41:50.934291 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:41:50.934291 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:41:50.934291 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:41:50.934291 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:41:50.934291 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:41:50.934291 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:41:50.934291 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 17:41:50.934291 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:41:50.936097 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 122/245] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:41:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:41:50.937405 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fc997-22f3-4939-a730-97a0ffb0ac2b None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:50.945790 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 124/246] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Sep 26 17:41:50 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:41:50.946485 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100c10c-86f6-4663-80d7-fa4af8f1f012 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:51.040206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:51.062803 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fc997-22f3-4939-a730-97a0ffb0ac2b None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:51.068682 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100c10c-86f6-4663-80d7-fa4af8f1f012 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:51.104883 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e182883-3884-44bd-9830-73d2f4b6dd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:51.105938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e182883-3884-44bd-9830-73d2f4b6dd1e None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:51.106416 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e182883-3884-44bd-9830-73d2f4b6dd1e None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:51.106905 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e182883-3884-44bd-9830-73d2f4b6dd1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:51.109766 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a32ab6-9330-40f5-9a71-d2a761a968fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:51.110449 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a32ab6-9330-40f5-9a71-d2a761a968fb None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:51.110731 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a32ab6-9330-40f5-9a71-d2a761a968fb None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:51.111000 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a32ab6-9330-40f5-9a71-d2a761a968fb None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:51.111681 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a32ab6-9330-40f5-9a71-d2a761a968fb None admin] RBAC: Adding query filter params (name=member) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:51.112889 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a32ab6-9330-40f5-9a71-d2a761a968fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:51.113404 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a32ab6-9330-40f5-9a71-d2a761a968fb None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:51.123102 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 125/247] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Sep 26 17:41:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:51.128668 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4c7b5-ca8d-4ed8-abcb-59495506b044 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:51.128957 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4c7b5-ca8d-4ed8-abcb-59495506b044 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:51.129258 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4c7b5-ca8d-4ed8-abcb-59495506b044 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:51.130689 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 126/248] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:41:51.131263 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4c7b5-ca8d-4ed8-abcb-59495506b044 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:51.184183 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e182883-3884-44bd-9830-73d2f4b6dd1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:51.185357 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:51.186565 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e182883-3884-44bd-9830-73d2f4b6dd1e None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:51.264400 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4c7b5-ca8d-4ed8-abcb-59495506b044 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:51.291497 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:51.315515 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087e789-82bf-4ecf-9eaf-44229b881a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:51.316202 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087e789-82bf-4ecf-9eaf-44229b881a4c None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:51.316482 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087e789-82bf-4ecf-9eaf-44229b881a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:51.316756 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087e789-82bf-4ecf-9eaf-44229b881a4c None admin] PATH_INFO: `/v3/users/57837d131a4d4ccdb7b1046bb81142cb` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:51.318502 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 123/249] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:41:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 17:41:51.319339 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e087e789-82bf-4ecf-9eaf-44229b881a4c None admin] RBAC: Authorizing `identity:get_user(user_id=57837d131a4d4ccdb7b1046bb81142cb)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:51.319749 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79d07f-60eb-41aa-b757-e1fc30ac4ad2 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:51.320029 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79d07f-60eb-41aa-b757-e1fc30ac4ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:51.320335 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79d07f-60eb-41aa-b757-e1fc30ac4ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:51.320964 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e087e789-82bf-4ecf-9eaf-44229b881a4c None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:51.323032 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 127/250] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:41:51 2022] GET /identity/v3/users/57837d131a4d4ccdb7b1046bb81142cb => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:51.324169 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087e789-82bf-4ecf-9eaf-44229b881a4c None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:51.341997 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-9b79d07f-60eb-41aa-b757-e1fc30ac4ad2 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:51.343286 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-9b79d07f-60eb-41aa-b757-e1fc30ac4ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:51.428497 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 124/251] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:41:51.430251 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79d07f-60eb-41aa-b757-e1fc30ac4ad2 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:51.462065 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087e789-82bf-4ecf-9eaf-44229b881a4c None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:51.484390 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:51.507554 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f963fe4-435d-4df2-9604-0f0f3c68aa49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:51.508760 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f963fe4-435d-4df2-9604-0f0f3c68aa49 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:51.509062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f963fe4-435d-4df2-9604-0f0f3c68aa49 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:51.509343 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f963fe4-435d-4df2-9604-0f0f3c68aa49 None admin] PATH_INFO: `/v3/projects/5f86051201ae444796f8bf9e49c1b888` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:51.510474 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f963fe4-435d-4df2-9604-0f0f3c68aa49 None admin] RBAC: Authorizing `identity:get_project(project_id=5f86051201ae444796f8bf9e49c1b888)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:51.512790 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f963fe4-435d-4df2-9604-0f0f3c68aa49 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:51.514948 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 128/252] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:41:51 2022] GET /identity/v3/projects/5f86051201ae444796f8bf9e49c1b888 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:51.520566 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f963fe4-435d-4df2-9604-0f0f3c68aa49 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:51.552205 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79d07f-60eb-41aa-b757-e1fc30ac4ad2 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:51.572771 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:51.602100 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa49070-dd33-4aa0-8f5b-5e06f25496f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:51.603386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa49070-dd33-4aa0-8f5b-5e06f25496f0 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:51.604749 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa49070-dd33-4aa0-8f5b-5e06f25496f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:51.605265 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa49070-dd33-4aa0-8f5b-5e06f25496f0 None admin] PATH_INFO: `/v3/projects/5f86051201ae444796f8bf9e49c1b888` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:51.606677 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa49070-dd33-4aa0-8f5b-5e06f25496f0 None admin] RBAC: Authorizing `identity:get_project(project_id=5f86051201ae444796f8bf9e49c1b888)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:51.608374 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa49070-dd33-4aa0-8f5b-5e06f25496f0 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:51.610798 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 125/253] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:41:51 2022] GET /identity/v3/projects/5f86051201ae444796f8bf9e49c1b888 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:51.616775 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa49070-dd33-4aa0-8f5b-5e06f25496f0 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:51.667144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f963fe4-435d-4df2-9604-0f0f3c68aa49 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:51.741761 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f481f70-0a2c-4b10-9b87-153d3f641374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:51.742795 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f481f70-0a2c-4b10-9b87-153d3f641374 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:51.743270 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f481f70-0a2c-4b10-9b87-153d3f641374 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:51.743746 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f481f70-0a2c-4b10-9b87-153d3f641374 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:51.744688 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f481f70-0a2c-4b10-9b87-153d3f641374 None admin] RBAC: Adding query filter params (role.id=def729f162f44f65b2e2bf261dde9b39, scope.project.id=5f86051201ae444796f8bf9e49c1b888, user.id=fdfb276b6fc946168ea9c8be53109d31) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:51.745239 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f481f70-0a2c-4b10-9b87-153d3f641374 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:51.747025 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f481f70-0a2c-4b10-9b87-153d3f641374 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:51.753035 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 129/254] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:41:51 2022] GET /identity/v3/role_assignments?user.id=fdfb276b6fc946168ea9c8be53109d31&scope.project.id=5f86051201ae444796f8bf9e49c1b888&role.id=def729f162f44f65b2e2bf261dde9b39 => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:41:51.805140 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa49070-dd33-4aa0-8f5b-5e06f25496f0 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:51.819636 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f481f70-0a2c-4b10-9b87-153d3f641374 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:51.861596 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b344d1-1c47-44fe-afcc-3084d1755ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:51.864133 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b344d1-1c47-44fe-afcc-3084d1755ea1 None admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:51.864411 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b344d1-1c47-44fe-afcc-3084d1755ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:51.864688 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b344d1-1c47-44fe-afcc-3084d1755ea1 None admin] PATH_INFO: `/v3/projects/5f86051201ae444796f8bf9e49c1b888/users/57837d131a4d4ccdb7b1046bb81142cb/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:51.869978 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b344d1-1c47-44fe-afcc-3084d1755ea1 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f86051201ae444796f8bf9e49c1b888, user_id=57837d131a4d4ccdb7b1046bb81142cb, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:51.871496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b344d1-1c47-44fe-afcc-3084d1755ea1 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:51.892051 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 126/255] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Sep 26 17:41:51 2022] PUT /identity/v3/projects/5f86051201ae444796f8bf9e49c1b888/users/57837d131a4d4ccdb7b1046bb81142cb/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:41:51.921277 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:52.011550 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f481f70-0a2c-4b10-9b87-153d3f641374 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:52.066853 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2bd5d4-2880-4ff1-a873-e77a2aad4be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:52.067444 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bd5d4-2880-4ff1-a873-e77a2aad4be9 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:52.067742 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bd5d4-2880-4ff1-a873-e77a2aad4be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:52.068067 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bd5d4-2880-4ff1-a873-e77a2aad4be9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:52.082954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2bd5d4-2880-4ff1-a873-e77a2aad4be9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:41:52.083355 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ee931-567d-40b7-90c5-287997026dae None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:52.083816 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ee931-567d-40b7-90c5-287997026dae None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:52.084228 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ee931-567d-40b7-90c5-287997026dae None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:52.087169 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 127/256] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:41:52.089183 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-ba2bd5d4-2880-4ff1-a873-e77a2aad4be9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:41:52.089183 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:41:52.089183 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:41:52.089183 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:41:52.089183 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:41:52.089183 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:41:52.089183 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:41:52.089183 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:41:52.089183 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:41:52.089183 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:41:52.089183 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:41:52.089183 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:41:52.089183 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:41:52.089183 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:41:52.089183 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:41:52.089183 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:41:52.090043 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:41:52.090043 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:41:52.090043 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:41:52.090043 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:41:52.090043 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:41:52.090043 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:41:52.090043 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:41:52.090043 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:41:52.090043 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:41:52.090043 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:41:52.090043 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:41:52.090043 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:41:52.090043 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:41:52.090043 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:41:52.090043 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:41:52.090043 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:41:52.090815 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:41:52.090815 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:41:52.090815 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:41:52.090815 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:41:52.090815 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:41:52.090815 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:41:52.090815 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:41:52.090815 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:41:52.090815 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:41:52.090815 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:41:52.090815 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:41:52.090815 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:41:52.090815 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 130/257] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Sep 26 17:41:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:41:52.095718 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5871fe9-e963-4f10-9e7d-def7392c438d None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:52.096005 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5871fe9-e963-4f10-9e7d-def7392c438d None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:52.096280 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5871fe9-e963-4f10-9e7d-def7392c438d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:52.096561 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2bd5d4-2880-4ff1-a873-e77a2aad4be9 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:52.141062 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-c5871fe9-e963-4f10-9e7d-def7392c438d None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:52.142469 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-c5871fe9-e963-4f10-9e7d-def7392c438d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:52.225398 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2bd5d4-2880-4ff1-a873-e77a2aad4be9 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:52.237532 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:52.239255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:52.283306 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 128/258] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:41:52.298665 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f39312-7881-4973-94d4-a62c9ce2a4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:52.299392 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f39312-7881-4973-94d4-a62c9ce2a4bd None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:52.299711 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f39312-7881-4973-94d4-a62c9ce2a4bd None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:52.299988 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f39312-7881-4973-94d4-a62c9ce2a4bd None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:52.300667 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f39312-7881-4973-94d4-a62c9ce2a4bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:52.300976 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f39312-7881-4973-94d4-a62c9ce2a4bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:52.302430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f39312-7881-4973-94d4-a62c9ce2a4bd None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:52.319255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 131/259] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:41:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:41:52.324917 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5871fe9-e963-4f10-9e7d-def7392c438d None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:52.461764 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5871fe9-e963-4f10-9e7d-def7392c438d None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:52.502986 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783cef4-b25f-4e58-8cc8-07d31ccb625a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:52.503987 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783cef4-b25f-4e58-8cc8-07d31ccb625a None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:52.504457 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783cef4-b25f-4e58-8cc8-07d31ccb625a None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:52.504915 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783cef4-b25f-4e58-8cc8-07d31ccb625a None admin] PATH_INFO: `/v3/users/d139027996f248f5b957be881e5c0c36` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:52.506307 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783cef4-b25f-4e58-8cc8-07d31ccb625a None admin] RBAC: Authorizing `identity:get_user(user_id=d139027996f248f5b957be881e5c0c36)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:52.508470 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783cef4-b25f-4e58-8cc8-07d31ccb625a None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:52.510283 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 129/260] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:41:52 2022] GET /identity/v3/users/d139027996f248f5b957be881e5c0c36 => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:52.515864 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f39312-7881-4973-94d4-a62c9ce2a4bd None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:52.657373 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783cef4-b25f-4e58-8cc8-07d31ccb625a None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:52.657539 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f39312-7881-4973-94d4-a62c9ce2a4bd None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:52.708165 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:52.718494 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358e055-e0c1-416f-b8d5-414a7a0d8e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:52.719176 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358e055-e0c1-416f-b8d5-414a7a0d8e60 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:52.719455 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358e055-e0c1-416f-b8d5-414a7a0d8e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:52.719731 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358e055-e0c1-416f-b8d5-414a7a0d8e60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:52.785477 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783cef4-b25f-4e58-8cc8-07d31ccb625a None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:52.791812 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:52.829337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b1def-43dc-48e5-9a66-960d30224eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:52.830709 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b1def-43dc-48e5-9a66-960d30224eed None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:52.831180 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b1def-43dc-48e5-9a66-960d30224eed None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:52.831670 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b1def-43dc-48e5-9a66-960d30224eed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:52.844570 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536b1def-43dc-48e5-9a66-960d30224eed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:41:52.851260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-536b1def-43dc-48e5-9a66-960d30224eed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 17:41:52.851260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:41:52.851260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:41:52.851260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:41:52.851260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:41:52.851260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:41:52.851260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:41:52.851260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:41:52.851260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:41:52.851260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:41:52.851260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:41:52.851260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:41:52.851260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:41:52.851260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:41:52.851260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:41:52.851260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:41:52.852161 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:41:52.852161 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:41:52.852161 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:41:52.852161 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:41:52.852161 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:41:52.852161 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:41:52.852161 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:41:52.852161 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:41:52.852161 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:41:52.852161 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:41:52.852161 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:41:52.852161 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:41:52.852161 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:41:52.852161 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:41:52.852161 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:41:52.852161 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:41:52.852955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:41:52.852955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:41:52.852955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:41:52.852955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:41:52.852955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:41:52.852955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:41:52.852955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:41:52.852955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:41:52.852955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:41:52.852955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:41:52.852955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 17:41:52.852955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:41:52.855938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 130/261] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Sep 26 17:41:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:41:52.862248 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b1def-43dc-48e5-9a66-960d30224eed None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:52.876096 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358e055-e0c1-416f-b8d5-414a7a0d8e60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:52.881626 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358e055-e0c1-416f-b8d5-414a7a0d8e60 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:53.040322 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:53.044937 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 132/262] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:41:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 17:41:53.051066 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b1def-43dc-48e5-9a66-960d30224eed None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:53.054914 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358e055-e0c1-416f-b8d5-414a7a0d8e60 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:53.126008 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080fb1f-63a7-4f48-ac56-da0bee89de7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:53.126621 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080fb1f-63a7-4f48-ac56-da0bee89de7d None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:53.126902 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080fb1f-63a7-4f48-ac56-da0bee89de7d None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:53.127175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080fb1f-63a7-4f48-ac56-da0bee89de7d None admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:53.127848 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080fb1f-63a7-4f48-ac56-da0bee89de7d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:53.128154 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080fb1f-63a7-4f48-ac56-da0bee89de7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:53.129591 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080fb1f-63a7-4f48-ac56-da0bee89de7d None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:53.143268 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 131/263] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:41:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:41:53.149653 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080fb1f-63a7-4f48-ac56-da0bee89de7d None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:53.162674 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:53.218064 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358e055-e0c1-416f-b8d5-414a7a0d8e60 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:53.265932 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa54de-aeb9-4f78-9f93-b6715970edf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:53.266571 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa54de-aeb9-4f78-9f93-b6715970edf5 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:53.266855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa54de-aeb9-4f78-9f93-b6715970edf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:53.267126 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa54de-aeb9-4f78-9f93-b6715970edf5 None admin] PATH_INFO: `/v3/projects/5f86051201ae444796f8bf9e49c1b888` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:53.268269 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa54de-aeb9-4f78-9f93-b6715970edf5 None admin] RBAC: Authorizing `identity:get_project(project_id=5f86051201ae444796f8bf9e49c1b888)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:53.269759 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa54de-aeb9-4f78-9f93-b6715970edf5 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:53.271416 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 133/264] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:41:53 2022] GET /identity/v3/projects/5f86051201ae444796f8bf9e49c1b888 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:53.278312 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa54de-aeb9-4f78-9f93-b6715970edf5 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:53.356931 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080fb1f-63a7-4f48-ac56-da0bee89de7d None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:53.417522 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa54de-aeb9-4f78-9f93-b6715970edf5 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:53.430373 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4a972-a04b-423c-8a46-3c2c0f98fa74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:53.431027 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4a972-a04b-423c-8a46-3c2c0f98fa74 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:53.431306 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4a972-a04b-423c-8a46-3c2c0f98fa74 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:53.431581 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4a972-a04b-423c-8a46-3c2c0f98fa74 None admin] PATH_INFO: `/v3/users/d139027996f248f5b957be881e5c0c36` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:53.432735 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4a972-a04b-423c-8a46-3c2c0f98fa74 None admin] RBAC: Authorizing `identity:get_user(user_id=d139027996f248f5b957be881e5c0c36)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:53.434261 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4a972-a04b-423c-8a46-3c2c0f98fa74 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:53.436150 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 132/265] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:41:53 2022] GET /identity/v3/users/d139027996f248f5b957be881e5c0c36 => generated 283 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:41:53.441893 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4a972-a04b-423c-8a46-3c2c0f98fa74 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:53.473462 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc223e9-f2ea-45c0-9c05-d17444a971f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:53.473837 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc223e9-f2ea-45c0-9c05-d17444a971f5 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:53.474121 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc223e9-f2ea-45c0-9c05-d17444a971f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:53.474397 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc223e9-f2ea-45c0-9c05-d17444a971f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:53.475150 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc223e9-f2ea-45c0-9c05-d17444a971f5 None admin] RBAC: Adding query filter params (role.id=be6ee971abf54b26be509c14823ece55, scope.project.id=5f86051201ae444796f8bf9e49c1b888, user.id=d139027996f248f5b957be881e5c0c36) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:53.475461 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc223e9-f2ea-45c0-9c05-d17444a971f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:53.477028 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc223e9-f2ea-45c0-9c05-d17444a971f5 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:53.492701 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 134/266] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:41:53 2022] GET /identity/v3/role_assignments?user.id=d139027996f248f5b957be881e5c0c36&scope.project.id=5f86051201ae444796f8bf9e49c1b888&role.id=be6ee971abf54b26be509c14823ece55 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:53.531839 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:53.652671 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4a972-a04b-423c-8a46-3c2c0f98fa74 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:53.718621 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291009c-6ca8-4c4d-a471-3f7477877c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:53.719254 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291009c-6ca8-4c4d-a471-3f7477877c43 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:53.719533 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291009c-6ca8-4c4d-a471-3f7477877c43 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:53.719807 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291009c-6ca8-4c4d-a471-3f7477877c43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:53.827419 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291009c-6ca8-4c4d-a471-3f7477877c43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:53.828918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291009c-6ca8-4c4d-a471-3f7477877c43 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:53.868138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:53.962237 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 133/267] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:41:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 17:41:53.969467 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc223e9-f2ea-45c0-9c05-d17444a971f5 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:53.977337 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:54.118419 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc223e9-f2ea-45c0-9c05-d17444a971f5 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:54.159361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a82cff-1314-4f50-a8c7-cb1ff1739fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:54.160008 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a82cff-1314-4f50-a8c7-cb1ff1739fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:54.160573 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a82cff-1314-4f50-a8c7-cb1ff1739fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:54.160847 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a82cff-1314-4f50-a8c7-cb1ff1739fc7 None admin] PATH_INFO: `/v3/projects/5f86051201ae444796f8bf9e49c1b888` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:54.162016 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a82cff-1314-4f50-a8c7-cb1ff1739fc7 None admin] RBAC: Authorizing `identity:get_project(project_id=5f86051201ae444796f8bf9e49c1b888)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:54.163474 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a82cff-1314-4f50-a8c7-cb1ff1739fc7 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:54.165489 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 135/268] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:41:53 2022] GET /identity/v3/projects/5f86051201ae444796f8bf9e49c1b888 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:54.174112 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291009c-6ca8-4c4d-a471-3f7477877c43 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:54.327323 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291009c-6ca8-4c4d-a471-3f7477877c43 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:54.364911 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:54.375024 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc5c2f-ac3c-4cf1-b7f8-46643ee1ff7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:54.375637 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc5c2f-ac3c-4cf1-b7f8-46643ee1ff7a None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:54.375918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc5c2f-ac3c-4cf1-b7f8-46643ee1ff7a None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:54.379143 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc5c2f-ac3c-4cf1-b7f8-46643ee1ff7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:54.379143 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc5c2f-ac3c-4cf1-b7f8-46643ee1ff7a None admin] RBAC: Adding query filter params (role.id=1d93df17fd9a4d92b8c9966cc9deacde, scope.project.id=5f86051201ae444796f8bf9e49c1b888, user.id=d139027996f248f5b957be881e5c0c36) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:54.379143 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc5c2f-ac3c-4cf1-b7f8-46643ee1ff7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:54.379143 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc5c2f-ac3c-4cf1-b7f8-46643ee1ff7a None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:54.387624 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 134/269] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:41:54 2022] GET /identity/v3/role_assignments?user.id=d139027996f248f5b957be881e5c0c36&scope.project.id=5f86051201ae444796f8bf9e49c1b888&role.id=1d93df17fd9a4d92b8c9966cc9deacde => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:54.434253 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad909ca0-d054-48c6-b584-51396e1ad373 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:54.434558 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad909ca0-d054-48c6-b584-51396e1ad373 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:54.434810 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad909ca0-d054-48c6-b584-51396e1ad373 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:54.436571 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 136/270] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:41:54.442498 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7eb44-335a-464c-84e7-85bdf52073b2 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:54.442860 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7eb44-335a-464c-84e7-85bdf52073b2 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:54.443058 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7eb44-335a-464c-84e7-85bdf52073b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:54.462820 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-0db7eb44-335a-464c-84e7-85bdf52073b2 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:54.464060 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-0db7eb44-335a-464c-84e7-85bdf52073b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:54.505273 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa38a70-fd96-4ec6-99e0-0d7ce0138521 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:54.505923 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa38a70-fd96-4ec6-99e0-0d7ce0138521 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:54.506398 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa38a70-fd96-4ec6-99e0-0d7ce0138521 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:54.508096 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 137/271] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 17:41:54.516501 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17520e27-790b-4094-8e37-5de241ddb66f None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:54.517121 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17520e27-790b-4094-8e37-5de241ddb66f None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:54.517594 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17520e27-790b-4094-8e37-5de241ddb66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:54.544375 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 135/272] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:41:54.550061 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-17520e27-790b-4094-8e37-5de241ddb66f None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:54.551279 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-17520e27-790b-4094-8e37-5de241ddb66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:54.638339 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 138/273] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:41:54.857185 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3de58f-48ad-45f5-9f6d-024169bca4f4 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:54.857522 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3de58f-48ad-45f5-9f6d-024169bca4f4 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:54.857741 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3de58f-48ad-45f5-9f6d-024169bca4f4 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:54.859381 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 136/274] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:41:54.864683 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4750a9c-2f9b-415a-aae5-e33d4bf12da9 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:54.864971 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4750a9c-2f9b-415a-aae5-e33d4bf12da9 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:54.865270 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4750a9c-2f9b-415a-aae5-e33d4bf12da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:54.871576 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:54.889806 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-f4750a9c-2f9b-415a-aae5-e33d4bf12da9 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:54.891100 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3de58f-48ad-45f5-9f6d-024169bca4f4 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:54.892916 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-f4750a9c-2f9b-415a-aae5-e33d4bf12da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:54.982707 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 139/275] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:41:54.983558 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4750a9c-2f9b-415a-aae5-e33d4bf12da9 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:55.025834 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3de58f-48ad-45f5-9f6d-024169bca4f4 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:55.051833 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:55.071698 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4d270-7fec-4b75-8f11-91762fb2687d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:55.072375 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4d270-7fec-4b75-8f11-91762fb2687d None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:55.072721 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4d270-7fec-4b75-8f11-91762fb2687d None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:55.072991 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4d270-7fec-4b75-8f11-91762fb2687d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:55.074147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4d270-7fec-4b75-8f11-91762fb2687d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:55.075882 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4d270-7fec-4b75-8f11-91762fb2687d None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:55.082934 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 137/276] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:41:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:41:55.084346 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4d270-7fec-4b75-8f11-91762fb2687d None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:55.112680 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4750a9c-2f9b-415a-aae5-e33d4bf12da9 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:55.149227 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:55.155723 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c702a6-b1eb-4531-93ae-6b85bf964fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:55.157418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c702a6-b1eb-4531-93ae-6b85bf964fed None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:55.158593 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c702a6-b1eb-4531-93ae-6b85bf964fed None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:55.159152 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c702a6-b1eb-4531-93ae-6b85bf964fed None admin] PATH_INFO: `/v3/roles/member` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:55.174921 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c702a6-b1eb-4531-93ae-6b85bf964fed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:41:55.181623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-a3c702a6-b1eb-4531-93ae-6b85bf964fed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 17:41:55.181623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:41:55.181623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:41:55.181623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:41:55.181623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:41:55.181623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:41:55.181623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:41:55.181623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:41:55.181623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:41:55.181623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:41:55.181623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:41:55.181623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:41:55.181623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:41:55.181623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:41:55.181623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:41:55.181623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:41:55.182781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:41:55.182781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:41:55.182781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:41:55.182781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:41:55.182781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:41:55.182781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:41:55.182781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:41:55.182781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:41:55.182781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:41:55.182781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:41:55.182781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:41:55.182781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:41:55.182781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:41:55.182781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:41:55.182781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:41:55.182781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:41:55.183590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:41:55.183590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:41:55.183590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:41:55.183590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:41:55.183590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:41:55.183590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:41:55.183590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:41:55.183590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:41:55.183590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:41:55.183590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:41:55.183590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 17:41:55.183590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:41:55.188270 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 140/277] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:41:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:41:55.189349 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c702a6-b1eb-4531-93ae-6b85bf964fed None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:55.216930 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4d270-7fec-4b75-8f11-91762fb2687d None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:55.259496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aca8b8-2194-4dda-bf52-9a696144b772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:55.260456 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aca8b8-2194-4dda-bf52-9a696144b772 None admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:55.260735 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aca8b8-2194-4dda-bf52-9a696144b772 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:55.261025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aca8b8-2194-4dda-bf52-9a696144b772 None admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:55.261959 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aca8b8-2194-4dda-bf52-9a696144b772 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:55.263585 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aca8b8-2194-4dda-bf52-9a696144b772 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:55.293057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 138/278] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Sep 26 17:41:55 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:41:55.294211 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48488e16-d1c8-4caf-95a0-3d43ffd9aec2 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:55.294506 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48488e16-d1c8-4caf-95a0-3d43ffd9aec2 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:55.294777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48488e16-d1c8-4caf-95a0-3d43ffd9aec2 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:55.300123 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 139/279] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:41:55.301853 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0e1f4-ae17-4a4c-a17f-9106ccdc0255 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:55.302136 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0e1f4-ae17-4a4c-a17f-9106ccdc0255 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:55.302406 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0e1f4-ae17-4a4c-a17f-9106ccdc0255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:55.321912 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c702a6-b1eb-4531-93ae-6b85bf964fed None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:55.326346 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-2ff0e1f4-ae17-4a4c-a17f-9106ccdc0255 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:55.327591 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-2ff0e1f4-ae17-4a4c-a17f-9106ccdc0255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:55.364867 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6d0da-9772-4c89-8b7b-155aefaf9ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:55.365992 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6d0da-9772-4c89-8b7b-155aefaf9ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:55.366591 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6d0da-9772-4c89-8b7b-155aefaf9ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:55.367101 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6d0da-9772-4c89-8b7b-155aefaf9ec8 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:55.368058 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6d0da-9772-4c89-8b7b-155aefaf9ec8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:55.368468 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6d0da-9772-4c89-8b7b-155aefaf9ec8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:55.369923 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6d0da-9772-4c89-8b7b-155aefaf9ec8 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:55.375440 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:55.384213 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 141/280] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Sep 26 17:41:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:55.384898 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6d0da-9772-4c89-8b7b-155aefaf9ec8 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:55.413071 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 140/281] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 17:41:55.413696 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0e1f4-ae17-4a4c-a17f-9106ccdc0255 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:55.471994 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:55.540247 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6d0da-9772-4c89-8b7b-155aefaf9ec8 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:55.542383 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0e1f4-ae17-4a4c-a17f-9106ccdc0255 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:55.584983 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fbef94-53b2-4ef8-b41f-05962e7f8db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:55.585698 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbef94-53b2-4ef8-b41f-05962e7f8db3 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:55.586005 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbef94-53b2-4ef8-b41f-05962e7f8db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:55.586275 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbef94-53b2-4ef8-b41f-05962e7f8db3 None admin] PATH_INFO: `/v3/users/a5f8c0071544461582805d558e04aa86` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:55.587923 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2f8b6-28e2-4d97-af52-89bc9402ff88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:55.588740 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2f8b6-28e2-4d97-af52-89bc9402ff88 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:55.589920 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2f8b6-28e2-4d97-af52-89bc9402ff88 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:55.590204 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2f8b6-28e2-4d97-af52-89bc9402ff88 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:55.604433 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f2f8b6-28e2-4d97-af52-89bc9402ff88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:41:55.605291 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fbef94-53b2-4ef8-b41f-05962e7f8db3 None admin] RBAC: Authorizing `identity:get_user(user_id=a5f8c0071544461582805d558e04aa86)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:55.607344 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fbef94-53b2-4ef8-b41f-05962e7f8db3 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:55.609218 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 141/282] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:41:55 2022] GET /identity/v3/users/a5f8c0071544461582805d558e04aa86 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:55.612002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-68f2f8b6-28e2-4d97-af52-89bc9402ff88 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 17:41:55.612002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:41:55.612002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:41:55.612002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:41:55.612002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:41:55.612002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:41:55.612002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:41:55.612002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:41:55.612002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:41:55.612002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:41:55.612002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:41:55.612002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:41:55.612002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:41:55.612002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:41:55.612002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:41:55.612002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:41:55.613091 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:41:55.613091 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:41:55.613091 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:41:55.613091 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:41:55.613091 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:41:55.613091 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:41:55.613091 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:41:55.613091 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:41:55.613091 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:41:55.613091 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:41:55.613091 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:41:55.613091 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:41:55.613091 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:41:55.613091 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:41:55.613091 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:41:55.613091 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:41:55.614307 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:41:55.614307 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:41:55.614307 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:41:55.614307 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:41:55.614307 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:41:55.614307 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:41:55.614307 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:41:55.614307 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:41:55.614307 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:41:55.614307 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:41:55.614307 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 17:41:55.614307 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:41:55.614307 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 142/283] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:41:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:41:55.617347 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fbef94-53b2-4ef8-b41f-05962e7f8db3 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:55.620235 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2f8b6-28e2-4d97-af52-89bc9402ff88 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:55.666046 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:55.750102 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2f8b6-28e2-4d97-af52-89bc9402ff88 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:55.753830 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fbef94-53b2-4ef8-b41f-05962e7f8db3 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:55.767566 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:55.799123 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afcba1-838f-45b9-8724-c49e60ce462b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:55.799735 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afcba1-838f-45b9-8724-c49e60ce462b None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:55.800009 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afcba1-838f-45b9-8724-c49e60ce462b None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:55.800274 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afcba1-838f-45b9-8724-c49e60ce462b None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:55.801404 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2afcba1-838f-45b9-8724-c49e60ce462b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:55.801404 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2afcba1-838f-45b9-8724-c49e60ce462b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:55.802803 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2afcba1-838f-45b9-8724-c49e60ce462b None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:55.810268 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1aa073-554f-44f9-9682-0f9fbc6bb307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:55.811683 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1aa073-554f-44f9-9682-0f9fbc6bb307 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:55.812415 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1aa073-554f-44f9-9682-0f9fbc6bb307 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:55.812886 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1aa073-554f-44f9-9682-0f9fbc6bb307 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:55.813869 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1aa073-554f-44f9-9682-0f9fbc6bb307 None admin] RBAC: Adding query filter params (role.id=b4593720c06e4a0db655f8e33079a15f, user.id=a5f8c0071544461582805d558e04aa86, scope.system=all) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:55.814353 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1aa073-554f-44f9-9682-0f9fbc6bb307 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:55.814577 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 143/284] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Sep 26 17:41:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:41:55.815675 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afcba1-838f-45b9-8724-c49e60ce462b None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:55.816479 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1aa073-554f-44f9-9682-0f9fbc6bb307 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:55.827658 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 142/285] 10.222.0.62 () {56 vars in 1308 bytes} [Mon Sep 26 17:41:55 2022] GET /identity/v3/role_assignments?user.id=a5f8c0071544461582805d558e04aa86&scope.system=all&role.id=b4593720c06e4a0db655f8e33079a15f => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:55.829302 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1aa073-554f-44f9-9682-0f9fbc6bb307 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:55.935585 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afcba1-838f-45b9-8724-c49e60ce462b None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:55.968019 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:55.973825 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1aa073-554f-44f9-9682-0f9fbc6bb307 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:55.995701 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c0df9-c448-46aa-b302-b5b7efbaa461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:55.996348 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c0df9-c448-46aa-b302-b5b7efbaa461 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:55.996622 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c0df9-c448-46aa-b302-b5b7efbaa461 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:55.996893 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c0df9-c448-46aa-b302-b5b7efbaa461 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:56.015277 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d256cc-3c38-4eed-a227-7747473f93c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:56.015933 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d256cc-3c38-4eed-a227-7747473f93c1 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:56.016207 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d256cc-3c38-4eed-a227-7747473f93c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:56.016484 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d256cc-3c38-4eed-a227-7747473f93c1 None admin] PATH_INFO: `/v3/users/fdfb276b6fc946168ea9c8be53109d31` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:56.017786 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d256cc-3c38-4eed-a227-7747473f93c1 None admin] RBAC: Authorizing `identity:get_user(user_id=fdfb276b6fc946168ea9c8be53109d31)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:56.019365 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d256cc-3c38-4eed-a227-7747473f93c1 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:56.021368 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 143/286] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:41:55 2022] GET /identity/v3/users/fdfb276b6fc946168ea9c8be53109d31 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:56.028119 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d256cc-3c38-4eed-a227-7747473f93c1 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:56.030318 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c0df9-c448-46aa-b302-b5b7efbaa461 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:41:56.036150 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-531c0df9-c448-46aa-b302-b5b7efbaa461 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 17:41:56.036150 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:41:56.036150 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:41:56.036150 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:41:56.036150 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:41:56.036150 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:41:56.036150 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:41:56.036150 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:41:56.036150 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:41:56.036150 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:41:56.036150 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:41:56.036150 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:41:56.036150 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:41:56.036150 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:41:56.036150 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:41:56.036150 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:41:56.037100 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:41:56.037100 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:41:56.037100 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:41:56.037100 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:41:56.037100 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:41:56.037100 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:41:56.037100 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:41:56.037100 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:41:56.037100 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:41:56.037100 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:41:56.037100 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:41:56.037100 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:41:56.037100 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:41:56.037100 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:41:56.037100 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:41:56.037100 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:41:56.037874 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:41:56.037874 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:41:56.037874 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:41:56.037874 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:41:56.037874 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:41:56.037874 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:41:56.037874 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:41:56.037874 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:41:56.037874 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:41:56.037874 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:41:56.037874 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 17:41:56.037874 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:41:56.044426 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 144/287] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:41:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:41:56.052653 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c0df9-c448-46aa-b302-b5b7efbaa461 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:56.144509 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d256cc-3c38-4eed-a227-7747473f93c1 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:56.145729 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:56.191249 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcecb84-a05e-4e6e-8844-91c1e87a4941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:56.191830 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcecb84-a05e-4e6e-8844-91c1e87a4941 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:56.192111 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcecb84-a05e-4e6e-8844-91c1e87a4941 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:56.192384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcecb84-a05e-4e6e-8844-91c1e87a4941 None admin] PATH_INFO: `/v3/projects/5f86051201ae444796f8bf9e49c1b888` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:56.194471 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcecb84-a05e-4e6e-8844-91c1e87a4941 None admin] RBAC: Authorizing `identity:get_project(project_id=5f86051201ae444796f8bf9e49c1b888)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:56.196546 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcecb84-a05e-4e6e-8844-91c1e87a4941 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:56.198995 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 144/288] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:41:56 2022] GET /identity/v3/projects/5f86051201ae444796f8bf9e49c1b888 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:41:56.205142 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcecb84-a05e-4e6e-8844-91c1e87a4941 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:56.230595 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c0df9-c448-46aa-b302-b5b7efbaa461 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:56.262713 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:56.328344 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8ba15-4df1-4bea-85be-6541e3511561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:56.328960 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8ba15-4df1-4bea-85be-6541e3511561 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:56.329261 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8ba15-4df1-4bea-85be-6541e3511561 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:56.329533 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8ba15-4df1-4bea-85be-6541e3511561 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:56.330203 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8ba15-4df1-4bea-85be-6541e3511561 None admin] RBAC: Adding query filter params (name=member) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:56.330506 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8ba15-4df1-4bea-85be-6541e3511561 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:56.331907 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8ba15-4df1-4bea-85be-6541e3511561 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:56.352234 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 145/289] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Sep 26 17:41:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:56.353075 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcecb84-a05e-4e6e-8844-91c1e87a4941 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:56.366167 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8ba15-4df1-4bea-85be-6541e3511561 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:56.416224 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b5957-db50-4d09-aff3-28670fa49447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:56.416938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b5957-db50-4d09-aff3-28670fa49447 None admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:56.417277 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b5957-db50-4d09-aff3-28670fa49447 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:56.417544 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b5957-db50-4d09-aff3-28670fa49447 None admin] PATH_INFO: `/v3/projects/5f86051201ae444796f8bf9e49c1b888/users/fdfb276b6fc946168ea9c8be53109d31/roles/def729f162f44f65b2e2bf261dde9b39` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:56.420292 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b5957-db50-4d09-aff3-28670fa49447 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f86051201ae444796f8bf9e49c1b888, user_id=fdfb276b6fc946168ea9c8be53109d31, role_id=def729f162f44f65b2e2bf261dde9b39)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:56.421752 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b5957-db50-4d09-aff3-28670fa49447 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:56.450265 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 145/290] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Sep 26 17:41:56 2022] PUT /identity/v3/projects/5f86051201ae444796f8bf9e49c1b888/users/fdfb276b6fc946168ea9c8be53109d31/roles/def729f162f44f65b2e2bf261dde9b39 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:41:56.521315 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:56.525894 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8ba15-4df1-4bea-85be-6541e3511561 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:56.578563 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714db464-3a5d-43fb-8a7e-ac64b5678c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:56.579268 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714db464-3a5d-43fb-8a7e-ac64b5678c6f None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:56.579552 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714db464-3a5d-43fb-8a7e-ac64b5678c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:56.579829 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714db464-3a5d-43fb-8a7e-ac64b5678c6f None admin] PATH_INFO: `/v3/users/57837d131a4d4ccdb7b1046bb81142cb` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:56.581833 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714db464-3a5d-43fb-8a7e-ac64b5678c6f None admin] RBAC: Authorizing `identity:get_user(user_id=57837d131a4d4ccdb7b1046bb81142cb)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:56.583660 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714db464-3a5d-43fb-8a7e-ac64b5678c6f None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:56.585814 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 146/291] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:41:56 2022] GET /identity/v3/users/57837d131a4d4ccdb7b1046bb81142cb => generated 297 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:41:56.594608 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b5957-db50-4d09-aff3-28670fa49447 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:56.712592 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:56.719702 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b5957-db50-4d09-aff3-28670fa49447 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:56.757121 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b827d-7cc2-4eab-ab1f-61e55feb4c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:56.757830 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b827d-7cc2-4eab-ab1f-61e55feb4c1b None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:56.758110 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b827d-7cc2-4eab-ab1f-61e55feb4c1b None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:56.758381 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b827d-7cc2-4eab-ab1f-61e55feb4c1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:56.827795 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9b827d-7cc2-4eab-ab1f-61e55feb4c1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:56.829286 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9b827d-7cc2-4eab-ab1f-61e55feb4c1b None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:56.925437 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:56.932165 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 146/292] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:41:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 17:41:56.938080 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714db464-3a5d-43fb-8a7e-ac64b5678c6f None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:57.066496 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714db464-3a5d-43fb-8a7e-ac64b5678c6f None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:57.110398 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01c9d3-3a7e-4e45-9122-ab04650aa356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:57.111041 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01c9d3-3a7e-4e45-9122-ab04650aa356 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:57.111322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01c9d3-3a7e-4e45-9122-ab04650aa356 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:57.111598 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01c9d3-3a7e-4e45-9122-ab04650aa356 None admin] PATH_INFO: `/v3/projects/5f86051201ae444796f8bf9e49c1b888` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:57.112724 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01c9d3-3a7e-4e45-9122-ab04650aa356 None admin] RBAC: Authorizing `identity:get_project(project_id=5f86051201ae444796f8bf9e49c1b888)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:57.114200 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01c9d3-3a7e-4e45-9122-ab04650aa356 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:57.115838 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 147/293] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:41:56 2022] GET /identity/v3/projects/5f86051201ae444796f8bf9e49c1b888 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:57.122422 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b827d-7cc2-4eab-ab1f-61e55feb4c1b None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:57.231760 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b827d-7cc2-4eab-ab1f-61e55feb4c1b None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:57.266931 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42e65e-8bcd-4ff1-b32e-06b18216aabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:57.267537 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42e65e-8bcd-4ff1-b32e-06b18216aabd None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:57.267810 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42e65e-8bcd-4ff1-b32e-06b18216aabd None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:57.268080 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42e65e-8bcd-4ff1-b32e-06b18216aabd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:57.268812 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42e65e-8bcd-4ff1-b32e-06b18216aabd None admin] RBAC: Adding query filter params (role.id=b4593720c06e4a0db655f8e33079a15f, scope.project.id=5f86051201ae444796f8bf9e49c1b888, user.id=57837d131a4d4ccdb7b1046bb81142cb) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:57.269144 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42e65e-8bcd-4ff1-b32e-06b18216aabd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:57.270615 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42e65e-8bcd-4ff1-b32e-06b18216aabd None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:57.277274 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 147/294] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:41:57 2022] GET /identity/v3/role_assignments?user.id=57837d131a4d4ccdb7b1046bb81142cb&scope.project.id=5f86051201ae444796f8bf9e49c1b888&role.id=b4593720c06e4a0db655f8e33079a15f => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:57.949340 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ad2b7-b2b1-4ca7-96e2-3e4bc6dc5577 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:57.949721 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ad2b7-b2b1-4ca7-96e2-3e4bc6dc5577 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:57.949884 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ad2b7-b2b1-4ca7-96e2-3e4bc6dc5577 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:57.951926 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 148/295] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:41:57.957002 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547f102-3570-423a-835f-69e2f9751095 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:57.957571 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547f102-3570-423a-835f-69e2f9751095 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:57.958060 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547f102-3570-423a-835f-69e2f9751095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:57.977763 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-d547f102-3570-423a-835f-69e2f9751095 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:57.979169 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-d547f102-3570-423a-835f-69e2f9751095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:58.034039 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:58.049139 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 148/296] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:41:58.239900 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a98a27-3395-4647-af2c-2a9d95335c44 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:58.240390 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a98a27-3395-4647-af2c-2a9d95335c44 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:58.240390 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a98a27-3395-4647-af2c-2a9d95335c44 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:58.241785 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 149/297] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:41:58.247586 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18227d55-dd1c-43ec-a903-111e2c7d5490 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:58.247971 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18227d55-dd1c-43ec-a903-111e2c7d5490 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:58.248151 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18227d55-dd1c-43ec-a903-111e2c7d5490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:58.266813 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-18227d55-dd1c-43ec-a903-111e2c7d5490 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:58.268044 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-18227d55-dd1c-43ec-a903-111e2c7d5490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:58.320049 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a98a27-3395-4647-af2c-2a9d95335c44 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:58.345105 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 149/298] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:41:58.362539 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:58.444319 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a98a27-3395-4647-af2c-2a9d95335c44 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:58.480423 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793310d7-d4e6-412e-b30e-a0fdf482f808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:58.481084 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793310d7-d4e6-412e-b30e-a0fdf482f808 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:58.481377 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793310d7-d4e6-412e-b30e-a0fdf482f808 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:58.481685 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793310d7-d4e6-412e-b30e-a0fdf482f808 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:58.492619 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793310d7-d4e6-412e-b30e-a0fdf482f808 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:41:58.497867 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-793310d7-d4e6-412e-b30e-a0fdf482f808 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 17:41:58.497867 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:41:58.497867 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:41:58.497867 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:41:58.497867 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:41:58.497867 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:41:58.497867 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:41:58.497867 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:41:58.497867 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:41:58.497867 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:41:58.497867 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:41:58.497867 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:41:58.497867 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:41:58.497867 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:41:58.497867 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:41:58.497867 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:41:58.498763 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:41:58.498763 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:41:58.498763 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:41:58.498763 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:41:58.498763 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:41:58.498763 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:41:58.498763 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:41:58.498763 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:41:58.498763 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:41:58.498763 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:41:58.498763 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:41:58.498763 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:41:58.498763 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:41:58.498763 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:41:58.498763 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:41:58.498763 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:41:58.499559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:41:58.499559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:41:58.499559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:41:58.499559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:41:58.499559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:41:58.499559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:41:58.499559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:41:58.499559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:41:58.499559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:41:58.499559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:41:58.499559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 17:41:58.499559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:41:58.500154 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72a7d4-072b-4f81-ae27-fca13fe74806 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:58.500154 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72a7d4-072b-4f81-ae27-fca13fe74806 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:58.500154 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72a7d4-072b-4f81-ae27-fca13fe74806 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:58.500331 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 150/299] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:41:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:41:58.500404 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 150/300] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 17:41:58.505981 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793310d7-d4e6-412e-b30e-a0fdf482f808 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:58.506329 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c8ff9-b5c1-4555-a1d1-c8c18eed6754 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:58.506683 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c8ff9-b5c1-4555-a1d1-c8c18eed6754 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:58.506963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c8ff9-b5c1-4555-a1d1-c8c18eed6754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:58.533636 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-053c8ff9-b5c1-4555-a1d1-c8c18eed6754 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:58.535456 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-053c8ff9-b5c1-4555-a1d1-c8c18eed6754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:58.612473 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:58.620677 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793310d7-d4e6-412e-b30e-a0fdf482f808 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:58.630111 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 151/301] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:41:58.654741 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c8ff9-b5c1-4555-a1d1-c8c18eed6754 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:58.661699 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29887c70-953a-4d4b-8982-fa0608057112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:58.662315 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29887c70-953a-4d4b-8982-fa0608057112 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:58.662591 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29887c70-953a-4d4b-8982-fa0608057112 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:58.662857 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29887c70-953a-4d4b-8982-fa0608057112 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:58.663589 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29887c70-953a-4d4b-8982-fa0608057112 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:58.664466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29887c70-953a-4d4b-8982-fa0608057112 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:58.665986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29887c70-953a-4d4b-8982-fa0608057112 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:58.675624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 151/302] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Sep 26 17:41:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:58.681534 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29887c70-953a-4d4b-8982-fa0608057112 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:58.711593 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:58.768367 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c8ff9-b5c1-4555-a1d1-c8c18eed6754 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:58.791604 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29887c70-953a-4d4b-8982-fa0608057112 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:58.808123 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85be60-e725-43e0-916d-3bd1e559c3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:58.809148 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85be60-e725-43e0-916d-3bd1e559c3ec None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:58.809597 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85be60-e725-43e0-916d-3bd1e559c3ec None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:58.810109 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85be60-e725-43e0-916d-3bd1e559c3ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:58.811379 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85be60-e725-43e0-916d-3bd1e559c3ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:58.813134 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85be60-e725-43e0-916d-3bd1e559c3ec None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:58.814873 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 152/303] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:41:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:58.821334 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85be60-e725-43e0-916d-3bd1e559c3ec None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:58.828208 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23581f69-c2ea-48ac-b1fb-d1ee7b94269f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:58.828910 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23581f69-c2ea-48ac-b1fb-d1ee7b94269f None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:58.829222 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23581f69-c2ea-48ac-b1fb-d1ee7b94269f None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:58.829496 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23581f69-c2ea-48ac-b1fb-d1ee7b94269f None admin] PATH_INFO: `/v3/users/d137f5984bce4e159aa4d54a80113c2d` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:58.844321 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23581f69-c2ea-48ac-b1fb-d1ee7b94269f None admin] RBAC: Authorizing `identity:get_user(user_id=d137f5984bce4e159aa4d54a80113c2d)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:58.845826 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23581f69-c2ea-48ac-b1fb-d1ee7b94269f None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:58.852668 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 152/304] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:41:58 2022] GET /identity/v3/users/d137f5984bce4e159aa4d54a80113c2d => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:41:58.853612 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23581f69-c2ea-48ac-b1fb-d1ee7b94269f None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:58.870516 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:58.933134 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85be60-e725-43e0-916d-3bd1e559c3ec None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:58.951831 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:58.965420 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23581f69-c2ea-48ac-b1fb-d1ee7b94269f None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:58.970364 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ade2b-41e7-4b23-9a89-ff3bbe3e72e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:58.970980 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ade2b-41e7-4b23-9a89-ff3bbe3e72e6 None admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:58.971253 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ade2b-41e7-4b23-9a89-ff3bbe3e72e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:58.971517 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ade2b-41e7-4b23-9a89-ff3bbe3e72e6 None admin] PATH_INFO: `/v3/groups` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:58.972162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ade2b-41e7-4b23-9a89-ff3bbe3e72e6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:58.973948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ade2b-41e7-4b23-9a89-ff3bbe3e72e6 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:58.991603 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 153/305] 10.222.0.62 () {60 vars in 1134 bytes} [Mon Sep 26 17:41:58 2022] POST /identity/v3/groups => generated 229 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:41:58.993337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ade2b-41e7-4b23-9a89-ff3bbe3e72e6 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:59.009382 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97023ad4-6828-4a9f-a52b-0feef3657454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:59.010122 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97023ad4-6828-4a9f-a52b-0feef3657454 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:59.010474 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97023ad4-6828-4a9f-a52b-0feef3657454 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:59.010816 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97023ad4-6828-4a9f-a52b-0feef3657454 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:59.011644 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97023ad4-6828-4a9f-a52b-0feef3657454 None admin] RBAC: Adding query filter params (role.id=def729f162f44f65b2e2bf261dde9b39, user.id=d137f5984bce4e159aa4d54a80113c2d, scope.system=all) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:59.012059 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97023ad4-6828-4a9f-a52b-0feef3657454 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:59.013693 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97023ad4-6828-4a9f-a52b-0feef3657454 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:59.027296 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 153/306] 10.222.0.62 () {56 vars in 1308 bytes} [Mon Sep 26 17:41:58 2022] GET /identity/v3/role_assignments?user.id=d137f5984bce4e159aa4d54a80113c2d&scope.system=all&role.id=def729f162f44f65b2e2bf261dde9b39 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:41:59.111789 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bee82d-15a8-45ec-a52d-8b8930080cb7 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:59.112130 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bee82d-15a8-45ec-a52d-8b8930080cb7 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:59.112336 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bee82d-15a8-45ec-a52d-8b8930080cb7 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:59.114605 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 154/307] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:41:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 17:41:59.124167 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e41efa-c4e5-4001-9d14-dec15a211c9d None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:59.124806 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e41efa-c4e5-4001-9d14-dec15a211c9d None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:59.125323 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e41efa-c4e5-4001-9d14-dec15a211c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:59.145253 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ade2b-41e7-4b23-9a89-ff3bbe3e72e6 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:59.147765 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-32e41efa-c4e5-4001-9d14-dec15a211c9d None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:41:59.150474 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-32e41efa-c4e5-4001-9d14-dec15a211c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:41:59.190905 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8300af-4a70-4eca-b725-bec9f08bcc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:59.191570 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8300af-4a70-4eca-b725-bec9f08bcc62 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:59.191848 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8300af-4a70-4eca-b725-bec9f08bcc62 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:59.192165 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8300af-4a70-4eca-b725-bec9f08bcc62 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:59.208682 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8300af-4a70-4eca-b725-bec9f08bcc62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:41:59.215130 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-3c8300af-4a70-4eca-b725-bec9f08bcc62 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 17:41:59.215130 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:41:59.215130 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:41:59.215130 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:41:59.215130 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:41:59.215130 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:41:59.215130 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:41:59.215130 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:41:59.215130 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:41:59.215130 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:41:59.215130 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:41:59.215130 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:41:59.215130 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:41:59.215130 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:41:59.215130 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:41:59.215130 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:41:59.216062 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:41:59.216062 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:41:59.216062 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:41:59.216062 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:41:59.216062 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:41:59.216062 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:41:59.216062 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:41:59.216062 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:41:59.216062 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:41:59.216062 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:41:59.216062 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:41:59.216062 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:41:59.216062 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:41:59.216062 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:41:59.216062 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:41:59.216062 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:41:59.216895 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:41:59.216895 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:41:59.216895 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:41:59.216895 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:41:59.216895 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:41:59.216895 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:41:59.216895 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:41:59.216895 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:41:59.216895 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:41:59.216895 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:41:59.216895 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 17:41:59.216895 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:41:59.216895 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 154/308] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:41:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:41:59.224593 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8300af-4a70-4eca-b725-bec9f08bcc62 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:59.255686 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 155/309] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:41:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 17:41:59.266096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:59.336361 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8300af-4a70-4eca-b725-bec9f08bcc62 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:59.371646 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33e625-494a-4514-a96a-32bb250c86aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:59.372685 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33e625-494a-4514-a96a-32bb250c86aa None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:59.373209 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33e625-494a-4514-a96a-32bb250c86aa None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:59.373685 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33e625-494a-4514-a96a-32bb250c86aa None admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:59.374861 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33e625-494a-4514-a96a-32bb250c86aa None admin] RBAC: Adding query filter params (name=member) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:59.375364 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33e625-494a-4514-a96a-32bb250c86aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:59.377533 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33e625-494a-4514-a96a-32bb250c86aa None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:59.387485 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 155/310] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Sep 26 17:41:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:41:59.398121 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e41efa-c4e5-4001-9d14-dec15a211c9d None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:59.422161 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:59.510188 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e41efa-c4e5-4001-9d14-dec15a211c9d None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:59.541252 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33e625-494a-4514-a96a-32bb250c86aa None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:59.547382 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d73958-e5f7-4abe-906d-01fdd9ac1d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:59.548028 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d73958-e5f7-4abe-906d-01fdd9ac1d46 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:59.548294 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d73958-e5f7-4abe-906d-01fdd9ac1d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:59.548569 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d73958-e5f7-4abe-906d-01fdd9ac1d46 None admin] PATH_INFO: `/v3/users/a5f8c0071544461582805d558e04aa86` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:59.549826 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d73958-e5f7-4abe-906d-01fdd9ac1d46 None admin] RBAC: Authorizing `identity:get_user(user_id=a5f8c0071544461582805d558e04aa86)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:59.551285 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d73958-e5f7-4abe-906d-01fdd9ac1d46 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:59.553046 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 156/311] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:41:59 2022] GET /identity/v3/users/a5f8c0071544461582805d558e04aa86 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:59.559870 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d73958-e5f7-4abe-906d-01fdd9ac1d46 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:59.654898 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:59.682511 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:41:59.684942 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d73958-e5f7-4abe-906d-01fdd9ac1d46 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:59.686362 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33e625-494a-4514-a96a-32bb250c86aa None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:59.724407 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195845f-a91c-414c-a79f-ae130d392b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:59.725539 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195845f-a91c-414c-a79f-ae130d392b38 None admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:59.726046 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195845f-a91c-414c-a79f-ae130d392b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:59.726653 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195845f-a91c-414c-a79f-ae130d392b38 None admin] PATH_INFO: `/v3/system/users/a5f8c0071544461582805d558e04aa86/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:59.728279 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c195845f-a91c-414c-a79f-ae130d392b38 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a5f8c0071544461582805d558e04aa86, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:59.730061 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c195845f-a91c-414c-a79f-ae130d392b38 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:59.735081 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2acdd0-be32-4a3f-aa97-91d6ba5d9bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:59.735719 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2acdd0-be32-4a3f-aa97-91d6ba5d9bf8 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:59.736038 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2acdd0-be32-4a3f-aa97-91d6ba5d9bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:59.736324 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2acdd0-be32-4a3f-aa97-91d6ba5d9bf8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:59.749977 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2acdd0-be32-4a3f-aa97-91d6ba5d9bf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:41:59.750499 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 157/312] 10.222.0.62 () {58 vars in 1334 bytes} [Mon Sep 26 17:41:59 2022] PUT /identity/v3/system/users/a5f8c0071544461582805d558e04aa86/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:41:59.755207 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-ad2acdd0-be32-4a3f-aa97-91d6ba5d9bf8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 17:41:59.755207 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:41:59.755207 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:41:59.755207 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:41:59.755207 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:41:59.755207 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:41:59.755207 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:41:59.755207 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:41:59.755207 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:41:59.755207 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:41:59.755207 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:41:59.755207 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:41:59.755207 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:41:59.755207 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:41:59.755207 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:41:59.755207 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:41:59.756147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:41:59.756147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:41:59.756147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:41:59.756147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:41:59.756147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:41:59.756147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:41:59.756147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:41:59.756147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:41:59.756147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:41:59.756147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:41:59.756147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:41:59.756147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:41:59.756147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:41:59.756147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:41:59.756147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:41:59.756147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:41:59.756963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:41:59.756963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:41:59.756963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:41:59.756963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:41:59.756963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:41:59.756963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:41:59.756963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:41:59.756963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:41:59.756963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:41:59.756963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:41:59.756963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 17:41:59.756963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:41:59.756963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 156/313] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:41:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:41:59.763538 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195845f-a91c-414c-a79f-ae130d392b38 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:41:59.881633 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195845f-a91c-414c-a79f-ae130d392b38 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:41:59.922177 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39324651-d3a8-4a1d-a5cd-ded2a4301455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:41:59.922822 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39324651-d3a8-4a1d-a5cd-ded2a4301455 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:41:59.923104 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39324651-d3a8-4a1d-a5cd-ded2a4301455 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:41:59.923376 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39324651-d3a8-4a1d-a5cd-ded2a4301455 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:41:59.924061 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39324651-d3a8-4a1d-a5cd-ded2a4301455 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:41:59.924428 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39324651-d3a8-4a1d-a5cd-ded2a4301455 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:41:59.925953 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39324651-d3a8-4a1d-a5cd-ded2a4301455 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:41:59.936683 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 158/314] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Sep 26 17:41:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:41:59.943340 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2acdd0-be32-4a3f-aa97-91d6ba5d9bf8 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:00.053403 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2acdd0-be32-4a3f-aa97-91d6ba5d9bf8 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:00.090066 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131e1d8-043a-4a8d-8a8a-85f027a5018b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:00.091022 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131e1d8-043a-4a8d-8a8a-85f027a5018b None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:00.091495 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131e1d8-043a-4a8d-8a8a-85f027a5018b None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:00.091962 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131e1d8-043a-4a8d-8a8a-85f027a5018b None admin] PATH_INFO: `/v3/users/fdfb276b6fc946168ea9c8be53109d31` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:00.093298 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f131e1d8-043a-4a8d-8a8a-85f027a5018b None admin] RBAC: Authorizing `identity:get_user(user_id=fdfb276b6fc946168ea9c8be53109d31)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:00.094968 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f131e1d8-043a-4a8d-8a8a-85f027a5018b None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:00.097101 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 157/315] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:41:59 2022] GET /identity/v3/users/fdfb276b6fc946168ea9c8be53109d31 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:00.102796 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39324651-d3a8-4a1d-a5cd-ded2a4301455 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:00.105499 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:00.212608 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39324651-d3a8-4a1d-a5cd-ded2a4301455 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:00.249860 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de1406-f444-423d-b637-b2682f429e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:00.250472 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de1406-f444-423d-b637-b2682f429e04 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:00.250750 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de1406-f444-423d-b637-b2682f429e04 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:00.251018 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de1406-f444-423d-b637-b2682f429e04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:00.323303 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de1406-f444-423d-b637-b2682f429e04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:00.324764 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de1406-f444-423d-b637-b2682f429e04 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:00.326842 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:00.427326 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 159/316] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:42:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 17:42:00.432675 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131e1d8-043a-4a8d-8a8a-85f027a5018b None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:00.461805 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:00.538696 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131e1d8-043a-4a8d-8a8a-85f027a5018b None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:00.574661 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef83125-5c21-4912-9796-d2f401b64da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:00.575297 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef83125-5c21-4912-9796-d2f401b64da7 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:00.575578 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef83125-5c21-4912-9796-d2f401b64da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:00.576108 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef83125-5c21-4912-9796-d2f401b64da7 None admin] PATH_INFO: `/v3/projects/5f86051201ae444796f8bf9e49c1b888` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:00.577268 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef83125-5c21-4912-9796-d2f401b64da7 None admin] RBAC: Authorizing `identity:get_project(project_id=5f86051201ae444796f8bf9e49c1b888)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:00.578729 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef83125-5c21-4912-9796-d2f401b64da7 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:00.580652 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 158/317] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:42:00 2022] GET /identity/v3/projects/5f86051201ae444796f8bf9e49c1b888 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:00.587347 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de1406-f444-423d-b637-b2682f429e04 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:00.691380 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de1406-f444-423d-b637-b2682f429e04 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:00.693304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:00.732288 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629fb92-a024-4978-bc24-871616216420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:00.732899 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629fb92-a024-4978-bc24-871616216420 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:00.733211 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629fb92-a024-4978-bc24-871616216420 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:00.733487 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629fb92-a024-4978-bc24-871616216420 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:00.734222 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629fb92-a024-4978-bc24-871616216420 None admin] RBAC: Adding query filter params (role.id=def729f162f44f65b2e2bf261dde9b39, scope.project.id=5f86051201ae444796f8bf9e49c1b888, user.id=fdfb276b6fc946168ea9c8be53109d31) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:00.734530 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629fb92-a024-4978-bc24-871616216420 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:00.735980 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629fb92-a024-4978-bc24-871616216420 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:00.742365 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 160/318] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:42:00 2022] GET /identity/v3/role_assignments?user.id=fdfb276b6fc946168ea9c8be53109d31&scope.project.id=5f86051201ae444796f8bf9e49c1b888&role.id=def729f162f44f65b2e2bf261dde9b39 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:01.241103 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0478a2-ab04-4a1a-a433-a350f30139f0 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:01.241488 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0478a2-ab04-4a1a-a433-a350f30139f0 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:01.241692 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0478a2-ab04-4a1a-a433-a350f30139f0 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:01.243056 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 159/319] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:01.248785 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b64ddb-7c3e-4f37-88de-2d0cb7f5e087 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:01.249118 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b64ddb-7c3e-4f37-88de-2d0cb7f5e087 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:01.249396 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b64ddb-7c3e-4f37-88de-2d0cb7f5e087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:01.269364 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-50b64ddb-7c3e-4f37-88de-2d0cb7f5e087 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:01.270697 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-50b64ddb-7c3e-4f37-88de-2d0cb7f5e087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:01.345718 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 161/320] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:42:01.383255 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a75ae7-824f-4491-bec0-69cab8c45300 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:01.383536 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a75ae7-824f-4491-bec0-69cab8c45300 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:01.383801 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a75ae7-824f-4491-bec0-69cab8c45300 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:01.385298 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 160/321] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:01.394035 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c3c0d-109f-4c49-906e-c3b4cb44be01 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:01.394035 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c3c0d-109f-4c49-906e-c3b4cb44be01 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:01.394035 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c3c0d-109f-4c49-906e-c3b4cb44be01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:01.412423 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-556c3c0d-109f-4c49-906e-c3b4cb44be01 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:01.413709 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-556c3c0d-109f-4c49-906e-c3b4cb44be01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:01.493133 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 162/322] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:42:01.627369 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a75ae7-824f-4491-bec0-69cab8c45300 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:01.750549 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:01.759167 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c3c0d-109f-4c49-906e-c3b4cb44be01 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:01.760484 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a75ae7-824f-4491-bec0-69cab8c45300 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:01.788514 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:01.803301 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7939840-ceeb-4200-9bd8-65095b9bd999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:01.803941 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7939840-ceeb-4200-9bd8-65095b9bd999 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:01.804220 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7939840-ceeb-4200-9bd8-65095b9bd999 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:01.804493 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7939840-ceeb-4200-9bd8-65095b9bd999 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:01.818551 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7939840-ceeb-4200-9bd8-65095b9bd999 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:42:01.823386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-e7939840-ceeb-4200-9bd8-65095b9bd999 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 17:42:01.823386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:01.823386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:01.823386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:01.823386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:01.823386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:01.823386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:01.823386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:01.823386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:01.823386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:01.823386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:01.823386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:01.823386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:42:01.823386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:42:01.823386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:42:01.823386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:42:01.824447 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:42:01.824447 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:42:01.824447 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:42:01.824447 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:42:01.824447 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:01.824447 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:01.824447 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:01.824447 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:01.824447 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:01.824447 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:01.824447 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:01.824447 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:01.824447 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:01.824447 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:01.824447 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:01.824447 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:01.826303 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:01.826303 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:01.826303 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:01.826303 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:01.826303 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:42:01.826303 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:42:01.826303 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:42:01.826303 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:42:01.826303 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:42:01.826303 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:42:01.826303 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 17:42:01.826303 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:01.826303 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 161/323] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:42:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:01.830454 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7939840-ceeb-4200-9bd8-65095b9bd999 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:01.878760 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c3c0d-109f-4c49-906e-c3b4cb44be01 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:01.917505 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757025e-2156-4992-b19c-32b946972961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:01.918167 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757025e-2156-4992-b19c-32b946972961 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:01.918472 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757025e-2156-4992-b19c-32b946972961 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:01.918718 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757025e-2156-4992-b19c-32b946972961 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:01.920015 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757025e-2156-4992-b19c-32b946972961 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:01.921560 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757025e-2156-4992-b19c-32b946972961 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:01.925055 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 163/324] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:42:01.928982 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757025e-2156-4992-b19c-32b946972961 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:01.938923 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7939840-ceeb-4200-9bd8-65095b9bd999 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:01.976996 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc781d-68db-422a-9e46-158a9a2893b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:01.977642 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc781d-68db-422a-9e46-158a9a2893b9 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:01.977921 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc781d-68db-422a-9e46-158a9a2893b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:01.978189 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc781d-68db-422a-9e46-158a9a2893b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:01.979237 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc781d-68db-422a-9e46-158a9a2893b9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:01.979573 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc781d-68db-422a-9e46-158a9a2893b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:01.981333 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc781d-68db-422a-9e46-158a9a2893b9 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:01.994757 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 162/325] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Sep 26 17:42:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:42:01.995795 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc781d-68db-422a-9e46-158a9a2893b9 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:02.015230 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:02.039768 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:02.047897 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757025e-2156-4992-b19c-32b946972961 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:02.084624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725c13c-41dd-4d0a-b52c-0646da6bcb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:02.085264 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725c13c-41dd-4d0a-b52c-0646da6bcb54 None admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:02.085540 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725c13c-41dd-4d0a-b52c-0646da6bcb54 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:02.085835 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725c13c-41dd-4d0a-b52c-0646da6bcb54 None admin] PATH_INFO: `/v3/groups` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:02.086451 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725c13c-41dd-4d0a-b52c-0646da6bcb54 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:02.087870 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725c13c-41dd-4d0a-b52c-0646da6bcb54 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:02.102679 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc781d-68db-422a-9e46-158a9a2893b9 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:02.105932 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 164/326] 10.222.0.62 () {60 vars in 1134 bytes} [Mon Sep 26 17:42:01 2022] POST /identity/v3/groups => generated 226 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:42:02.107134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d30829-682a-4ee3-bcb4-20828612c774 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:02.107416 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d30829-682a-4ee3-bcb4-20828612c774 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:02.107686 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d30829-682a-4ee3-bcb4-20828612c774 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:02.113444 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 165/327] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:02.115489 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d6e7c-0617-4516-8981-3d59d8bdc25f None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:02.115776 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d6e7c-0617-4516-8981-3d59d8bdc25f None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:02.116053 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d6e7c-0617-4516-8981-3d59d8bdc25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:02.138319 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-ae3d6e7c-0617-4516-8981-3d59d8bdc25f None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:02.139729 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-ae3d6e7c-0617-4516-8981-3d59d8bdc25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:02.153404 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df64f8e-66b7-46b8-8d47-1be55b69044d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:02.154738 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df64f8e-66b7-46b8-8d47-1be55b69044d None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:02.155193 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df64f8e-66b7-46b8-8d47-1be55b69044d None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:02.155645 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df64f8e-66b7-46b8-8d47-1be55b69044d None admin] PATH_INFO: `/v3/users/d137f5984bce4e159aa4d54a80113c2d` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:02.157167 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df64f8e-66b7-46b8-8d47-1be55b69044d None admin] RBAC: Authorizing `identity:get_user(user_id=d137f5984bce4e159aa4d54a80113c2d)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:02.158863 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df64f8e-66b7-46b8-8d47-1be55b69044d None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:02.161116 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 163/328] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:42:01 2022] GET /identity/v3/users/d137f5984bce4e159aa4d54a80113c2d => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:42:02.166886 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df64f8e-66b7-46b8-8d47-1be55b69044d None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:02.227150 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 166/329] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 17:42:02.275145 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:02.295673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df64f8e-66b7-46b8-8d47-1be55b69044d None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:02.331323 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6d175-69cb-4424-b8fe-b38b67d42c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:02.331979 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6d175-69cb-4424-b8fe-b38b67d42c6c None admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:02.332259 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6d175-69cb-4424-b8fe-b38b67d42c6c None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:02.332535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6d175-69cb-4424-b8fe-b38b67d42c6c None admin] PATH_INFO: `/v3/system/users/d137f5984bce4e159aa4d54a80113c2d/roles/def729f162f44f65b2e2bf261dde9b39` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:02.333975 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb6d175-69cb-4424-b8fe-b38b67d42c6c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d137f5984bce4e159aa4d54a80113c2d, role_id=def729f162f44f65b2e2bf261dde9b39)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:02.335353 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb6d175-69cb-4424-b8fe-b38b67d42c6c None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:02.344230 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 164/330] 10.222.0.62 () {58 vars in 1334 bytes} [Mon Sep 26 17:42:02 2022] PUT /identity/v3/system/users/d137f5984bce4e159aa4d54a80113c2d/roles/def729f162f44f65b2e2bf261dde9b39 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:42:02.502947 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d6e7c-0617-4516-8981-3d59d8bdc25f None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:02.615434 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:02.635983 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d6e7c-0617-4516-8981-3d59d8bdc25f None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:02.674050 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9e54e-1f89-4a95-b274-0102d400a78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:02.674697 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9e54e-1f89-4a95-b274-0102d400a78d None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:02.675074 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9e54e-1f89-4a95-b274-0102d400a78d None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:02.675381 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9e54e-1f89-4a95-b274-0102d400a78d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:02.686886 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b9e54e-1f89-4a95-b274-0102d400a78d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:42:02.691831 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-14b9e54e-1f89-4a95-b274-0102d400a78d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 17:42:02.691831 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:02.691831 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:02.691831 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:02.691831 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:02.691831 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:02.691831 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:02.691831 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:02.691831 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:02.691831 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:02.691831 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:02.691831 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:02.691831 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:42:02.691831 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:42:02.691831 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:42:02.691831 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:42:02.692724 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:42:02.692724 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:42:02.692724 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:42:02.692724 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:42:02.692724 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:02.692724 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:02.692724 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:02.692724 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:02.692724 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:02.692724 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:02.692724 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:02.692724 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:02.692724 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:02.692724 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:02.692724 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:02.692724 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:02.693575 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:02.693575 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:02.693575 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:02.693575 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:02.693575 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:42:02.693575 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:42:02.693575 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:42:02.693575 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:42:02.693575 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:42:02.693575 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:42:02.693575 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 17:42:02.693575 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:02.693575 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 167/331] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:42:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:02.699598 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6d175-69cb-4424-b8fe-b38b67d42c6c None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:02.819409 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6d175-69cb-4424-b8fe-b38b67d42c6c None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:02.855235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298bc5c-4829-4a9e-91b0-6f7b4731474f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:02.855845 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298bc5c-4829-4a9e-91b0-6f7b4731474f None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:02.856118 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298bc5c-4829-4a9e-91b0-6f7b4731474f None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:02.856433 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298bc5c-4829-4a9e-91b0-6f7b4731474f None admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:02.857150 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298bc5c-4829-4a9e-91b0-6f7b4731474f None admin] RBAC: Adding query filter params (name=member) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:02.857456 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298bc5c-4829-4a9e-91b0-6f7b4731474f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:02.858850 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298bc5c-4829-4a9e-91b0-6f7b4731474f None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:02.868402 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 165/332] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Sep 26 17:42:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:02.873987 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9e54e-1f89-4a95-b274-0102d400a78d None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:03.007432 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9e54e-1f89-4a95-b274-0102d400a78d None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:03.045058 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a66f46-0307-414e-a36e-1c6eac65f96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:03.045788 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a66f46-0307-414e-a36e-1c6eac65f96e None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:03.046279 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a66f46-0307-414e-a36e-1c6eac65f96e None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:03.046433 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a66f46-0307-414e-a36e-1c6eac65f96e None admin] PATH_INFO: `/v3/users/a5f8c0071544461582805d558e04aa86` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:03.047660 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a66f46-0307-414e-a36e-1c6eac65f96e None admin] RBAC: Authorizing `identity:get_user(user_id=a5f8c0071544461582805d558e04aa86)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:03.049233 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a66f46-0307-414e-a36e-1c6eac65f96e None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:03.053065 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 168/333] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:42:02 2022] GET /identity/v3/users/a5f8c0071544461582805d558e04aa86 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:03.057908 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298bc5c-4829-4a9e-91b0-6f7b4731474f None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:03.072196 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:03.178443 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298bc5c-4829-4a9e-91b0-6f7b4731474f None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:03.219285 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2167b-9bd4-487e-bb68-d48332b22234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:03.220262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2167b-9bd4-487e-bb68-d48332b22234 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:03.220737 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2167b-9bd4-487e-bb68-d48332b22234 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:03.221222 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2167b-9bd4-487e-bb68-d48332b22234 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:03.222161 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a2167b-9bd4-487e-bb68-d48332b22234 None admin] RBAC: Adding query filter params (role.id=b4593720c06e4a0db655f8e33079a15f, user.id=a5f8c0071544461582805d558e04aa86, scope.system=all) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:03.222662 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a2167b-9bd4-487e-bb68-d48332b22234 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:03.224374 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a2167b-9bd4-487e-bb68-d48332b22234 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:03.238103 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 166/334] 10.222.0.62 () {56 vars in 1308 bytes} [Mon Sep 26 17:42:03 2022] GET /identity/v3/role_assignments?user.id=a5f8c0071544461582805d558e04aa86&scope.system=all&role.id=b4593720c06e4a0db655f8e33079a15f => generated 510 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:42:04.934842 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bc1c1-eb36-4afd-8032-0aec5fae8219 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:04.935867 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bc1c1-eb36-4afd-8032-0aec5fae8219 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:04.936372 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bc1c1-eb36-4afd-8032-0aec5fae8219 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:04.938371 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 169/335] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:04.944229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc1fc4-ba34-4a63-b41f-91d299cc1a59 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:04.945169 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc1fc4-ba34-4a63-b41f-91d299cc1a59 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:04.945644 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc1fc4-ba34-4a63-b41f-91d299cc1a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:04.965723 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-b1fc1fc4-ba34-4a63-b41f-91d299cc1a59 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:04.967230 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-b1fc1fc4-ba34-4a63-b41f-91d299cc1a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:05.038407 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e20702-f8ea-49ed-aa74-4b602e012ac8 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:05.039119 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e20702-f8ea-49ed-aa74-4b602e012ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:05.039609 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e20702-f8ea-49ed-aa74-4b602e012ac8 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:05.041584 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 170/336] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 17:42:05.048520 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885180fe-4c15-4fa6-ac75-b78130604d8b None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:05.049184 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885180fe-4c15-4fa6-ac75-b78130604d8b None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:05.049681 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885180fe-4c15-4fa6-ac75-b78130604d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:05.055249 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:05.068752 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 167/337] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 17:42:05.076630 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-885180fe-4c15-4fa6-ac75-b78130604d8b None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:05.077860 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-885180fe-4c15-4fa6-ac75-b78130604d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:05.093362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:05.160993 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 171/338] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:42:05.653656 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830606b-7a95-4c25-960c-e1ee840dbe12 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:05.653998 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830606b-7a95-4c25-960c-e1ee840dbe12 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:05.654170 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830606b-7a95-4c25-960c-e1ee840dbe12 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:05.656390 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 168/339] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:05.670728 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c3b71-43ac-43b6-a202-3e62add74da5 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:05.671336 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c3b71-43ac-43b6-a202-3e62add74da5 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:05.672990 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830606b-7a95-4c25-960c-e1ee840dbe12 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:05.674337 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c3b71-43ac-43b6-a202-3e62add74da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:05.697945 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-de7c3b71-43ac-43b6-a202-3e62add74da5 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:05.699818 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-de7c3b71-43ac-43b6-a202-3e62add74da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:05.780179 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 172/340] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:42:05.781424 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c3b71-43ac-43b6-a202-3e62add74da5 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:05.865421 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:05.897407 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c3b71-43ac-43b6-a202-3e62add74da5 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:05.938686 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc07abf-2ba8-44fd-8357-df2d2271ad42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:05.940631 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc07abf-2ba8-44fd-8357-df2d2271ad42 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:05.941333 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc07abf-2ba8-44fd-8357-df2d2271ad42 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:05.941804 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc07abf-2ba8-44fd-8357-df2d2271ad42 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:05.952549 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830606b-7a95-4c25-960c-e1ee840dbe12 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:05.954023 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc07abf-2ba8-44fd-8357-df2d2271ad42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:42:05.959375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-ffc07abf-2ba8-44fd-8357-df2d2271ad42 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 17:42:05.959375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:05.959375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:05.959375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:05.959375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:05.959375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:05.959375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:05.959375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:05.959375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:05.959375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:05.959375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:05.959375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:05.959375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:42:05.959375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:42:05.959375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:42:05.959375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:42:05.960285 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:42:05.960285 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:42:05.960285 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:42:05.960285 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:42:05.960285 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:05.960285 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:05.960285 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:05.960285 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:05.960285 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:05.960285 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:05.960285 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:05.960285 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:05.960285 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:05.960285 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:05.960285 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:05.960285 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:05.961631 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:05.961631 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:05.961631 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:05.961631 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:05.961631 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:42:05.961631 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:42:05.961631 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:42:05.961631 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:42:05.961631 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:42:05.961631 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:42:05.961631 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 17:42:05.961631 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:05.964956 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 173/341] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:42:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:05.973309 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc07abf-2ba8-44fd-8357-df2d2271ad42 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:06.025723 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c1d4f-1450-4985-9b24-4308a8cd34dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:06.026475 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c1d4f-1450-4985-9b24-4308a8cd34dc None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:06.026766 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c1d4f-1450-4985-9b24-4308a8cd34dc None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:06.027016 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c1d4f-1450-4985-9b24-4308a8cd34dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:06.050385 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c1d4f-1450-4985-9b24-4308a8cd34dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:42:06.055948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-bd9c1d4f-1450-4985-9b24-4308a8cd34dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 17:42:06.055948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:06.055948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:06.055948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:06.055948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:06.055948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:06.055948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:06.055948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:06.055948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:06.055948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:06.055948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:06.055948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:06.055948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:42:06.055948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:42:06.055948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:42:06.055948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:42:06.056837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:42:06.056837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:42:06.056837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:42:06.056837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:42:06.056837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:06.056837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:06.056837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:06.056837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:06.056837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:06.056837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:06.056837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:06.056837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:06.056837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:06.056837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:06.056837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:06.056837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:06.057668 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:06.057668 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:06.057668 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:06.057668 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:06.057668 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:42:06.057668 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:42:06.057668 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:42:06.057668 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:42:06.057668 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:42:06.057668 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:42:06.057668 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 17:42:06.057668 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:06.057668 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 169/342] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Sep 26 17:42:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:06.073908 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216951e-f74b-4f48-a018-90d9c34ed413 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:06.074213 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216951e-f74b-4f48-a018-90d9c34ed413 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:06.074449 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216951e-f74b-4f48-a018-90d9c34ed413 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:06.076310 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 170/343] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:06.077162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216951e-f74b-4f48-a018-90d9c34ed413 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:06.164541 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:06.172689 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc07abf-2ba8-44fd-8357-df2d2271ad42 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:06.213266 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:06.221964 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1221d4f-7a63-4ec2-8426-93b72b402496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:06.222577 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1221d4f-7a63-4ec2-8426-93b72b402496 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:06.222858 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1221d4f-7a63-4ec2-8426-93b72b402496 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:06.223130 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1221d4f-7a63-4ec2-8426-93b72b402496 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:06.223798 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1221d4f-7a63-4ec2-8426-93b72b402496 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:06.224103 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1221d4f-7a63-4ec2-8426-93b72b402496 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:06.225520 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1221d4f-7a63-4ec2-8426-93b72b402496 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:06.233623 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216951e-f74b-4f48-a018-90d9c34ed413 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:06.235178 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 174/344] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Sep 26 17:42:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:06.236515 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34a91b-b855-451a-9b6f-31310cd9e85d None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:06.236800 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34a91b-b855-451a-9b6f-31310cd9e85d None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:06.241053 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34a91b-b855-451a-9b6f-31310cd9e85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:06.264986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-9a34a91b-b855-451a-9b6f-31310cd9e85d None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:06.266569 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-9a34a91b-b855-451a-9b6f-31310cd9e85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:06.280173 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27145639-f57b-4ca1-966a-422c1c3f14c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:06.280841 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27145639-f57b-4ca1-966a-422c1c3f14c7 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:06.281174 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27145639-f57b-4ca1-966a-422c1c3f14c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:06.281441 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27145639-f57b-4ca1-966a-422c1c3f14c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:06.282155 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27145639-f57b-4ca1-966a-422c1c3f14c7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:06.282452 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27145639-f57b-4ca1-966a-422c1c3f14c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:06.283880 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27145639-f57b-4ca1-966a-422c1c3f14c7 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:06.296471 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 171/345] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:42:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:06.297451 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27145639-f57b-4ca1-966a-422c1c3f14c7 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:06.355319 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 175/346] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:42:06.356247 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34a91b-b855-451a-9b6f-31310cd9e85d None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:06.462074 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27145639-f57b-4ca1-966a-422c1c3f14c7 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:06.499264 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34a91b-b855-451a-9b6f-31310cd9e85d None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:06.509227 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:06.526163 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:06.537492 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2726e-aa4b-4302-8902-5f4e685d32de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:06.538501 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2726e-aa4b-4302-8902-5f4e685d32de None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:06.538787 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2726e-aa4b-4302-8902-5f4e685d32de None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:06.539728 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2726e-aa4b-4302-8902-5f4e685d32de None admin] PATH_INFO: `/v3/users/d137f5984bce4e159aa4d54a80113c2d` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:06.540864 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2726e-aa4b-4302-8902-5f4e685d32de None admin] RBAC: Authorizing `identity:get_user(user_id=d137f5984bce4e159aa4d54a80113c2d)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:06.542349 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2726e-aa4b-4302-8902-5f4e685d32de None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:06.544219 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 176/347] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:42:06 2022] GET /identity/v3/users/d137f5984bce4e159aa4d54a80113c2d => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:06.545153 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2726e-aa4b-4302-8902-5f4e685d32de None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:06.562777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b77275-12db-4947-87bd-1080346b5492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:06.563444 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b77275-12db-4947-87bd-1080346b5492 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:06.563749 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b77275-12db-4947-87bd-1080346b5492 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:06.563988 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b77275-12db-4947-87bd-1080346b5492 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:06.602609 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b77275-12db-4947-87bd-1080346b5492 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:42:06.608025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-55b77275-12db-4947-87bd-1080346b5492 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 17:42:06.608025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:06.608025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:06.608025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:06.608025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:06.608025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:06.608025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:06.608025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:06.608025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:06.608025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:06.608025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:06.608025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:06.608025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:42:06.608025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:42:06.608025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:42:06.608025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:42:06.609048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:42:06.609048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:42:06.609048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:42:06.609048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:42:06.609048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:06.609048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:06.609048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:06.609048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:06.609048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:06.609048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:06.609048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:06.609048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:06.609048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:06.609048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:06.609048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:06.609048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:06.609892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:06.609892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:06.609892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:06.609892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:06.609892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:42:06.609892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:42:06.609892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:42:06.609892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:42:06.609892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:42:06.609892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:42:06.609892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 17:42:06.609892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:06.617270 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 172/348] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:42:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:06.618246 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b77275-12db-4947-87bd-1080346b5492 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:06.660747 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2726e-aa4b-4302-8902-5f4e685d32de None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:06.698690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea5279-8857-4cff-bf20-2f12d71844e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:06.699771 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea5279-8857-4cff-bf20-2f12d71844e6 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:06.700110 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea5279-8857-4cff-bf20-2f12d71844e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:06.700387 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea5279-8857-4cff-bf20-2f12d71844e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:06.766416 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:06.776626 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea5279-8857-4cff-bf20-2f12d71844e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:06.778827 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea5279-8857-4cff-bf20-2f12d71844e6 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:06.786256 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b77275-12db-4947-87bd-1080346b5492 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:06.828986 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec42e4-12ad-4af2-8ffd-85f0c5e985f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:06.829686 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec42e4-12ad-4af2-8ffd-85f0c5e985f6 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:06.829968 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec42e4-12ad-4af2-8ffd-85f0c5e985f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:06.830243 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec42e4-12ad-4af2-8ffd-85f0c5e985f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:06.831358 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec42e4-12ad-4af2-8ffd-85f0c5e985f6 None admin] RBAC: Adding query filter params (role.id=def729f162f44f65b2e2bf261dde9b39, user.id=d137f5984bce4e159aa4d54a80113c2d, scope.system=all) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:06.831672 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec42e4-12ad-4af2-8ffd-85f0c5e985f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:06.833697 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec42e4-12ad-4af2-8ffd-85f0c5e985f6 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:06.847563 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 173/349] 10.222.0.62 () {56 vars in 1308 bytes} [Mon Sep 26 17:42:06 2022] GET /identity/v3/role_assignments?user.id=d137f5984bce4e159aa4d54a80113c2d&scope.system=all&role.id=def729f162f44f65b2e2bf261dde9b39 => generated 510 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:06.848795 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec42e4-12ad-4af2-8ffd-85f0c5e985f6 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:06.913428 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:06.925109 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 177/350] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:42:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 17:42:06.926746 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37917670-e199-4353-9907-f97380f73e69 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:06.927352 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37917670-e199-4353-9907-f97380f73e69 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:06.927642 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37917670-e199-4353-9907-f97380f73e69 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:06.928899 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 178/351] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:06.929794 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37917670-e199-4353-9907-f97380f73e69 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:06.998990 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec42e4-12ad-4af2-8ffd-85f0c5e985f6 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:07.046123 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd3116-73f0-411a-9d16-c5f5da1ce272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:07.046977 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd3116-73f0-411a-9d16-c5f5da1ce272 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:07.047288 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd3116-73f0-411a-9d16-c5f5da1ce272 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:07.048150 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd3116-73f0-411a-9d16-c5f5da1ce272 None admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:07.049133 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd3116-73f0-411a-9d16-c5f5da1ce272 None admin] RBAC: Adding query filter params (name=member) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:07.049448 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd3116-73f0-411a-9d16-c5f5da1ce272 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:07.051730 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd3116-73f0-411a-9d16-c5f5da1ce272 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:07.059590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:07.063668 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 174/352] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Sep 26 17:42:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:07.064529 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd3116-73f0-411a-9d16-c5f5da1ce272 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:07.080202 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37917670-e199-4353-9907-f97380f73e69 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:07.124882 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fda30a-b6b6-41f8-8bcc-9cb11e1733d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:07.125717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fda30a-b6b6-41f8-8bcc-9cb11e1733d3 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:07.126001 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fda30a-b6b6-41f8-8bcc-9cb11e1733d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:07.126541 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fda30a-b6b6-41f8-8bcc-9cb11e1733d3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:07.140759 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fda30a-b6b6-41f8-8bcc-9cb11e1733d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:42:07.146409 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-b2fda30a-b6b6-41f8-8bcc-9cb11e1733d3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 17:42:07.146409 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:07.146409 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:07.146409 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:07.146409 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:07.146409 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:07.146409 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:07.146409 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:07.146409 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:07.146409 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:07.146409 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:07.146409 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:07.146409 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:42:07.146409 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:42:07.146409 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:42:07.146409 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:42:07.147364 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:42:07.147364 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:42:07.147364 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:42:07.147364 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:42:07.147364 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:07.147364 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:07.147364 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:07.147364 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:07.147364 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:07.147364 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:07.147364 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:07.147364 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:07.147364 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:07.147364 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:07.147364 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:07.147364 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:07.148220 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:07.148220 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:07.148220 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:07.148220 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:07.148220 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:42:07.148220 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:42:07.148220 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:42:07.148220 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:42:07.148220 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:42:07.148220 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:42:07.148220 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 17:42:07.148220 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:07.148990 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 179/353] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:42:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:07.150503 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc71342-b797-4eca-9177-438f82845e3a None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:07.150781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc71342-b797-4eca-9177-438f82845e3a None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:07.151049 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc71342-b797-4eca-9177-438f82845e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:07.174322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-adc71342-b797-4eca-9177-438f82845e3a None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:07.175532 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-adc71342-b797-4eca-9177-438f82845e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:07.185319 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:07.192345 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd3116-73f0-411a-9d16-c5f5da1ce272 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:07.240849 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c2b43d-6682-4d3e-9cdb-b178a6b2a622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:07.241535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2b43d-6682-4d3e-9cdb-b178a6b2a622 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:07.241812 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2b43d-6682-4d3e-9cdb-b178a6b2a622 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:07.242662 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2b43d-6682-4d3e-9cdb-b178a6b2a622 None admin] PATH_INFO: `/v3/projects/00fef40581d54f69b20ec6565c3cf274` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:07.244300 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c2b43d-6682-4d3e-9cdb-b178a6b2a622 None admin] RBAC: Authorizing `identity:get_project(project_id=00fef40581d54f69b20ec6565c3cf274)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:07.245806 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c2b43d-6682-4d3e-9cdb-b178a6b2a622 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:07.247440 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 175/354] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:42:07 2022] GET /identity/v3/projects/00fef40581d54f69b20ec6565c3cf274 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:07.248290 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c2b43d-6682-4d3e-9cdb-b178a6b2a622 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:07.267995 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 180/355] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:42:07.273064 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc71342-b797-4eca-9177-438f82845e3a None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:07.377327 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c2b43d-6682-4d3e-9cdb-b178a6b2a622 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:07.386016 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:07.419825 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc71342-b797-4eca-9177-438f82845e3a None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:07.433893 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1e72e-8091-4613-bc33-7c994a610c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:07.434537 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1e72e-8091-4613-bc33-7c994a610c7e None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:07.434791 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1e72e-8091-4613-bc33-7c994a610c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:07.435063 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1e72e-8091-4613-bc33-7c994a610c7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:07.467133 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949065df-8317-4259-b691-894e293a5209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:07.467783 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949065df-8317-4259-b691-894e293a5209 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:07.468063 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949065df-8317-4259-b691-894e293a5209 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:07.468333 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949065df-8317-4259-b691-894e293a5209 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:07.468996 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949065df-8317-4259-b691-894e293a5209 None admin] RBAC: Adding query filter params (name=member) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:07.469932 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949065df-8317-4259-b691-894e293a5209 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:07.471262 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949065df-8317-4259-b691-894e293a5209 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:07.474955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:07.487176 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 181/356] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Sep 26 17:42:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:07.487884 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949065df-8317-4259-b691-894e293a5209 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:07.523851 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1e72e-8091-4613-bc33-7c994a610c7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:07.525469 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1e72e-8091-4613-bc33-7c994a610c7e None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:07.617338 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949065df-8317-4259-b691-894e293a5209 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:07.649177 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 176/357] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:42:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 17:42:07.654402 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51b495-bb9d-4907-b3a3-9ba2856537fa None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:07.654677 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51b495-bb9d-4907-b3a3-9ba2856537fa None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:07.654948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51b495-bb9d-4907-b3a3-9ba2856537fa None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:07.656361 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 177/358] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:07.656940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51b495-bb9d-4907-b3a3-9ba2856537fa None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:07.657102 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd36b66-d1c5-4d51-86d1-6a017fa61172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:07.658223 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd36b66-d1c5-4d51-86d1-6a017fa61172 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:07.658223 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd36b66-d1c5-4d51-86d1-6a017fa61172 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:07.658416 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd36b66-d1c5-4d51-86d1-6a017fa61172 None admin] PATH_INFO: `/v3/groups/58f1d106059548fc8d9d7615cfeef933` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:07.666165 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd36b66-d1c5-4d51-86d1-6a017fa61172 None admin] RBAC: Authorizing `identity:get_group(group_id=58f1d106059548fc8d9d7615cfeef933)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:07.667444 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd36b66-d1c5-4d51-86d1-6a017fa61172 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:07.669996 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 182/359] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Sep 26 17:42:07 2022] GET /identity/v3/groups/58f1d106059548fc8d9d7615cfeef933 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:07.669996 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd36b66-d1c5-4d51-86d1-6a017fa61172 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:07.681740 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:07.740637 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:07.781224 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51b495-bb9d-4907-b3a3-9ba2856537fa None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:07.789232 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd36b66-d1c5-4d51-86d1-6a017fa61172 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:07.821958 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5051e1-2b79-477d-beff-f7e7764b94d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:07.822809 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5051e1-2b79-477d-beff-f7e7764b94d0 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:07.823253 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5051e1-2b79-477d-beff-f7e7764b94d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:07.823691 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5051e1-2b79-477d-beff-f7e7764b94d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:07.831950 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e4178-f2dc-4a8b-b7e4-b6755e4e3492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:07.832591 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e4178-f2dc-4a8b-b7e4-b6755e4e3492 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:07.832872 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e4178-f2dc-4a8b-b7e4-b6755e4e3492 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:07.833946 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e4178-f2dc-4a8b-b7e4-b6755e4e3492 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:07.846254 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e4178-f2dc-4a8b-b7e4-b6755e4e3492 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:42:07.852316 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-ad9e4178-f2dc-4a8b-b7e4-b6755e4e3492 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 17:42:07.852316 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:07.852316 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:07.852316 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:07.852316 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:07.852316 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:07.852316 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:07.852316 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:07.852316 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:07.852316 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:07.852316 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:07.852316 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:07.852316 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:42:07.852316 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:42:07.852316 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:42:07.852316 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:42:07.853225 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:42:07.853225 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:42:07.853225 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:42:07.853225 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:42:07.853225 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:07.853225 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:07.853225 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:07.853225 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:07.853225 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:07.853225 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:07.853225 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:07.853225 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:07.853225 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:07.853225 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:07.853225 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:07.853225 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:07.854006 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:07.854006 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:07.854006 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:07.854006 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:07.854006 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:42:07.854006 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:42:07.854006 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:42:07.854006 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:42:07.854006 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:42:07.854006 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:42:07.854006 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 17:42:07.854006 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:07.854006 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 183/360] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Sep 26 17:42:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:07.857486 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e4178-f2dc-4a8b-b7e4-b6755e4e3492 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:07.907241 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5051e1-2b79-477d-beff-f7e7764b94d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:07.908656 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5051e1-2b79-477d-beff-f7e7764b94d0 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:07.937814 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:07.977997 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e4178-f2dc-4a8b-b7e4-b6755e4e3492 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:07.990847 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:08.015693 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebfa394-4c58-4447-abb9-746fa1c35384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:08.016342 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfa394-4c58-4447-abb9-746fa1c35384 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:08.016623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfa394-4c58-4447-abb9-746fa1c35384 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:08.017715 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfa394-4c58-4447-abb9-746fa1c35384 None admin] PATH_INFO: `/v3/projects/00fef40581d54f69b20ec6565c3cf274` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:08.018098 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebfa394-4c58-4447-abb9-746fa1c35384 None admin] RBAC: Authorizing `identity:get_project(project_id=00fef40581d54f69b20ec6565c3cf274)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:08.019563 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebfa394-4c58-4447-abb9-746fa1c35384 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:08.021409 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 184/361] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:42:07 2022] GET /identity/v3/projects/00fef40581d54f69b20ec6565c3cf274 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:08.022398 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729855b3-85f3-46a3-81e3-d15793be586c None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:08.022682 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729855b3-85f3-46a3-81e3-d15793be586c None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:08.023025 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729855b3-85f3-46a3-81e3-d15793be586c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:08.036642 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 178/362] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:42:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 17:42:08.040218 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5051e1-2b79-477d-beff-f7e7764b94d0 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:08.051142 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-729855b3-85f3-46a3-81e3-d15793be586c None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:08.052342 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-729855b3-85f3-46a3-81e3-d15793be586c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:08.128202 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 185/363] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:42:08.128884 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729855b3-85f3-46a3-81e3-d15793be586c None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:08.151204 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5051e1-2b79-477d-beff-f7e7764b94d0 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:08.199234 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86a7b9-f971-4229-93b6-1f916bc658c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:08.201192 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86a7b9-f971-4229-93b6-1f916bc658c6 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:08.201481 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86a7b9-f971-4229-93b6-1f916bc658c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:08.201778 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86a7b9-f971-4229-93b6-1f916bc658c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:08.202545 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86a7b9-f971-4229-93b6-1f916bc658c6 None admin] RBAC: Adding query filter params (group.id=58f1d106059548fc8d9d7615cfeef933, role.id=1d93df17fd9a4d92b8c9966cc9deacde, scope.project.id=00fef40581d54f69b20ec6565c3cf274) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:08.202810 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86a7b9-f971-4229-93b6-1f916bc658c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:08.204302 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86a7b9-f971-4229-93b6-1f916bc658c6 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:08.211866 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 179/364] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Sep 26 17:42:08 2022] GET /identity/v3/role_assignments?group.id=58f1d106059548fc8d9d7615cfeef933&scope.project.id=00fef40581d54f69b20ec6565c3cf274&role.id=1d93df17fd9a4d92b8c9966cc9deacde => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:08.216047 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86a7b9-f971-4229-93b6-1f916bc658c6 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:08.217390 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:08.255503 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729855b3-85f3-46a3-81e3-d15793be586c None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:08.258167 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:08.299212 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786ec87-4996-4dc4-8ed5-fe50fd6bc6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:08.300252 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786ec87-4996-4dc4-8ed5-fe50fd6bc6ab None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:08.300733 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786ec87-4996-4dc4-8ed5-fe50fd6bc6ab None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:08.301267 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786ec87-4996-4dc4-8ed5-fe50fd6bc6ab None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:08.302176 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786ec87-4996-4dc4-8ed5-fe50fd6bc6ab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:08.302699 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786ec87-4996-4dc4-8ed5-fe50fd6bc6ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:08.305937 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786ec87-4996-4dc4-8ed5-fe50fd6bc6ab None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:08.316370 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 186/365] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:42:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:08.317728 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786ec87-4996-4dc4-8ed5-fe50fd6bc6ab None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:08.368099 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86a7b9-f971-4229-93b6-1f916bc658c6 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:08.423206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6b383-bfee-4356-845f-97291ba9a53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:08.423861 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6b383-bfee-4356-845f-97291ba9a53a None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:08.424141 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6b383-bfee-4356-845f-97291ba9a53a None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:08.424412 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6b383-bfee-4356-845f-97291ba9a53a None admin] PATH_INFO: `/v3/groups/58f1d106059548fc8d9d7615cfeef933` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:08.426396 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6b383-bfee-4356-845f-97291ba9a53a None admin] RBAC: Authorizing `identity:get_group(group_id=58f1d106059548fc8d9d7615cfeef933)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:08.428446 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6b383-bfee-4356-845f-97291ba9a53a None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:08.431298 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 180/366] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Sep 26 17:42:08 2022] GET /identity/v3/groups/58f1d106059548fc8d9d7615cfeef933 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:08.431995 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6b383-bfee-4356-845f-97291ba9a53a None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:08.464777 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786ec87-4996-4dc4-8ed5-fe50fd6bc6ab None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:08.498773 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:08.511688 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899f1fd-0b86-480b-ac33-2badc4af8b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:08.512622 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899f1fd-0b86-480b-ac33-2badc4af8b65 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:08.512904 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899f1fd-0b86-480b-ac33-2badc4af8b65 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:08.513237 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899f1fd-0b86-480b-ac33-2badc4af8b65 None admin] PATH_INFO: `/v3/projects/5f86051201ae444796f8bf9e49c1b888` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:08.514412 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899f1fd-0b86-480b-ac33-2badc4af8b65 None admin] RBAC: Authorizing `identity:get_project(project_id=5f86051201ae444796f8bf9e49c1b888)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:08.515860 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899f1fd-0b86-480b-ac33-2badc4af8b65 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:08.518619 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 187/367] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:42:08 2022] GET /identity/v3/projects/5f86051201ae444796f8bf9e49c1b888 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:08.519413 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899f1fd-0b86-480b-ac33-2badc4af8b65 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:08.563183 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:08.567147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6b383-bfee-4356-845f-97291ba9a53a None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:08.612177 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b6f4a-7885-418b-8c0e-9a98605da78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:08.612792 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b6f4a-7885-418b-8c0e-9a98605da78a None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:08.613106 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b6f4a-7885-418b-8c0e-9a98605da78a None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:08.613380 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b6f4a-7885-418b-8c0e-9a98605da78a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:08.649684 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899f1fd-0b86-480b-ac33-2badc4af8b65 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:08.694112 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2c770-e7a4-46c0-8116-cb623ad9b887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:08.694744 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2c770-e7a4-46c0-8116-cb623ad9b887 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:08.695020 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2c770-e7a4-46c0-8116-cb623ad9b887 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:08.696623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2c770-e7a4-46c0-8116-cb623ad9b887 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:08.700134 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b6f4a-7885-418b-8c0e-9a98605da78a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:08.701911 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b6f4a-7885-418b-8c0e-9a98605da78a None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:08.712855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece2c770-e7a4-46c0-8116-cb623ad9b887 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:42:08.720255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-ece2c770-e7a4-46c0-8116-cb623ad9b887 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:42:08.720255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:08.720255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:08.720255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:08.720255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:08.720255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:08.720255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:08.720255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:08.720255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:08.720255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:08.720255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:08.720255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:08.720255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:42:08.720255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:42:08.720255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:42:08.720255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:42:08.721268 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:42:08.721268 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:42:08.721268 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:42:08.721268 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:42:08.721268 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:08.721268 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:08.721268 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:08.721268 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:08.721268 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:08.721268 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:08.721268 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:08.721268 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:08.721268 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:08.721268 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:08.721268 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:08.721268 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:08.722476 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:08.722476 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:08.722476 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:08.722476 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:08.722476 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:42:08.722476 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:42:08.722476 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:42:08.722476 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:42:08.722476 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:42:08.722476 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:42:08.722476 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:42:08.722476 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:08.722476 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 188/368] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Sep 26 17:42:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:08.722476 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2c770-e7a4-46c0-8116-cb623ad9b887 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:08.795301 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:08.832844 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:08.837555 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 181/369] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:42:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 17:42:08.838224 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b6f4a-7885-418b-8c0e-9a98605da78a None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:08.868572 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2c770-e7a4-46c0-8116-cb623ad9b887 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:08.915194 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe280b6-75b3-43e0-83db-cd5a055039c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:08.915518 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe280b6-75b3-43e0-83db-cd5a055039c5 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:08.915698 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe280b6-75b3-43e0-83db-cd5a055039c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:08.915977 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe280b6-75b3-43e0-83db-cd5a055039c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:08.916716 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe280b6-75b3-43e0-83db-cd5a055039c5 None admin] RBAC: Adding query filter params (group.id=58f1d106059548fc8d9d7615cfeef933, role.id=b4593720c06e4a0db655f8e33079a15f, scope.project.id=00fef40581d54f69b20ec6565c3cf274) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:08.917080 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe280b6-75b3-43e0-83db-cd5a055039c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:08.918517 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe280b6-75b3-43e0-83db-cd5a055039c5 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:08.929043 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 189/370] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Sep 26 17:42:08 2022] GET /identity/v3/role_assignments?group.id=58f1d106059548fc8d9d7615cfeef933&scope.project.id=00fef40581d54f69b20ec6565c3cf274&role.id=b4593720c06e4a0db655f8e33079a15f => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:08.929043 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe280b6-75b3-43e0-83db-cd5a055039c5 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:08.988834 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b6f4a-7885-418b-8c0e-9a98605da78a None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:09.030989 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4073b-dbeb-4bc9-8517-b1569ae0969b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:09.031690 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4073b-dbeb-4bc9-8517-b1569ae0969b None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:09.032026 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4073b-dbeb-4bc9-8517-b1569ae0969b None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:09.032306 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4073b-dbeb-4bc9-8517-b1569ae0969b None admin] PATH_INFO: `/v3/groups/58f1d106059548fc8d9d7615cfeef933` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:09.033504 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec4073b-dbeb-4bc9-8517-b1569ae0969b None admin] RBAC: Authorizing `identity:get_group(group_id=58f1d106059548fc8d9d7615cfeef933)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:09.034983 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec4073b-dbeb-4bc9-8517-b1569ae0969b None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:09.037126 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 182/371] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Sep 26 17:42:08 2022] GET /identity/v3/groups/58f1d106059548fc8d9d7615cfeef933 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:09.038071 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4073b-dbeb-4bc9-8517-b1569ae0969b None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:09.068458 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe280b6-75b3-43e0-83db-cd5a055039c5 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:09.094294 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:09.123137 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc3f29-0932-414b-a7f6-1a7123b152e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:09.124143 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc3f29-0932-414b-a7f6-1a7123b152e4 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:09.124657 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc3f29-0932-414b-a7f6-1a7123b152e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:09.125160 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc3f29-0932-414b-a7f6-1a7123b152e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:09.126164 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc3f29-0932-414b-a7f6-1a7123b152e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:09.126683 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc3f29-0932-414b-a7f6-1a7123b152e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:09.127472 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:09.129557 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc3f29-0932-414b-a7f6-1a7123b152e4 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:09.141664 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 190/372] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:42:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:09.144048 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc3f29-0932-414b-a7f6-1a7123b152e4 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:09.169172 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4073b-dbeb-4bc9-8517-b1569ae0969b None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:09.211729 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e396e-a8e4-4ac4-bd84-1b800e6d92cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:09.212383 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e396e-a8e4-4ac4-bd84-1b800e6d92cf None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:09.212661 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e396e-a8e4-4ac4-bd84-1b800e6d92cf None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:09.212933 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e396e-a8e4-4ac4-bd84-1b800e6d92cf None admin] PATH_INFO: `/v3/projects/5f86051201ae444796f8bf9e49c1b888` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:09.216080 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e396e-a8e4-4ac4-bd84-1b800e6d92cf None admin] RBAC: Authorizing `identity:get_project(project_id=5f86051201ae444796f8bf9e49c1b888)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:09.217632 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e396e-a8e4-4ac4-bd84-1b800e6d92cf None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:09.219557 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 183/373] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:42:09 2022] GET /identity/v3/projects/5f86051201ae444796f8bf9e49c1b888 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:09.222917 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e396e-a8e4-4ac4-bd84-1b800e6d92cf None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:09.268716 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc3f29-0932-414b-a7f6-1a7123b152e4 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:09.310982 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd791e-356f-4f16-94ff-d415aff6c7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:09.312401 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd791e-356f-4f16-94ff-d415aff6c7d3 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:09.312907 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd791e-356f-4f16-94ff-d415aff6c7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:09.313410 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd791e-356f-4f16-94ff-d415aff6c7d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:09.314718 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd791e-356f-4f16-94ff-d415aff6c7d3 None admin] RBAC: Adding query filter params (group.id=58f1d106059548fc8d9d7615cfeef933, role.id=b4593720c06e4a0db655f8e33079a15f, scope.project.id=5f86051201ae444796f8bf9e49c1b888) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:09.315247 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd791e-356f-4f16-94ff-d415aff6c7d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:09.317537 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd791e-356f-4f16-94ff-d415aff6c7d3 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:09.324462 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 191/374] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Sep 26 17:42:09 2022] GET /identity/v3/role_assignments?group.id=58f1d106059548fc8d9d7615cfeef933&scope.project.id=5f86051201ae444796f8bf9e49c1b888&role.id=b4593720c06e4a0db655f8e33079a15f => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:09.329739 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd791e-356f-4f16-94ff-d415aff6c7d3 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:09.356554 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e396e-a8e4-4ac4-bd84-1b800e6d92cf None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:09.411165 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:09.461929 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a3bef-dd1d-4dfa-b3ee-5018b854d267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:09.462567 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a3bef-dd1d-4dfa-b3ee-5018b854d267 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:09.462853 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a3bef-dd1d-4dfa-b3ee-5018b854d267 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:09.463130 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a3bef-dd1d-4dfa-b3ee-5018b854d267 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:09.475164 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:09.480788 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd791e-356f-4f16-94ff-d415aff6c7d3 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:09.530721 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28bac5-e63b-46ea-b32d-1f9fc653b377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:09.531786 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28bac5-e63b-46ea-b32d-1f9fc653b377 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:09.532261 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28bac5-e63b-46ea-b32d-1f9fc653b377 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:09.532700 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28bac5-e63b-46ea-b32d-1f9fc653b377 None admin] PATH_INFO: `/v3/groups/58f1d106059548fc8d9d7615cfeef933` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:09.534150 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28bac5-e63b-46ea-b32d-1f9fc653b377 None admin] RBAC: Authorizing `identity:get_group(group_id=58f1d106059548fc8d9d7615cfeef933)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:09.536097 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28bac5-e63b-46ea-b32d-1f9fc653b377 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:09.539023 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 192/375] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Sep 26 17:42:09 2022] GET /identity/v3/groups/58f1d106059548fc8d9d7615cfeef933 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:09.546641 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28bac5-e63b-46ea-b32d-1f9fc653b377 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:09.617604 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2a3bef-dd1d-4dfa-b3ee-5018b854d267 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:09.620822 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2a3bef-dd1d-4dfa-b3ee-5018b854d267 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:09.700706 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28bac5-e63b-46ea-b32d-1f9fc653b377 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:09.728653 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:09.740449 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 184/376] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:42:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 17:42:09.747374 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a3bef-dd1d-4dfa-b3ee-5018b854d267 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:09.771193 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bf2b6-9cf3-4691-b057-6e9ec39bf3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:09.771805 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bf2b6-9cf3-4691-b057-6e9ec39bf3e2 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:09.772079 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bf2b6-9cf3-4691-b057-6e9ec39bf3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:09.772345 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bf2b6-9cf3-4691-b057-6e9ec39bf3e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:09.773094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8bf2b6-9cf3-4691-b057-6e9ec39bf3e2 None admin] RBAC: Adding query filter params (group.id=58f1d106059548fc8d9d7615cfeef933, role.id=1d93df17fd9a4d92b8c9966cc9deacde, scope.project.id=5f86051201ae444796f8bf9e49c1b888) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:09.773475 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8bf2b6-9cf3-4691-b057-6e9ec39bf3e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:09.774901 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8bf2b6-9cf3-4691-b057-6e9ec39bf3e2 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:09.782763 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 193/377] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Sep 26 17:42:09 2022] GET /identity/v3/role_assignments?group.id=58f1d106059548fc8d9d7615cfeef933&scope.project.id=5f86051201ae444796f8bf9e49c1b888&role.id=1d93df17fd9a4d92b8c9966cc9deacde => generated 260 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:42:09.818455 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:09.907416 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a3bef-dd1d-4dfa-b3ee-5018b854d267 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:09.959324 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0237d-40ff-4bda-8e84-f7fad4b81fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:09.960338 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0237d-40ff-4bda-8e84-f7fad4b81fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:09.960905 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0237d-40ff-4bda-8e84-f7fad4b81fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:09.961422 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0237d-40ff-4bda-8e84-f7fad4b81fc5 None admin] PATH_INFO: `/v3/projects/068ad96e90d940c6a9455251dbef5ca0` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:09.963046 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0237d-40ff-4bda-8e84-f7fad4b81fc5 None admin] RBAC: Authorizing `identity:get_project(project_id=068ad96e90d940c6a9455251dbef5ca0)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:09.964732 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0237d-40ff-4bda-8e84-f7fad4b81fc5 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:09.966649 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 185/378] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:42:09 2022] GET /identity/v3/projects/068ad96e90d940c6a9455251dbef5ca0 => generated 344 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:09.972435 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bf2b6-9cf3-4691-b057-6e9ec39bf3e2 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:10.104619 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bf2b6-9cf3-4691-b057-6e9ec39bf3e2 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:10.151454 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e390dc-c8ac-4e25-97c0-b308658305c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:10.152214 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e390dc-c8ac-4e25-97c0-b308658305c1 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:10.152429 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e390dc-c8ac-4e25-97c0-b308658305c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:10.152720 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e390dc-c8ac-4e25-97c0-b308658305c1 None admin] PATH_INFO: `/v3/groups/1fc182f48836474caf10f7fb6e653863` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:10.159838 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e390dc-c8ac-4e25-97c0-b308658305c1 None admin] RBAC: Authorizing `identity:get_group(group_id=1fc182f48836474caf10f7fb6e653863)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:10.161842 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e390dc-c8ac-4e25-97c0-b308658305c1 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:10.164238 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 194/379] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Sep 26 17:42:09 2022] GET /identity/v3/groups/1fc182f48836474caf10f7fb6e653863 => generated 229 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:10.170129 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0237d-40ff-4bda-8e84-f7fad4b81fc5 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:10.315304 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0237d-40ff-4bda-8e84-f7fad4b81fc5 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:10.318153 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:10.359676 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d9c327-0c71-47d0-aac3-54dbaca3bdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:10.360201 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9c327-0c71-47d0-aac3-54dbaca3bdbf None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:10.360480 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9c327-0c71-47d0-aac3-54dbaca3bdbf None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:10.360807 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9c327-0c71-47d0-aac3-54dbaca3bdbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:10.361572 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d9c327-0c71-47d0-aac3-54dbaca3bdbf None admin] RBAC: Adding query filter params (group.id=1fc182f48836474caf10f7fb6e653863, role.id=be6ee971abf54b26be509c14823ece55, scope.project.id=068ad96e90d940c6a9455251dbef5ca0) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:10.361931 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d9c327-0c71-47d0-aac3-54dbaca3bdbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:10.363372 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d9c327-0c71-47d0-aac3-54dbaca3bdbf None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:10.373231 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 186/380] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Sep 26 17:42:10 2022] GET /identity/v3/role_assignments?group.id=1fc182f48836474caf10f7fb6e653863&scope.project.id=068ad96e90d940c6a9455251dbef5ca0&role.id=be6ee971abf54b26be509c14823ece55 => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:10.833477 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71120bd6-203b-4f96-8df8-eee6b8548446 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:10.834163 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71120bd6-203b-4f96-8df8-eee6b8548446 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:10.834631 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71120bd6-203b-4f96-8df8-eee6b8548446 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:10.837187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 195/381] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:10.842843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a8c80-6f86-4455-a8f5-52d3b5b59f8a None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:10.843367 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a8c80-6f86-4455-a8f5-52d3b5b59f8a None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:10.843849 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a8c80-6f86-4455-a8f5-52d3b5b59f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:10.862487 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-b06a8c80-6f86-4455-a8f5-52d3b5b59f8a None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:10.863986 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-b06a8c80-6f86-4455-a8f5-52d3b5b59f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:10.959069 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 187/382] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:42:11.502480 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71120bd6-203b-4f96-8df8-eee6b8548446 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:11.507153 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798f7f1-3797-41f2-ab77-3bdaa24e82b6 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:11.508084 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798f7f1-3797-41f2-ab77-3bdaa24e82b6 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:11.509203 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798f7f1-3797-41f2-ab77-3bdaa24e82b6 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:11.509901 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 188/383] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:11.515003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51d7f2-3439-4bf1-a225-fb17f99629d8 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:11.515293 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51d7f2-3439-4bf1-a225-fb17f99629d8 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:11.515567 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51d7f2-3439-4bf1-a225-fb17f99629d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:11.533962 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-be51d7f2-3439-4bf1-a225-fb17f99629d8 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:11.535248 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-be51d7f2-3439-4bf1-a225-fb17f99629d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:11.563313 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:11.612085 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 189/384] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 17:42:11.629612 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71120bd6-203b-4f96-8df8-eee6b8548446 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:11.667799 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992c961-eeb6-4391-a827-b248eb99e67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:11.668781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992c961-eeb6-4391-a827-b248eb99e67b None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:11.669307 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992c961-eeb6-4391-a827-b248eb99e67b None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:11.669695 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992c961-eeb6-4391-a827-b248eb99e67b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:11.682762 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992c961-eeb6-4391-a827-b248eb99e67b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:42:11.689647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-9992c961-eeb6-4391-a827-b248eb99e67b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 17:42:11.689647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:11.689647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:11.689647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:11.689647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:11.689647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:11.689647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:11.689647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:11.689647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:11.689647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:11.689647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:11.689647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:11.689647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:42:11.689647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:42:11.689647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:42:11.689647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:42:11.690603 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:42:11.690603 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:42:11.690603 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:42:11.690603 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:42:11.690603 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:11.690603 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:11.690603 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:11.690603 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:11.690603 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:11.690603 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:11.690603 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:11.690603 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:11.690603 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:11.690603 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:11.690603 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:11.690603 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:11.691400 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:11.691400 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:11.691400 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:11.691400 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:11.691400 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:42:11.691400 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:42:11.691400 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:42:11.691400 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:42:11.691400 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:42:11.691400 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:42:11.691400 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 17:42:11.691400 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:11.691400 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 196/385] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Sep 26 17:42:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:11.698699 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51d7f2-3439-4bf1-a225-fb17f99629d8 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:11.730054 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:11.813625 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51d7f2-3439-4bf1-a225-fb17f99629d8 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:11.865929 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51208bed-7f0a-47b8-aa96-e87b701f85c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:11.866571 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51208bed-7f0a-47b8-aa96-e87b701f85c8 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:11.866844 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51208bed-7f0a-47b8-aa96-e87b701f85c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:11.867154 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51208bed-7f0a-47b8-aa96-e87b701f85c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:11.867863 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51208bed-7f0a-47b8-aa96-e87b701f85c8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:11.868163 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51208bed-7f0a-47b8-aa96-e87b701f85c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:11.870040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51208bed-7f0a-47b8-aa96-e87b701f85c8 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:11.880301 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 190/386] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:42:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:11.886088 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992c961-eeb6-4391-a827-b248eb99e67b None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:11.987241 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51208bed-7f0a-47b8-aa96-e87b701f85c8 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:12.020392 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992c961-eeb6-4391-a827-b248eb99e67b None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:12.022736 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:12.072668 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7de8ff-a0dd-412f-b954-585ae26dc125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:12.073347 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7de8ff-a0dd-412f-b954-585ae26dc125 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:12.073623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7de8ff-a0dd-412f-b954-585ae26dc125 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:12.073892 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7de8ff-a0dd-412f-b954-585ae26dc125 None admin] PATH_INFO: `/v3/groups/58f1d106059548fc8d9d7615cfeef933` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:12.075037 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7de8ff-a0dd-412f-b954-585ae26dc125 None admin] RBAC: Authorizing `identity:get_group(group_id=58f1d106059548fc8d9d7615cfeef933)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:12.076826 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7de8ff-a0dd-412f-b954-585ae26dc125 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:12.083323 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 197/387] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Sep 26 17:42:11 2022] GET /identity/v3/groups/58f1d106059548fc8d9d7615cfeef933 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:12.083323 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9367575-713c-4b78-ac12-9e0839e2726a None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:12.083323 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9367575-713c-4b78-ac12-9e0839e2726a None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:12.083323 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9367575-713c-4b78-ac12-9e0839e2726a None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:12.083323 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 198/388] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:12.086489 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9367575-713c-4b78-ac12-9e0839e2726a None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:12.137840 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:12.153391 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51208bed-7f0a-47b8-aa96-e87b701f85c8 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:12.193950 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5d44c-1959-47dd-b932-f82738c2fc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:12.194578 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5d44c-1959-47dd-b932-f82738c2fc61 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:12.194850 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5d44c-1959-47dd-b932-f82738c2fc61 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:12.195616 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5d44c-1959-47dd-b932-f82738c2fc61 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:12.208386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb5d44c-1959-47dd-b932-f82738c2fc61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:42:12.215045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-ffb5d44c-1959-47dd-b932-f82738c2fc61 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 17:42:12.215045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:12.215045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:12.215045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:12.215045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:12.215045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:12.215045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:12.215045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:12.215045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:12.215045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:12.215045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:12.215045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:12.215045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:42:12.215045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:42:12.215045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:42:12.215045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:42:12.216187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:42:12.216187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:42:12.216187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:42:12.216187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:42:12.216187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:12.216187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:12.216187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:12.216187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:12.216187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:12.216187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:12.216187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:12.216187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:12.216187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:12.216187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:12.216187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:12.216187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:12.222272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:12.222272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:12.222272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:12.222272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:12.222272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:42:12.222272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:42:12.222272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:42:12.222272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:42:12.222272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:42:12.222272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:42:12.222272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 17:42:12.222272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:12.222272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 191/389] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:42:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:42:12.222272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c0f34-7da2-4096-91d1-db9b08e2747d None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:12.223014 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c0f34-7da2-4096-91d1-db9b08e2747d None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:12.223014 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c0f34-7da2-4096-91d1-db9b08e2747d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:12.238773 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9367575-713c-4b78-ac12-9e0839e2726a None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:12.241458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-927c0f34-7da2-4096-91d1-db9b08e2747d None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:12.242682 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-927c0f34-7da2-4096-91d1-db9b08e2747d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:12.284805 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeccf30e-c701-4af4-a07f-42a9fbb1e627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:12.285811 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeccf30e-c701-4af4-a07f-42a9fbb1e627 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:12.286323 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeccf30e-c701-4af4-a07f-42a9fbb1e627 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:12.286875 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeccf30e-c701-4af4-a07f-42a9fbb1e627 None admin] PATH_INFO: `/v3/projects/00fef40581d54f69b20ec6565c3cf274` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:12.288253 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeccf30e-c701-4af4-a07f-42a9fbb1e627 None admin] RBAC: Authorizing `identity:get_project(project_id=00fef40581d54f69b20ec6565c3cf274)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:12.290572 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeccf30e-c701-4af4-a07f-42a9fbb1e627 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:12.297508 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 199/390] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:42:12 2022] GET /identity/v3/projects/00fef40581d54f69b20ec6565c3cf274 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:12.297958 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeccf30e-c701-4af4-a07f-42a9fbb1e627 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:12.329151 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 192/391] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:42:12.330088 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c0f34-7da2-4096-91d1-db9b08e2747d None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:12.345623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:12.415361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeccf30e-c701-4af4-a07f-42a9fbb1e627 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:12.459589 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b01128-265c-46e3-81f4-bfecb52ce283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:12.461721 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b01128-265c-46e3-81f4-bfecb52ce283 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:12.462211 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b01128-265c-46e3-81f4-bfecb52ce283 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:12.462698 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b01128-265c-46e3-81f4-bfecb52ce283 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:12.463571 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b01128-265c-46e3-81f4-bfecb52ce283 None admin] RBAC: Adding query filter params (name=member) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:12.464083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b01128-265c-46e3-81f4-bfecb52ce283 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:12.466217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b01128-265c-46e3-81f4-bfecb52ce283 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:12.476531 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 200/392] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Sep 26 17:42:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:12.482192 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b01128-265c-46e3-81f4-bfecb52ce283 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:12.482832 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:12.517742 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c0f34-7da2-4096-91d1-db9b08e2747d None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:12.578456 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a562c-e7fd-4151-8095-631129633a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:12.579517 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a562c-e7fd-4151-8095-631129633a97 None admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:12.579792 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a562c-e7fd-4151-8095-631129633a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:12.580335 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a562c-e7fd-4151-8095-631129633a97 None admin] PATH_INFO: `/v3/projects/00fef40581d54f69b20ec6565c3cf274/groups/58f1d106059548fc8d9d7615cfeef933/roles/1d93df17fd9a4d92b8c9966cc9deacde` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:12.583316 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a562c-e7fd-4151-8095-631129633a97 None admin] RBAC: Authorizing `identity:create_grant(project_id=00fef40581d54f69b20ec6565c3cf274, group_id=58f1d106059548fc8d9d7615cfeef933, role_id=1d93df17fd9a4d92b8c9966cc9deacde)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:12.585077 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a562c-e7fd-4151-8095-631129633a97 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:12.601421 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:12.604346 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 193/393] 10.222.0.62 () {58 vars in 1442 bytes} [Mon Sep 26 17:42:12 2022] PUT /identity/v3/projects/00fef40581d54f69b20ec6565c3cf274/groups/58f1d106059548fc8d9d7615cfeef933/roles/1d93df17fd9a4d92b8c9966cc9deacde => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:42:12.605502 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b01128-265c-46e3-81f4-bfecb52ce283 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:12.605927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8453dff-604e-4b17-9895-821d15e5bafd None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:12.606207 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8453dff-604e-4b17-9895-821d15e5bafd None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:12.606473 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8453dff-604e-4b17-9895-821d15e5bafd None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:12.608427 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 194/394] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:12.616310 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8793cb6-0ef7-43aa-b8e6-ce8ee447e73b None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:12.616728 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8793cb6-0ef7-43aa-b8e6-ce8ee447e73b None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:12.617749 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8793cb6-0ef7-43aa-b8e6-ce8ee447e73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:12.658276 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-b8793cb6-0ef7-43aa-b8e6-ce8ee447e73b None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:12.659503 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-b8793cb6-0ef7-43aa-b8e6-ce8ee447e73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:12.680353 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0037b0d-b79c-4c81-8b74-e490252809ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:12.681029 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0037b0d-b79c-4c81-8b74-e490252809ae None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:12.681309 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0037b0d-b79c-4c81-8b74-e490252809ae None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:12.681579 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0037b0d-b79c-4c81-8b74-e490252809ae None admin] PATH_INFO: `/v3/groups/58f1d106059548fc8d9d7615cfeef933` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:12.684237 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0037b0d-b79c-4c81-8b74-e490252809ae None admin] RBAC: Authorizing `identity:get_group(group_id=58f1d106059548fc8d9d7615cfeef933)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:12.685746 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0037b0d-b79c-4c81-8b74-e490252809ae None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:12.687532 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 201/395] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Sep 26 17:42:12 2022] GET /identity/v3/groups/58f1d106059548fc8d9d7615cfeef933 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:42:12.693956 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0037b0d-b79c-4c81-8b74-e490252809ae None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:12.791584 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 195/396] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:42:12.792704 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8793cb6-0ef7-43aa-b8e6-ce8ee447e73b None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:12.852068 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0037b0d-b79c-4c81-8b74-e490252809ae None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:12.886306 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:12.897131 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac1745-f5e5-4eac-9df6-a6ede343f60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:12.898230 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac1745-f5e5-4eac-9df6-a6ede343f60e None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:12.899307 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac1745-f5e5-4eac-9df6-a6ede343f60e None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:12.899729 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac1745-f5e5-4eac-9df6-a6ede343f60e None admin] PATH_INFO: `/v3/projects/00fef40581d54f69b20ec6565c3cf274` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:12.901194 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac1745-f5e5-4eac-9df6-a6ede343f60e None admin] RBAC: Authorizing `identity:get_project(project_id=00fef40581d54f69b20ec6565c3cf274)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:12.902799 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac1745-f5e5-4eac-9df6-a6ede343f60e None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:12.904982 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 202/397] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:42:12 2022] GET /identity/v3/projects/00fef40581d54f69b20ec6565c3cf274 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:12.910708 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac1745-f5e5-4eac-9df6-a6ede343f60e None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:12.929859 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8793cb6-0ef7-43aa-b8e6-ce8ee447e73b None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:12.948562 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:12.967051 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb18d5f-f534-45e5-92e7-7583c78e2f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:12.967783 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb18d5f-f534-45e5-92e7-7583c78e2f4e None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:12.968140 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb18d5f-f534-45e5-92e7-7583c78e2f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:12.968488 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb18d5f-f534-45e5-92e7-7583c78e2f4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:12.981199 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb18d5f-f534-45e5-92e7-7583c78e2f4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:42:12.986210 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-dfb18d5f-f534-45e5-92e7-7583c78e2f4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 17:42:12.986210 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:12.986210 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:12.986210 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:12.986210 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:12.986210 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:12.986210 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:12.986210 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:12.986210 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:12.986210 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:12.986210 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:12.986210 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:12.986210 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:42:12.986210 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:42:12.986210 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:42:12.986210 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:42:12.987175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:42:12.987175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:42:12.987175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:42:12.987175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:42:12.987175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:12.987175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:12.987175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:12.987175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:12.987175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:12.987175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:12.987175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:12.987175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:12.987175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:12.987175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:12.987175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:12.987175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:12.987955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:12.987955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:12.987955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:12.987955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:12.987955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:42:12.987955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:42:12.987955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:42:12.987955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:42:12.987955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:42:12.987955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:42:12.987955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 17:42:12.987955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:12.987955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 196/398] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:42:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:12.997990 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb18d5f-f534-45e5-92e7-7583c78e2f4e None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:13.031802 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac1745-f5e5-4eac-9df6-a6ede343f60e None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:13.071735 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc566a-6ea4-43ea-bdcb-12fcca445c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:13.072790 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc566a-6ea4-43ea-bdcb-12fcca445c46 None admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:13.073353 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc566a-6ea4-43ea-bdcb-12fcca445c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:13.073834 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc566a-6ea4-43ea-bdcb-12fcca445c46 None admin] PATH_INFO: `/v3/projects/00fef40581d54f69b20ec6565c3cf274/groups/58f1d106059548fc8d9d7615cfeef933/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:13.079074 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc566a-6ea4-43ea-bdcb-12fcca445c46 None admin] RBAC: Authorizing `identity:create_grant(project_id=00fef40581d54f69b20ec6565c3cf274, group_id=58f1d106059548fc8d9d7615cfeef933, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:13.082679 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc566a-6ea4-43ea-bdcb-12fcca445c46 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:13.099372 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 203/399] 10.222.0.62 () {58 vars in 1442 bytes} [Mon Sep 26 17:42:12 2022] PUT /identity/v3/projects/00fef40581d54f69b20ec6565c3cf274/groups/58f1d106059548fc8d9d7615cfeef933/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:42:13.099988 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc566a-6ea4-43ea-bdcb-12fcca445c46 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:13.170243 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb18d5f-f534-45e5-92e7-7583c78e2f4e None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:13.212774 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:13.222551 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93905509-e184-4f20-be5a-3939940a2c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:13.223857 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93905509-e184-4f20-be5a-3939940a2c5c None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:13.224346 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93905509-e184-4f20-be5a-3939940a2c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:13.225112 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93905509-e184-4f20-be5a-3939940a2c5c None admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:13.227419 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93905509-e184-4f20-be5a-3939940a2c5c None admin] RBAC: Adding query filter params (name=member) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:13.227955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93905509-e184-4f20-be5a-3939940a2c5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:13.229995 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93905509-e184-4f20-be5a-3939940a2c5c None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:13.242626 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 197/400] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Sep 26 17:42:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:13.245461 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f58d16-805e-4d27-a7bd-3a13943237a9 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:13.246204 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f58d16-805e-4d27-a7bd-3a13943237a9 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:13.246687 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f58d16-805e-4d27-a7bd-3a13943237a9 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:13.249672 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 198/401] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:13.250795 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f58d16-805e-4d27-a7bd-3a13943237a9 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:13.268261 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:13.277488 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc566a-6ea4-43ea-bdcb-12fcca445c46 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:13.319760 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f224c-f6ff-423d-97c2-fc94be4d0c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:13.320447 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f224c-f6ff-423d-97c2-fc94be4d0c83 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:13.320727 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f224c-f6ff-423d-97c2-fc94be4d0c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:13.321001 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f224c-f6ff-423d-97c2-fc94be4d0c83 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:13.335612 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698f224c-f6ff-423d-97c2-fc94be4d0c83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:42:13.340975 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-698f224c-f6ff-423d-97c2-fc94be4d0c83 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 17:42:13.340975 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:13.340975 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:13.340975 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:13.340975 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:13.340975 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:13.340975 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:13.340975 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:13.340975 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:13.340975 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:13.340975 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:13.340975 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:13.340975 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:42:13.340975 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:42:13.340975 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:42:13.340975 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:42:13.341865 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:42:13.341865 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:42:13.341865 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:42:13.341865 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:42:13.341865 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:13.341865 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:13.341865 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:13.341865 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:13.341865 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:13.341865 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:13.341865 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:13.341865 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:13.341865 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:13.341865 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:13.341865 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:13.341865 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:13.346366 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:13.346366 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:13.346366 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:13.346366 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:13.346366 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:42:13.346366 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:42:13.346366 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:42:13.346366 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:42:13.346366 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:42:13.346366 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:42:13.346366 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 17:42:13.346366 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:13.346366 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 204/402] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Sep 26 17:42:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:13.346366 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2ca94-d4e6-48f7-a5eb-138fc3b08704 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:13.347074 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2ca94-d4e6-48f7-a5eb-138fc3b08704 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:13.347074 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2ca94-d4e6-48f7-a5eb-138fc3b08704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:13.367036 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-a0a2ca94-d4e6-48f7-a5eb-138fc3b08704 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:13.368297 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-a0a2ca94-d4e6-48f7-a5eb-138fc3b08704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:13.403460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f58d16-805e-4d27-a7bd-3a13943237a9 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:13.452107 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 205/403] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:42:13.452874 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf789521-b4b6-45d9-877c-aed3091af79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:13.453041 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2ca94-d4e6-48f7-a5eb-138fc3b08704 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:13.453933 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf789521-b4b6-45d9-877c-aed3091af79e None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:13.454399 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf789521-b4b6-45d9-877c-aed3091af79e None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:13.454854 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf789521-b4b6-45d9-877c-aed3091af79e None admin] PATH_INFO: `/v3/groups/58f1d106059548fc8d9d7615cfeef933` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:13.457434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf789521-b4b6-45d9-877c-aed3091af79e None admin] RBAC: Authorizing `identity:get_group(group_id=58f1d106059548fc8d9d7615cfeef933)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:13.459190 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf789521-b4b6-45d9-877c-aed3091af79e None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:13.461971 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 199/404] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Sep 26 17:42:13 2022] GET /identity/v3/groups/58f1d106059548fc8d9d7615cfeef933 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:13.467442 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf789521-b4b6-45d9-877c-aed3091af79e None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:13.562199 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:13.627852 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:13.648174 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2ca94-d4e6-48f7-a5eb-138fc3b08704 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:13.652936 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf789521-b4b6-45d9-877c-aed3091af79e None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:13.685225 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49fbce8-d2c4-425b-9051-ca91e3e11b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:13.686173 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fbce8-d2c4-425b-9051-ca91e3e11b16 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:13.686645 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fbce8-d2c4-425b-9051-ca91e3e11b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:13.687144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fbce8-d2c4-425b-9051-ca91e3e11b16 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:13.688102 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49fbce8-d2c4-425b-9051-ca91e3e11b16 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:13.688593 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49fbce8-d2c4-425b-9051-ca91e3e11b16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:13.690667 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49fbce8-d2c4-425b-9051-ca91e3e11b16 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:13.707356 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 206/405] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:42:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:13.709086 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49fbce8-d2c4-425b-9051-ca91e3e11b16 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:13.778655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f246ee-52bc-4276-a80a-2a215ddfe7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:13.779311 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f246ee-52bc-4276-a80a-2a215ddfe7f8 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:13.779702 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f246ee-52bc-4276-a80a-2a215ddfe7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:13.780158 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f246ee-52bc-4276-a80a-2a215ddfe7f8 None admin] PATH_INFO: `/v3/projects/5f86051201ae444796f8bf9e49c1b888` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:13.781902 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f246ee-52bc-4276-a80a-2a215ddfe7f8 None admin] RBAC: Authorizing `identity:get_project(project_id=5f86051201ae444796f8bf9e49c1b888)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:13.783668 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f246ee-52bc-4276-a80a-2a215ddfe7f8 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:13.786811 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 200/406] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:42:13 2022] GET /identity/v3/projects/5f86051201ae444796f8bf9e49c1b888 => generated 302 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:13.787714 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f246ee-52bc-4276-a80a-2a215ddfe7f8 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:13.817316 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49fbce8-d2c4-425b-9051-ca91e3e11b16 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:13.858779 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10b7ab-6be6-45a7-96a4-abc5deadb773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:13.859808 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10b7ab-6be6-45a7-96a4-abc5deadb773 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:13.860277 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10b7ab-6be6-45a7-96a4-abc5deadb773 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:13.860739 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10b7ab-6be6-45a7-96a4-abc5deadb773 None admin] PATH_INFO: `/v3/groups/58f1d106059548fc8d9d7615cfeef933` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:13.862126 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f10b7ab-6be6-45a7-96a4-abc5deadb773 None admin] RBAC: Authorizing `identity:get_group(group_id=58f1d106059548fc8d9d7615cfeef933)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:13.863793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f10b7ab-6be6-45a7-96a4-abc5deadb773 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:13.871117 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 207/407] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Sep 26 17:42:13 2022] GET /identity/v3/groups/58f1d106059548fc8d9d7615cfeef933 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:13.872399 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10b7ab-6be6-45a7-96a4-abc5deadb773 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:13.892481 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:13.934427 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f246ee-52bc-4276-a80a-2a215ddfe7f8 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:13.969756 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:13.980982 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7fc77-1495-4d3b-a0b0-60d83226f678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:13.982013 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7fc77-1495-4d3b-a0b0-60d83226f678 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:13.982500 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7fc77-1495-4d3b-a0b0-60d83226f678 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:13.983158 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7fc77-1495-4d3b-a0b0-60d83226f678 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:13.995721 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10b7ab-6be6-45a7-96a4-abc5deadb773 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:13.997540 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed7fc77-1495-4d3b-a0b0-60d83226f678 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:42:14.003128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-0ed7fc77-1495-4d3b-a0b0-60d83226f678 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:42:14.003128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:14.003128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:14.003128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:14.003128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:14.003128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:14.003128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:14.003128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:14.003128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:14.003128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:14.003128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:14.003128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:14.003128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:42:14.003128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:42:14.003128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:42:14.003128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:42:14.004193 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:42:14.004193 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:42:14.004193 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:42:14.004193 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:42:14.004193 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:14.004193 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:14.004193 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:14.004193 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:14.004193 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:14.004193 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:14.004193 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:14.004193 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:14.004193 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:14.004193 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:14.004193 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:14.004193 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:14.005027 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:14.005027 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:14.005027 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:14.005027 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:14.005027 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:42:14.005027 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:42:14.005027 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:42:14.005027 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:42:14.005027 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:42:14.005027 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:42:14.005027 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:42:14.005027 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:14.005027 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 201/408] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Sep 26 17:42:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:14.005674 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7fc77-1495-4d3b-a0b0-60d83226f678 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:14.039625 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b50680-4a33-4a0d-a136-e0ef036135d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:14.040725 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b50680-4a33-4a0d-a136-e0ef036135d8 None admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:14.041174 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b50680-4a33-4a0d-a136-e0ef036135d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:14.041915 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b50680-4a33-4a0d-a136-e0ef036135d8 None admin] PATH_INFO: `/v3/projects/5f86051201ae444796f8bf9e49c1b888/groups/58f1d106059548fc8d9d7615cfeef933/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:14.044247 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b50680-4a33-4a0d-a136-e0ef036135d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f86051201ae444796f8bf9e49c1b888, group_id=58f1d106059548fc8d9d7615cfeef933, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:14.045854 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b50680-4a33-4a0d-a136-e0ef036135d8 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:14.064829 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 208/409] 10.222.0.62 () {58 vars in 1442 bytes} [Mon Sep 26 17:42:13 2022] PUT /identity/v3/projects/5f86051201ae444796f8bf9e49c1b888/groups/58f1d106059548fc8d9d7615cfeef933/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:42:14.065978 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b50680-4a33-4a0d-a136-e0ef036135d8 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:14.129286 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7fc77-1495-4d3b-a0b0-60d83226f678 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:14.163107 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:14.191947 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b50680-4a33-4a0d-a136-e0ef036135d8 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:14.197956 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af99b17-3587-436a-a841-d3d25053f555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:14.198679 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af99b17-3587-436a-a841-d3d25053f555 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:14.199029 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af99b17-3587-436a-a841-d3d25053f555 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:14.199350 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af99b17-3587-436a-a841-d3d25053f555 None admin] PATH_INFO: `/v3/projects/5f86051201ae444796f8bf9e49c1b888` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:14.200606 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af99b17-3587-436a-a841-d3d25053f555 None admin] RBAC: Authorizing `identity:get_project(project_id=5f86051201ae444796f8bf9e49c1b888)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:14.209192 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af99b17-3587-436a-a841-d3d25053f555 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:14.215768 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 202/410] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:42:14 2022] GET /identity/v3/projects/5f86051201ae444796f8bf9e49c1b888 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:14.227223 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af99b17-3587-436a-a841-d3d25053f555 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:14.242208 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba05ffe-568a-4c2c-8477-880ae79432f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:14.243221 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba05ffe-568a-4c2c-8477-880ae79432f9 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:14.243713 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba05ffe-568a-4c2c-8477-880ae79432f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:14.244175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba05ffe-568a-4c2c-8477-880ae79432f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:14.245089 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba05ffe-568a-4c2c-8477-880ae79432f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:14.245594 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba05ffe-568a-4c2c-8477-880ae79432f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:14.247207 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba05ffe-568a-4c2c-8477-880ae79432f9 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:14.258950 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 209/411] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:42:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:14.268227 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba05ffe-568a-4c2c-8477-880ae79432f9 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:14.330877 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:14.384082 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af99b17-3587-436a-a841-d3d25053f555 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:14.416977 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba05ffe-568a-4c2c-8477-880ae79432f9 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:14.442342 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f709b-7aac-44d4-88f6-e80c1912c538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:14.443027 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f709b-7aac-44d4-88f6-e80c1912c538 None admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:14.443311 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f709b-7aac-44d4-88f6-e80c1912c538 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:14.443590 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f709b-7aac-44d4-88f6-e80c1912c538 None admin] PATH_INFO: `/v3/projects/5f86051201ae444796f8bf9e49c1b888/groups/58f1d106059548fc8d9d7615cfeef933/roles/1d93df17fd9a4d92b8c9966cc9deacde` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:14.452024 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f709b-7aac-44d4-88f6-e80c1912c538 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f86051201ae444796f8bf9e49c1b888, group_id=58f1d106059548fc8d9d7615cfeef933, role_id=1d93df17fd9a4d92b8c9966cc9deacde)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:14.453535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f709b-7aac-44d4-88f6-e80c1912c538 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:14.455514 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a5463-50af-4f29-baba-0be7a3289a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:14.456421 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a5463-50af-4f29-baba-0be7a3289a2a None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:14.456703 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a5463-50af-4f29-baba-0be7a3289a2a None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:14.456979 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a5463-50af-4f29-baba-0be7a3289a2a None admin] PATH_INFO: `/v3/groups/1fc182f48836474caf10f7fb6e653863` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:14.458119 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a5463-50af-4f29-baba-0be7a3289a2a None admin] RBAC: Authorizing `identity:get_group(group_id=1fc182f48836474caf10f7fb6e653863)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:14.460264 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a5463-50af-4f29-baba-0be7a3289a2a None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:14.463002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 210/412] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Sep 26 17:42:14 2022] GET /identity/v3/groups/1fc182f48836474caf10f7fb6e653863 => generated 229 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:14.468395 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a5463-50af-4f29-baba-0be7a3289a2a None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:14.479237 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:14.482650 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 203/413] 10.222.0.62 () {58 vars in 1442 bytes} [Mon Sep 26 17:42:14 2022] PUT /identity/v3/projects/5f86051201ae444796f8bf9e49c1b888/groups/58f1d106059548fc8d9d7615cfeef933/roles/1d93df17fd9a4d92b8c9966cc9deacde => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:42:14.582826 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a5463-50af-4f29-baba-0be7a3289a2a None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:14.621163 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a492405-755f-4d82-9a23-414b4d2687e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:14.621806 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a492405-755f-4d82-9a23-414b4d2687e2 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:14.622094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a492405-755f-4d82-9a23-414b4d2687e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:14.622369 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a492405-755f-4d82-9a23-414b4d2687e2 None admin] PATH_INFO: `/v3/projects/068ad96e90d940c6a9455251dbef5ca0` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:14.623514 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a492405-755f-4d82-9a23-414b4d2687e2 None admin] RBAC: Authorizing `identity:get_project(project_id=068ad96e90d940c6a9455251dbef5ca0)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:14.625033 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a492405-755f-4d82-9a23-414b4d2687e2 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:14.626998 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 211/414] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:42:14 2022] GET /identity/v3/projects/068ad96e90d940c6a9455251dbef5ca0 => generated 344 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:14.633493 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f709b-7aac-44d4-88f6-e80c1912c538 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:14.756290 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f709b-7aac-44d4-88f6-e80c1912c538 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:14.773829 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:14.793686 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e02cc-4e2a-42ce-82e7-57d67a67ddd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:14.794348 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e02cc-4e2a-42ce-82e7-57d67a67ddd5 None admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:14.794631 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e02cc-4e2a-42ce-82e7-57d67a67ddd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:14.794901 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e02cc-4e2a-42ce-82e7-57d67a67ddd5 None admin] PATH_INFO: `/v3/projects/068ad96e90d940c6a9455251dbef5ca0/groups/1fc182f48836474caf10f7fb6e653863/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:14.796780 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e02cc-4e2a-42ce-82e7-57d67a67ddd5 None admin] RBAC: Authorizing `identity:create_grant(project_id=068ad96e90d940c6a9455251dbef5ca0, group_id=1fc182f48836474caf10f7fb6e653863, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:14.798261 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e02cc-4e2a-42ce-82e7-57d67a67ddd5 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:14.812191 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 204/415] 10.222.0.62 () {58 vars in 1442 bytes} [Mon Sep 26 17:42:14 2022] PUT /identity/v3/projects/068ad96e90d940c6a9455251dbef5ca0/groups/1fc182f48836474caf10f7fb6e653863/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:42:15.540270 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ac398-59d6-45c5-ad0e-4e7271213a06 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:15.540807 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ac398-59d6-45c5-ad0e-4e7271213a06 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:15.540807 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ac398-59d6-45c5-ad0e-4e7271213a06 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:15.542461 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 212/416] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:15.547934 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89df8fd-300b-48e2-9168-03c542817bb3 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:15.548501 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89df8fd-300b-48e2-9168-03c542817bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:15.548966 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89df8fd-300b-48e2-9168-03c542817bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:15.573162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-a89df8fd-300b-48e2-9168-03c542817bb3 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:15.574658 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-a89df8fd-300b-48e2-9168-03c542817bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:15.629049 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752b7e4-eba3-46af-9d3b-30a78880611f None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:15.629381 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752b7e4-eba3-46af-9d3b-30a78880611f None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:15.629622 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752b7e4-eba3-46af-9d3b-30a78880611f None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:15.631251 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 213/417] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:15.641500 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7aa91e-b44e-4845-a702-019a69c33f99 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:15.641809 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7aa91e-b44e-4845-a702-019a69c33f99 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:15.642075 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7aa91e-b44e-4845-a702-019a69c33f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:15.652370 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 205/418] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:42:15.677996 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-1d7aa91e-b44e-4845-a702-019a69c33f99 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:15.679958 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-1d7aa91e-b44e-4845-a702-019a69c33f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:15.779238 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 214/419] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:42:15.918863 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89df8fd-300b-48e2-9168-03c542817bb3 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:16.038189 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89df8fd-300b-48e2-9168-03c542817bb3 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:16.050829 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:16.091045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0331f86-6ede-4f20-b89f-58cbc5615c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:16.091677 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0331f86-6ede-4f20-b89f-58cbc5615c46 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:16.091951 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0331f86-6ede-4f20-b89f-58cbc5615c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:16.092217 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0331f86-6ede-4f20-b89f-58cbc5615c46 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:16.107457 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0331f86-6ede-4f20-b89f-58cbc5615c46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:42:16.112294 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-a0331f86-6ede-4f20-b89f-58cbc5615c46 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 17:42:16.112294 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:16.112294 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:16.112294 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:16.112294 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:16.112294 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:16.112294 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:16.112294 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:16.112294 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:16.112294 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:16.112294 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:16.112294 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:16.112294 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:42:16.112294 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:42:16.112294 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:42:16.112294 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:42:16.113206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:42:16.113206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:42:16.113206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:42:16.113206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:42:16.113206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:16.113206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:16.113206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:16.113206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:16.113206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:16.113206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:16.113206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:16.113206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:16.113206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:16.113206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:16.113206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:16.113206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:16.114006 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:16.114006 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:16.114006 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:16.114006 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:16.114006 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:42:16.114006 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:42:16.114006 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:42:16.114006 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:42:16.114006 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:42:16.114006 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:42:16.114006 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 17:42:16.114006 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:16.114627 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 206/420] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Sep 26 17:42:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:16.119102 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7aa91e-b44e-4845-a702-019a69c33f99 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:16.122611 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:16.154985 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0331f86-6ede-4f20-b89f-58cbc5615c46 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:16.297128 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7aa91e-b44e-4845-a702-019a69c33f99 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:16.337367 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0331f86-6ede-4f20-b89f-58cbc5615c46 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:16.360322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61439ec2-5f8c-4731-abf1-e38108ac92b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:16.360997 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61439ec2-5f8c-4731-abf1-e38108ac92b8 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:16.361297 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61439ec2-5f8c-4731-abf1-e38108ac92b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:16.361565 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61439ec2-5f8c-4731-abf1-e38108ac92b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:16.362223 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61439ec2-5f8c-4731-abf1-e38108ac92b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:16.362521 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61439ec2-5f8c-4731-abf1-e38108ac92b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:16.364061 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61439ec2-5f8c-4731-abf1-e38108ac92b8 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:16.381177 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 215/421] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:42:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:16.385636 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61439ec2-5f8c-4731-abf1-e38108ac92b8 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:16.411984 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04785d63-2e9f-4922-9627-c120c5b73560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:16.412950 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04785d63-2e9f-4922-9627-c120c5b73560 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:16.413473 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04785d63-2e9f-4922-9627-c120c5b73560 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:16.414484 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04785d63-2e9f-4922-9627-c120c5b73560 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:16.433275 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04785d63-2e9f-4922-9627-c120c5b73560 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:42:16.438673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-04785d63-2e9f-4922-9627-c120c5b73560 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 17:42:16.438673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:16.438673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:16.438673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:16.438673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:16.438673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:16.438673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:16.438673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:16.438673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:16.438673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:16.438673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:16.438673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:16.438673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:42:16.438673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:42:16.438673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:42:16.438673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:42:16.439527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:42:16.439527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:42:16.439527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:42:16.439527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:42:16.439527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:16.439527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:16.439527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:16.439527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:16.439527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:16.439527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:16.439527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:16.439527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:16.439527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:16.439527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:16.439527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:16.439527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:16.440346 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:16.440346 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:16.440346 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:16.440346 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:16.440346 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:42:16.440346 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:42:16.440346 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:42:16.440346 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:42:16.440346 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:42:16.440346 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:42:16.440346 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 17:42:16.440346 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:16.442687 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 207/422] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:42:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:42:16.448604 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04785d63-2e9f-4922-9627-c120c5b73560 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:16.505377 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:16.529385 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:16.605138 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61439ec2-5f8c-4731-abf1-e38108ac92b8 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:16.666190 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04785d63-2e9f-4922-9627-c120c5b73560 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:16.679699 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882ca3d-6bd1-4130-9baa-dbc88f9abccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:16.680319 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882ca3d-6bd1-4130-9baa-dbc88f9abccf None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:16.680598 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882ca3d-6bd1-4130-9baa-dbc88f9abccf None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:16.680876 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882ca3d-6bd1-4130-9baa-dbc88f9abccf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:16.718954 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a130121-8664-46b3-81b7-8524e0e78851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:16.719698 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a130121-8664-46b3-81b7-8524e0e78851 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:16.719874 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a130121-8664-46b3-81b7-8524e0e78851 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:16.720165 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a130121-8664-46b3-81b7-8524e0e78851 None admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:16.720812 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a130121-8664-46b3-81b7-8524e0e78851 None admin] RBAC: Adding query filter params (name=member) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:16.721154 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a130121-8664-46b3-81b7-8524e0e78851 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:16.722730 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a130121-8664-46b3-81b7-8524e0e78851 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:16.731435 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 208/423] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Sep 26 17:42:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:16.732776 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebce6ed-b8a1-4f5b-b263-038be2ecf1ce None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:16.733101 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebce6ed-b8a1-4f5b-b263-038be2ecf1ce None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:16.733376 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebce6ed-b8a1-4f5b-b263-038be2ecf1ce None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:16.738968 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 209/424] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:16.740376 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebce6ed-b8a1-4f5b-b263-038be2ecf1ce None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:16.773240 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0882ca3d-6bd1-4130-9baa-dbc88f9abccf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:16.775831 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0882ca3d-6bd1-4130-9baa-dbc88f9abccf None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:16.844689 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:16.857716 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:16.866046 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebce6ed-b8a1-4f5b-b263-038be2ecf1ce None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:16.902079 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 216/425] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:42:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 17:42:16.903367 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887d015-de66-4c16-9b5f-d3e4e9d6c44d None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:16.903758 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887d015-de66-4c16-9b5f-d3e4e9d6c44d None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:16.904008 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887d015-de66-4c16-9b5f-d3e4e9d6c44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:16.909803 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd237c-ded2-453f-993d-9cee0e52f188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:16.911123 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd237c-ded2-453f-993d-9cee0e52f188 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:16.912497 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd237c-ded2-453f-993d-9cee0e52f188 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:16.912964 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd237c-ded2-453f-993d-9cee0e52f188 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:16.926927 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-8887d015-de66-4c16-9b5f-d3e4e9d6c44d None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:16.928980 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-8887d015-de66-4c16-9b5f-d3e4e9d6c44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:16.988072 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cd237c-ded2-453f-993d-9cee0e52f188 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:16.989596 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cd237c-ded2-453f-993d-9cee0e52f188 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:17.016309 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 217/426] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:42:17.017578 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887d015-de66-4c16-9b5f-d3e4e9d6c44d None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:17.126118 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:17.134095 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887d015-de66-4c16-9b5f-d3e4e9d6c44d None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:17.147955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:17.174366 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d6bee-695b-4dc4-819c-0edd9f770b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:17.175333 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d6bee-695b-4dc4-819c-0edd9f770b1d None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:17.176034 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d6bee-695b-4dc4-819c-0edd9f770b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:17.176512 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d6bee-695b-4dc4-819c-0edd9f770b1d None admin] PATH_INFO: `/v3/projects/00fef40581d54f69b20ec6565c3cf274` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:17.177888 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d6bee-695b-4dc4-819c-0edd9f770b1d None admin] RBAC: Authorizing `identity:get_project(project_id=00fef40581d54f69b20ec6565c3cf274)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:17.180850 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d6bee-695b-4dc4-819c-0edd9f770b1d None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:17.182735 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 218/427] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:42:17 2022] GET /identity/v3/projects/00fef40581d54f69b20ec6565c3cf274 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:17.189498 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 210/428] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:42:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 17:42:17.192577 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d6bee-695b-4dc4-819c-0edd9f770b1d None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:17.192805 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd237c-ded2-453f-993d-9cee0e52f188 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:17.306429 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d6bee-695b-4dc4-819c-0edd9f770b1d None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:17.346364 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d60518-54ae-4b6e-80c6-025f53effe93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:17.347374 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d60518-54ae-4b6e-80c6-025f53effe93 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:17.348417 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d60518-54ae-4b6e-80c6-025f53effe93 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:17.348906 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d60518-54ae-4b6e-80c6-025f53effe93 None admin] PATH_INFO: `/v3/projects/00fef40581d54f69b20ec6565c3cf274` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:17.350966 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d60518-54ae-4b6e-80c6-025f53effe93 None admin] RBAC: Authorizing `identity:get_project(project_id=00fef40581d54f69b20ec6565c3cf274)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:17.353272 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d60518-54ae-4b6e-80c6-025f53effe93 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:17.355539 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 219/429] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:42:17 2022] GET /identity/v3/projects/00fef40581d54f69b20ec6565c3cf274 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:17.357620 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f24ae-d3fe-4d1a-a1a3-7eb10ce0412f None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:17.358102 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f24ae-d3fe-4d1a-a1a3-7eb10ce0412f None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:17.358585 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f24ae-d3fe-4d1a-a1a3-7eb10ce0412f None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:17.360838 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 220/430] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:17.362260 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f24ae-d3fe-4d1a-a1a3-7eb10ce0412f None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:17.374061 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd237c-ded2-453f-993d-9cee0e52f188 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:17.402528 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:17.423927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de9aea-95cc-401b-a9dc-c1d097f9af8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:17.424589 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de9aea-95cc-401b-a9dc-c1d097f9af8a None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:17.424864 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de9aea-95cc-401b-a9dc-c1d097f9af8a None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:17.425168 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de9aea-95cc-401b-a9dc-c1d097f9af8a None admin] PATH_INFO: `/v3/groups/58f1d106059548fc8d9d7615cfeef933` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:17.426383 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de9aea-95cc-401b-a9dc-c1d097f9af8a None admin] RBAC: Authorizing `identity:get_group(group_id=58f1d106059548fc8d9d7615cfeef933)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:17.427894 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de9aea-95cc-401b-a9dc-c1d097f9af8a None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:17.430345 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 211/431] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Sep 26 17:42:17 2022] GET /identity/v3/groups/58f1d106059548fc8d9d7615cfeef933 => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:42:17.431602 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a348bef-4402-4932-9103-83a228be5655 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:17.431871 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a348bef-4402-4932-9103-83a228be5655 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:17.432145 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a348bef-4402-4932-9103-83a228be5655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:17.452034 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-0a348bef-4402-4932-9103-83a228be5655 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:17.453375 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-0a348bef-4402-4932-9103-83a228be5655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:17.495427 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f24ae-d3fe-4d1a-a1a3-7eb10ce0412f None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:17.507688 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:17.526314 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 212/432] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:42:17.527166 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a348bef-4402-4932-9103-83a228be5655 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:17.545104 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b285f2-4003-4877-80e8-f7f2f276318a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:17.545750 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b285f2-4003-4877-80e8-f7f2f276318a None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:17.546035 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b285f2-4003-4877-80e8-f7f2f276318a None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:17.546301 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b285f2-4003-4877-80e8-f7f2f276318a None admin] PATH_INFO: `/v3/groups/58f1d106059548fc8d9d7615cfeef933` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:17.547428 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b285f2-4003-4877-80e8-f7f2f276318a None admin] RBAC: Authorizing `identity:get_group(group_id=58f1d106059548fc8d9d7615cfeef933)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:17.548867 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b285f2-4003-4877-80e8-f7f2f276318a None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:17.550476 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 221/433] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Sep 26 17:42:17 2022] GET /identity/v3/groups/58f1d106059548fc8d9d7615cfeef933 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:17.551323 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b285f2-4003-4877-80e8-f7f2f276318a None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:17.638111 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a348bef-4402-4932-9103-83a228be5655 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:17.663936 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:17.667164 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b285f2-4003-4877-80e8-f7f2f276318a None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:17.673969 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f029a-f853-4304-b9a2-e8b6eaf4a8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:17.674976 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f029a-f853-4304-b9a2-e8b6eaf4a8d4 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:17.675260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f029a-f853-4304-b9a2-e8b6eaf4a8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:17.675531 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f029a-f853-4304-b9a2-e8b6eaf4a8d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:17.676666 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f029a-f853-4304-b9a2-e8b6eaf4a8d4 None admin] RBAC: Adding query filter params (group.id=58f1d106059548fc8d9d7615cfeef933, role.id=1d93df17fd9a4d92b8c9966cc9deacde, scope.project.id=00fef40581d54f69b20ec6565c3cf274) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:17.677000 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f029a-f853-4304-b9a2-e8b6eaf4a8d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:17.678774 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f029a-f853-4304-b9a2-e8b6eaf4a8d4 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:17.686691 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 213/434] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Sep 26 17:42:17 2022] GET /identity/v3/role_assignments?group.id=58f1d106059548fc8d9d7615cfeef933&scope.project.id=00fef40581d54f69b20ec6565c3cf274&role.id=1d93df17fd9a4d92b8c9966cc9deacde => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:17.688483 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b30c1-77ff-4591-8889-65652dab8038 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:17.688917 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b30c1-77ff-4591-8889-65652dab8038 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:17.689610 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b30c1-77ff-4591-8889-65652dab8038 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:17.691503 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 214/435] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:17.692690 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b30c1-77ff-4591-8889-65652dab8038 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:17.707708 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147038c-3089-441f-b648-1b6fb25d9a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:17.708365 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147038c-3089-441f-b648-1b6fb25d9a50 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:17.708650 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147038c-3089-441f-b648-1b6fb25d9a50 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:17.708934 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147038c-3089-441f-b648-1b6fb25d9a50 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:17.721676 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147038c-3089-441f-b648-1b6fb25d9a50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:42:17.726793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-c147038c-3089-441f-b648-1b6fb25d9a50 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 17:42:17.726793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:17.726793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:17.726793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:17.726793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:17.726793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:17.726793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:17.726793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:17.726793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:17.726793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:17.726793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:17.726793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:17.726793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:42:17.726793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:42:17.726793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:42:17.726793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:42:17.727954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:42:17.727954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:42:17.727954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:42:17.727954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:42:17.727954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:17.727954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:17.727954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:17.727954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:17.727954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:17.727954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:17.727954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:17.727954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:17.727954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:17.727954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:17.727954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:17.727954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:17.733840 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:17.733840 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:17.733840 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:17.733840 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:17.733840 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:42:17.733840 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:42:17.733840 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:42:17.733840 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:42:17.733840 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:42:17.733840 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:42:17.733840 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 17:42:17.733840 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:17.733840 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 222/436] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:42:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:17.733840 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26e562-6687-4564-a0ad-7df6901dc6e2 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:17.734738 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26e562-6687-4564-a0ad-7df6901dc6e2 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:17.734738 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26e562-6687-4564-a0ad-7df6901dc6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:17.755663 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-de26e562-6687-4564-a0ad-7df6901dc6e2 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:17.757374 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-de26e562-6687-4564-a0ad-7df6901dc6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:17.779797 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:17.837129 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 223/437] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:42:17.838498 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26e562-6687-4564-a0ad-7df6901dc6e2 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:17.845978 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b30c1-77ff-4591-8889-65652dab8038 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:17.887919 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cfd77-00a9-4365-b3fc-9967c3c81361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:17.888883 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cfd77-00a9-4365-b3fc-9967c3c81361 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:17.889322 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cfd77-00a9-4365-b3fc-9967c3c81361 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:17.889727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cfd77-00a9-4365-b3fc-9967c3c81361 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:17.890624 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884cfd77-00a9-4365-b3fc-9967c3c81361 None admin] RBAC: Adding query filter params (group.id=58f1d106059548fc8d9d7615cfeef933, role.id=b4593720c06e4a0db655f8e33079a15f, scope.project.id=00fef40581d54f69b20ec6565c3cf274) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:17.890932 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884cfd77-00a9-4365-b3fc-9967c3c81361 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:17.892367 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884cfd77-00a9-4365-b3fc-9967c3c81361 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:17.899994 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 215/438] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Sep 26 17:42:17 2022] GET /identity/v3/role_assignments?group.id=58f1d106059548fc8d9d7615cfeef933&scope.project.id=00fef40581d54f69b20ec6565c3cf274&role.id=b4593720c06e4a0db655f8e33079a15f => generated 611 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:17.900814 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cfd77-00a9-4365-b3fc-9967c3c81361 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:17.961522 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:17.976096 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26e562-6687-4564-a0ad-7df6901dc6e2 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:18.023433 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499f1ff-2496-4680-b3a1-ff208349c162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:18.024208 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499f1ff-2496-4680-b3a1-ff208349c162 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:18.024488 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499f1ff-2496-4680-b3a1-ff208349c162 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:18.024756 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499f1ff-2496-4680-b3a1-ff208349c162 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:18.026345 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499f1ff-2496-4680-b3a1-ff208349c162 None admin] RBAC: Adding query filter params (name=member) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:18.026649 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499f1ff-2496-4680-b3a1-ff208349c162 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:18.029523 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499f1ff-2496-4680-b3a1-ff208349c162 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:18.032685 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cfd77-00a9-4365-b3fc-9967c3c81361 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:18.041727 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 224/439] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Sep 26 17:42:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:18.047604 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499f1ff-2496-4680-b3a1-ff208349c162 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:18.050167 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:18.086880 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2e778-2a19-4126-867a-19ca5a691044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:18.087109 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2e778-2a19-4126-867a-19ca5a691044 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:18.087270 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2e778-2a19-4126-867a-19ca5a691044 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:18.087542 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2e778-2a19-4126-867a-19ca5a691044 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:18.104450 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f2e778-2a19-4126-867a-19ca5a691044 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:42:18.111687 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-13f2e778-2a19-4126-867a-19ca5a691044 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 17:42:18.111687 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:18.111687 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:18.111687 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:18.111687 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:18.111687 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:18.111687 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:18.111687 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:18.111687 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:18.111687 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:18.111687 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:18.111687 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:18.111687 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:42:18.111687 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:42:18.111687 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:42:18.111687 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:42:18.112611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:42:18.112611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:42:18.112611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:42:18.112611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:42:18.112611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:18.112611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:18.112611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:18.112611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:18.112611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:18.112611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:18.112611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:18.112611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:18.112611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:18.112611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:18.112611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:18.112611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:18.113449 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:18.113449 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:18.113449 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:18.113449 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:18.113449 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:42:18.113449 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:42:18.113449 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:42:18.113449 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:42:18.113449 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:42:18.113449 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:42:18.113449 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 17:42:18.113449 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:18.113449 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 216/440] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Sep 26 17:42:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:18.120394 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2e778-2a19-4126-867a-19ca5a691044 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:18.174901 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499f1ff-2496-4680-b3a1-ff208349c162 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:18.214784 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b00ad-73b7-43b5-8668-9240cd140708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:18.215397 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b00ad-73b7-43b5-8668-9240cd140708 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:18.215677 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b00ad-73b7-43b5-8668-9240cd140708 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:18.215948 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b00ad-73b7-43b5-8668-9240cd140708 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:18.238965 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2e778-2a19-4126-867a-19ca5a691044 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:18.239619 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:18.282276 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389439a-9b4c-4ae3-8d3c-6643e79b69a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:18.282878 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389439a-9b4c-4ae3-8d3c-6643e79b69a6 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:18.283151 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389439a-9b4c-4ae3-8d3c-6643e79b69a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:18.283416 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389439a-9b4c-4ae3-8d3c-6643e79b69a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:18.284067 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9389439a-9b4c-4ae3-8d3c-6643e79b69a6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:18.284364 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9389439a-9b4c-4ae3-8d3c-6643e79b69a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:18.286185 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9389439a-9b4c-4ae3-8d3c-6643e79b69a6 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:18.294406 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 217/441] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:42:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:42:18.295334 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389439a-9b4c-4ae3-8d3c-6643e79b69a6 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:18.299066 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b00ad-73b7-43b5-8668-9240cd140708 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:18.300514 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b00ad-73b7-43b5-8668-9240cd140708 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:18.333765 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:18.415631 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389439a-9b4c-4ae3-8d3c-6643e79b69a6 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:18.433159 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 225/442] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:42:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 17:42:18.434050 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b00ad-73b7-43b5-8668-9240cd140708 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:18.457040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5a968-720f-40b6-9497-2557f922af4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:18.457700 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5a968-720f-40b6-9497-2557f922af4c None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:18.457982 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5a968-720f-40b6-9497-2557f922af4c None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:18.458251 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5a968-720f-40b6-9497-2557f922af4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:18.471489 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed5a968-720f-40b6-9497-2557f922af4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:42:18.477229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-1ed5a968-720f-40b6-9497-2557f922af4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:42:18.477229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:18.477229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:18.477229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:18.477229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:18.477229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:18.477229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:18.477229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:18.477229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:18.477229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:18.477229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:18.477229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:18.477229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:42:18.477229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:42:18.477229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:42:18.477229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:42:18.478124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:42:18.478124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:42:18.478124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:42:18.478124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:42:18.478124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:18.478124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:18.478124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:18.478124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:18.478124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:18.478124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:18.478124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:18.478124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:18.478124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:18.478124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:18.478124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:18.478124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:18.478919 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:18.478919 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:18.478919 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:18.478919 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:18.478919 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:42:18.478919 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:42:18.478919 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:42:18.478919 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:42:18.478919 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:42:18.478919 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:42:18.478919 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:42:18.478919 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:18.478919 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 218/443] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Sep 26 17:42:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:18.480006 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5a968-720f-40b6-9497-2557f922af4c None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:18.497535 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:18.545089 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b00ad-73b7-43b5-8668-9240cd140708 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:18.581243 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f6561-6704-4e4a-820d-2ce87742be11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:18.581875 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f6561-6704-4e4a-820d-2ce87742be11 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:18.582213 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f6561-6704-4e4a-820d-2ce87742be11 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:18.582476 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f6561-6704-4e4a-820d-2ce87742be11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:18.589586 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:18.595980 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5a968-720f-40b6-9497-2557f922af4c None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:18.628661 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7184d-2678-4500-82f9-7e2ac26b2f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:18.629324 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7184d-2678-4500-82f9-7e2ac26b2f7a None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:18.629601 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7184d-2678-4500-82f9-7e2ac26b2f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:18.629872 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7184d-2678-4500-82f9-7e2ac26b2f7a None admin] PATH_INFO: `/v3/projects/5f86051201ae444796f8bf9e49c1b888` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:18.630984 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7184d-2678-4500-82f9-7e2ac26b2f7a None admin] RBAC: Authorizing `identity:get_project(project_id=5f86051201ae444796f8bf9e49c1b888)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:18.632457 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7184d-2678-4500-82f9-7e2ac26b2f7a None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:18.634627 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 219/444] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:42:18 2022] GET /identity/v3/projects/5f86051201ae444796f8bf9e49c1b888 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:18.635388 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7184d-2678-4500-82f9-7e2ac26b2f7a None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:18.649841 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1f6561-6704-4e4a-820d-2ce87742be11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:18.651302 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1f6561-6704-4e4a-820d-2ce87742be11 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:18.702338 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:18.734985 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7184d-2678-4500-82f9-7e2ac26b2f7a None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:18.748954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 226/445] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:42:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 17:42:18.750143 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f6561-6704-4e4a-820d-2ce87742be11 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:18.772608 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc58518e-dcfa-4855-8e05-731ba9c31965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:18.773283 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58518e-dcfa-4855-8e05-731ba9c31965 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:18.773559 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58518e-dcfa-4855-8e05-731ba9c31965 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:18.773826 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58518e-dcfa-4855-8e05-731ba9c31965 None admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:18.774480 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc58518e-dcfa-4855-8e05-731ba9c31965 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:18.774780 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc58518e-dcfa-4855-8e05-731ba9c31965 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:18.776158 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc58518e-dcfa-4855-8e05-731ba9c31965 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:18.783997 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 220/446] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:42:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:18.784774 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc58518e-dcfa-4855-8e05-731ba9c31965 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:18.812439 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:18.848401 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f6561-6704-4e4a-820d-2ce87742be11 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:18.882839 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc58518e-dcfa-4855-8e05-731ba9c31965 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:18.883013 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53487e4a-41bc-41e1-87e8-5fb391dc8799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:18.883548 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53487e4a-41bc-41e1-87e8-5fb391dc8799 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:18.883824 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53487e4a-41bc-41e1-87e8-5fb391dc8799 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:18.884098 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53487e4a-41bc-41e1-87e8-5fb391dc8799 None admin] PATH_INFO: `/v3/groups/58f1d106059548fc8d9d7615cfeef933` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:18.886110 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53487e4a-41bc-41e1-87e8-5fb391dc8799 None admin] RBAC: Authorizing `identity:get_group(group_id=58f1d106059548fc8d9d7615cfeef933)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:18.887557 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53487e4a-41bc-41e1-87e8-5fb391dc8799 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:18.893845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 227/447] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Sep 26 17:42:18 2022] GET /identity/v3/groups/58f1d106059548fc8d9d7615cfeef933 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:18.893845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53487e4a-41bc-41e1-87e8-5fb391dc8799 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:18.911476 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:18.917129 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b624e-397e-4e2f-bc2d-de8183101a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:18.917770 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b624e-397e-4e2f-bc2d-de8183101a52 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:18.918039 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b624e-397e-4e2f-bc2d-de8183101a52 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:18.918311 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b624e-397e-4e2f-bc2d-de8183101a52 None admin] PATH_INFO: `/v3/projects/5f86051201ae444796f8bf9e49c1b888` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:18.919425 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b624e-397e-4e2f-bc2d-de8183101a52 None admin] RBAC: Authorizing `identity:get_project(project_id=5f86051201ae444796f8bf9e49c1b888)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:18.920857 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b624e-397e-4e2f-bc2d-de8183101a52 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:18.922493 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 221/448] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:42:18 2022] GET /identity/v3/projects/5f86051201ae444796f8bf9e49c1b888 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:18.923245 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b624e-397e-4e2f-bc2d-de8183101a52 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:18.994207 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53487e4a-41bc-41e1-87e8-5fb391dc8799 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:19.015914 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:19.023052 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b624e-397e-4e2f-bc2d-de8183101a52 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:19.027923 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf410bc0-d696-4eeb-aa76-855e122b1f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:19.028527 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf410bc0-d696-4eeb-aa76-855e122b1f9c None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:19.028808 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf410bc0-d696-4eeb-aa76-855e122b1f9c None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:19.029106 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf410bc0-d696-4eeb-aa76-855e122b1f9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:19.057280 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a522f-6ce4-4487-9127-539918658e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:19.057943 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a522f-6ce4-4487-9127-539918658e9d None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:19.058224 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a522f-6ce4-4487-9127-539918658e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:19.058519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a522f-6ce4-4487-9127-539918658e9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:19.059236 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a522f-6ce4-4487-9127-539918658e9d None admin] RBAC: Adding query filter params (group.id=58f1d106059548fc8d9d7615cfeef933, role.id=b4593720c06e4a0db655f8e33079a15f, scope.project.id=5f86051201ae444796f8bf9e49c1b888) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:19.059544 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a522f-6ce4-4487-9127-539918658e9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:19.060969 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a522f-6ce4-4487-9127-539918658e9d None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:19.066620 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 222/449] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Sep 26 17:42:18 2022] GET /identity/v3/role_assignments?group.id=58f1d106059548fc8d9d7615cfeef933&scope.project.id=5f86051201ae444796f8bf9e49c1b888&role.id=b4593720c06e4a0db655f8e33079a15f => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:19.081154 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a522f-6ce4-4487-9127-539918658e9d None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:19.100609 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf410bc0-d696-4eeb-aa76-855e122b1f9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:19.102728 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf410bc0-d696-4eeb-aa76-855e122b1f9c None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:19.126341 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:19.190734 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a522f-6ce4-4487-9127-539918658e9d None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:19.219922 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 228/450] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:42:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 17:42:19.226282 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf410bc0-d696-4eeb-aa76-855e122b1f9c None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:19.231185 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69feb9-f284-4a23-a121-e4c91bd040e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:19.231832 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69feb9-f284-4a23-a121-e4c91bd040e9 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:19.232114 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69feb9-f284-4a23-a121-e4c91bd040e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:19.232388 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69feb9-f284-4a23-a121-e4c91bd040e9 None admin] PATH_INFO: `/v3/groups/58f1d106059548fc8d9d7615cfeef933` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:19.233566 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d69feb9-f284-4a23-a121-e4c91bd040e9 None admin] RBAC: Authorizing `identity:get_group(group_id=58f1d106059548fc8d9d7615cfeef933)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:19.235029 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d69feb9-f284-4a23-a121-e4c91bd040e9 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:19.236767 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 223/451] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Sep 26 17:42:19 2022] GET /identity/v3/groups/58f1d106059548fc8d9d7615cfeef933 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:19.242826 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69feb9-f284-4a23-a121-e4c91bd040e9 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:19.276408 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:19.345948 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf410bc0-d696-4eeb-aa76-855e122b1f9c None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:19.370857 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:19.387382 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96804b-0894-40bf-9ce6-5ebba70f7c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:19.390546 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96804b-0894-40bf-9ce6-5ebba70f7c70 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:19.390546 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96804b-0894-40bf-9ce6-5ebba70f7c70 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:19.390546 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96804b-0894-40bf-9ce6-5ebba70f7c70 None admin] PATH_INFO: `/v3/projects/068ad96e90d940c6a9455251dbef5ca0` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:19.390846 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69feb9-f284-4a23-a121-e4c91bd040e9 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:19.390934 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96804b-0894-40bf-9ce6-5ebba70f7c70 None admin] RBAC: Authorizing `identity:get_project(project_id=068ad96e90d940c6a9455251dbef5ca0)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:19.392261 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96804b-0894-40bf-9ce6-5ebba70f7c70 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:19.396910 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 229/452] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:42:19 2022] GET /identity/v3/projects/068ad96e90d940c6a9455251dbef5ca0 => generated 344 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:42:19.400515 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96804b-0894-40bf-9ce6-5ebba70f7c70 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:19.432085 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca094520-57f7-4fdf-9449-3cc562f82725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:19.435428 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca094520-57f7-4fdf-9449-3cc562f82725 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:19.435428 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca094520-57f7-4fdf-9449-3cc562f82725 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:19.435428 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca094520-57f7-4fdf-9449-3cc562f82725 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:19.435428 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca094520-57f7-4fdf-9449-3cc562f82725 None admin] RBAC: Adding query filter params (group.id=58f1d106059548fc8d9d7615cfeef933, role.id=1d93df17fd9a4d92b8c9966cc9deacde, scope.project.id=5f86051201ae444796f8bf9e49c1b888) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:19.435428 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca094520-57f7-4fdf-9449-3cc562f82725 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:19.435804 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca094520-57f7-4fdf-9449-3cc562f82725 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:19.442980 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 224/453] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Sep 26 17:42:19 2022] GET /identity/v3/role_assignments?group.id=58f1d106059548fc8d9d7615cfeef933&scope.project.id=5f86051201ae444796f8bf9e49c1b888&role.id=1d93df17fd9a4d92b8c9966cc9deacde => generated 611 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:42:19.517134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96804b-0894-40bf-9ce6-5ebba70f7c70 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:19.555672 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b82afc-f880-4ca9-bd83-b39ea617e7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:19.556234 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b82afc-f880-4ca9-bd83-b39ea617e7fb None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:19.556508 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b82afc-f880-4ca9-bd83-b39ea617e7fb None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:19.556776 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b82afc-f880-4ca9-bd83-b39ea617e7fb None admin] PATH_INFO: `/v3/groups/1fc182f48836474caf10f7fb6e653863` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:19.557934 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b82afc-f880-4ca9-bd83-b39ea617e7fb None admin] RBAC: Authorizing `identity:get_group(group_id=1fc182f48836474caf10f7fb6e653863)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:19.559371 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b82afc-f880-4ca9-bd83-b39ea617e7fb None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:19.560965 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 230/454] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Sep 26 17:42:19 2022] GET /identity/v3/groups/1fc182f48836474caf10f7fb6e653863 => generated 229 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:42:19.567384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca094520-57f7-4fdf-9449-3cc562f82725 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:19.662784 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:19.673437 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca094520-57f7-4fdf-9449-3cc562f82725 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:19.707654 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c156f98-2b79-4819-b2e6-828ab09916a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:19.708222 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c156f98-2b79-4819-b2e6-828ab09916a3 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:19.708489 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c156f98-2b79-4819-b2e6-828ab09916a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:19.708756 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c156f98-2b79-4819-b2e6-828ab09916a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:19.709514 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c156f98-2b79-4819-b2e6-828ab09916a3 None admin] RBAC: Adding query filter params (group.id=1fc182f48836474caf10f7fb6e653863, role.id=be6ee971abf54b26be509c14823ece55, scope.project.id=068ad96e90d940c6a9455251dbef5ca0) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:19.709814 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c156f98-2b79-4819-b2e6-828ab09916a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:19.711780 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c156f98-2b79-4819-b2e6-828ab09916a3 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:19.717546 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 225/455] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Sep 26 17:42:19 2022] GET /identity/v3/role_assignments?group.id=1fc182f48836474caf10f7fb6e653863&scope.project.id=068ad96e90d940c6a9455251dbef5ca0&role.id=be6ee971abf54b26be509c14823ece55 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:22.413510 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6079e-0c04-4188-924d-75daa381264f None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:22.414087 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6079e-0c04-4188-924d-75daa381264f None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:22.414157 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6079e-0c04-4188-924d-75daa381264f None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:22.415793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 231/456] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:22.421892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2367d-e726-4408-87ea-47cf14f52f26 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:22.422421 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2367d-e726-4408-87ea-47cf14f52f26 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:22.422421 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2367d-e726-4408-87ea-47cf14f52f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:22.442257 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-e5b2367d-e726-4408-87ea-47cf14f52f26 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:22.443470 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-e5b2367d-e726-4408-87ea-47cf14f52f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:22.519584 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 226/457] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 17:42:22.603298 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53425fe-6f3c-4f04-b0ff-070a48989ffe None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:22.603615 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53425fe-6f3c-4f04-b0ff-070a48989ffe None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:22.603843 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53425fe-6f3c-4f04-b0ff-070a48989ffe None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:22.605449 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 232/458] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:22.610802 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839d1b2-ef82-44c3-a292-33522a323e83 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:22.611389 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839d1b2-ef82-44c3-a292-33522a323e83 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:22.611859 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839d1b2-ef82-44c3-a292-33522a323e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:22.630524 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-6839d1b2-ef82-44c3-a292-33522a323e83 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:22.632098 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-6839d1b2-ef82-44c3-a292-33522a323e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:22.715617 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 227/459] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 17:42:22.865845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53425fe-6f3c-4f04-b0ff-070a48989ffe None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:22.924557 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7973bd-905a-4ada-a00a-65369e7cd003 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:22.925196 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7973bd-905a-4ada-a00a-65369e7cd003 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:22.925698 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7973bd-905a-4ada-a00a-65369e7cd003 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:22.927936 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 228/460] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:22.933316 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef8633-cd89-4fc3-b361-4cf9fca6c324 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:22.933853 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef8633-cd89-4fc3-b361-4cf9fca6c324 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:22.934374 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef8633-cd89-4fc3-b361-4cf9fca6c324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:22.940658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:22.963430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-1eef8633-cd89-4fc3-b361-4cf9fca6c324 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:22.973029 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-1eef8633-cd89-4fc3-b361-4cf9fca6c324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:22.986538 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53425fe-6f3c-4f04-b0ff-070a48989ffe None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:22.988934 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:23.028076 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac02ba5-80b3-42af-9ab9-71b5337f8d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:23.028703 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac02ba5-80b3-42af-9ab9-71b5337f8d79 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:23.028980 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac02ba5-80b3-42af-9ab9-71b5337f8d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:23.029276 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac02ba5-80b3-42af-9ab9-71b5337f8d79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:23.049189 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac02ba5-80b3-42af-9ab9-71b5337f8d79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:23.052368 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac02ba5-80b3-42af-9ab9-71b5337f8d79 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:23.079012 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-cac02ba5-80b3-42af-9ab9-71b5337f8d79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:23.079012 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:23.079012 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:23.079012 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:23.079012 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:23.079012 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:23.079012 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:23.079012 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:23.079012 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:23.079012 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:23.079012 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:23.079012 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:23.079012 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:23.079012 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:23.079012 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:23.079012 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:23.080171 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:23.080171 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:23.080171 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:23.080171 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:23.080171 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:23.080171 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:23.080171 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:23.080171 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:23.080171 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:23.080171 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:23.080171 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:23.080171 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:23.080171 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:23.080171 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:23.080171 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:23.080171 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:23.080171 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:23.081286 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:23.081286 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:23.081286 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:23.086389 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 233/461] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:23.092413 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac02ba5-80b3-42af-9ab9-71b5337f8d79 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:23.106101 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 229/462] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:42:23.156526 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef8633-cd89-4fc3-b361-4cf9fca6c324 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:23.252115 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac02ba5-80b3-42af-9ab9-71b5337f8d79 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:23.261690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:23.292631 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a760e75-e906-4de8-be76-4aac40e362f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:23.293457 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a760e75-e906-4de8-be76-4aac40e362f3 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:23.293831 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a760e75-e906-4de8-be76-4aac40e362f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:23.294172 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a760e75-e906-4de8-be76-4aac40e362f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:23.294893 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a760e75-e906-4de8-be76-4aac40e362f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:23.295327 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a760e75-e906-4de8-be76-4aac40e362f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:23.296697 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a760e75-e906-4de8-be76-4aac40e362f3 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:23.309816 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 234/463] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:23.311211 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08defb-b6fd-42f7-8c7f-4e84d48c753d None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:23.311560 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08defb-b6fd-42f7-8c7f-4e84d48c753d None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:23.311902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08defb-b6fd-42f7-8c7f-4e84d48c753d None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:23.313453 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 235/464] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:23.314951 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08defb-b6fd-42f7-8c7f-4e84d48c753d None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:23.316755 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef8633-cd89-4fc3-b361-4cf9fca6c324 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:23.367094 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f558eb-2813-413e-921a-8719a84dbf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:23.368261 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f558eb-2813-413e-921a-8719a84dbf7f None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:23.368737 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f558eb-2813-413e-921a-8719a84dbf7f None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:23.369453 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f558eb-2813-413e-921a-8719a84dbf7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:23.385044 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f558eb-2813-413e-921a-8719a84dbf7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:23.387941 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f558eb-2813-413e-921a-8719a84dbf7f None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:23.392580 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:23.413308 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-b4f558eb-2813-413e-921a-8719a84dbf7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:23.413308 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:23.413308 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:23.413308 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:23.413308 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:23.413308 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:23.413308 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:23.413308 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:23.413308 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:23.413308 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:23.413308 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:23.413308 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:23.413308 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:23.413308 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:23.413308 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:23.413308 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:23.414298 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:23.414298 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:23.414298 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:23.414298 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:23.414298 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:23.414298 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:23.414298 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:23.414298 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:23.414298 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:23.414298 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:23.414298 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:23.414298 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:23.414298 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:23.414298 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:23.414298 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:23.414298 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:23.414298 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:23.415163 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:23.415163 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:23.415163 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:23.417081 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 230/465] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:23.423798 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b811aa0-aef2-4a82-827e-d9e94a3d1206 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:23.424768 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b811aa0-aef2-4a82-827e-d9e94a3d1206 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:23.425312 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b811aa0-aef2-4a82-827e-d9e94a3d1206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:23.432682 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08defb-b6fd-42f7-8c7f-4e84d48c753d None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:23.443883 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-1b811aa0-aef2-4a82-827e-d9e94a3d1206 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:23.445631 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-1b811aa0-aef2-4a82-827e-d9e94a3d1206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:23.469112 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32461d92-1ed4-49d4-8f09-1d8d8bdedff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:23.469739 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32461d92-1ed4-49d4-8f09-1d8d8bdedff9 None admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:23.470013 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32461d92-1ed4-49d4-8f09-1d8d8bdedff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:23.470281 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32461d92-1ed4-49d4-8f09-1d8d8bdedff9 None admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:23.470952 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32461d92-1ed4-49d4-8f09-1d8d8bdedff9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:23.472326 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32461d92-1ed4-49d4-8f09-1d8d8bdedff9 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:23.497224 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 236/466] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Sep 26 17:42:23 2022] POST /identity/v3/users => generated 246 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 17:42:23.498072 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32461d92-1ed4-49d4-8f09-1d8d8bdedff9 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:23.529553 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 231/467] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:42:23.530886 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b811aa0-aef2-4a82-827e-d9e94a3d1206 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:23.537617 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:23.705848 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32461d92-1ed4-49d4-8f09-1d8d8bdedff9 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:23.740035 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b811aa0-aef2-4a82-827e-d9e94a3d1206 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:23.753362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afabdf2-aee9-4f63-92f1-5351edcab681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:23.755188 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afabdf2-aee9-4f63-92f1-5351edcab681 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:23.755487 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afabdf2-aee9-4f63-92f1-5351edcab681 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:23.755763 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afabdf2-aee9-4f63-92f1-5351edcab681 None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:23.756418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afabdf2-aee9-4f63-92f1-5351edcab681 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:23.756723 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afabdf2-aee9-4f63-92f1-5351edcab681 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:23.758211 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afabdf2-aee9-4f63-92f1-5351edcab681 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:23.776575 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 237/468] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:23.780141 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a729e-a366-487e-8f6f-2f4052c5d42d None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:23.780370 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a729e-a366-487e-8f6f-2f4052c5d42d None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:23.780639 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a729e-a366-487e-8f6f-2f4052c5d42d None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:23.782425 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 238/469] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:23.784810 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:23.786195 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a729e-a366-487e-8f6f-2f4052c5d42d None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:23.804106 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742772d2-cfa0-40fc-9955-a3519de387fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:23.805574 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742772d2-cfa0-40fc-9955-a3519de387fa None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:23.806049 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742772d2-cfa0-40fc-9955-a3519de387fa None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:23.806966 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742772d2-cfa0-40fc-9955-a3519de387fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:23.819249 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742772d2-cfa0-40fc-9955-a3519de387fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:23.820979 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742772d2-cfa0-40fc-9955-a3519de387fa None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:23.841024 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-742772d2-cfa0-40fc-9955-a3519de387fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:23.841024 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:23.841024 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:23.841024 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:23.841024 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:23.841024 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:23.841024 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:23.841024 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:23.841024 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:23.841024 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:23.841024 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:23.841024 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:23.841024 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:23.841024 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:23.841024 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:23.841024 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:23.841980 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:23.841980 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:23.841980 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:23.841980 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:23.841980 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:23.841980 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:23.841980 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:23.841980 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:23.841980 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:23.841980 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:23.841980 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:23.841980 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:23.841980 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:23.841980 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:23.841980 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:23.841980 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:23.841980 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:23.842860 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:23.842860 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:23.842860 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:23.842860 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 232/470] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:23.843434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000053d-ad4f-4ab0-8518-4f56beac92da None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:23.843607 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000053d-ad4f-4ab0-8518-4f56beac92da None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:23.843830 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000053d-ad4f-4ab0-8518-4f56beac92da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:23.865675 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-6000053d-ad4f-4ab0-8518-4f56beac92da None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:23.866903 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-6000053d-ad4f-4ab0-8518-4f56beac92da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:23.889543 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:23.908805 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a729e-a366-487e-8f6f-2f4052c5d42d None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:23.941185 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 233/471] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:42:23.941185 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000053d-ad4f-4ab0-8518-4f56beac92da None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:23.952354 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8adf9-594c-43ff-9c4e-f42904d030df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:23.952958 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8adf9-594c-43ff-9c4e-f42904d030df None admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:23.953655 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8adf9-594c-43ff-9c4e-f42904d030df None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:23.953939 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8adf9-594c-43ff-9c4e-f42904d030df None admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:23.954592 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a8adf9-594c-43ff-9c4e-f42904d030df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:23.956400 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a8adf9-594c-43ff-9c4e-f42904d030df None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:23.983994 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 239/472] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Sep 26 17:42:23 2022] POST /identity/v3/users => generated 248 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:42:23.984831 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8adf9-594c-43ff-9c4e-f42904d030df None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:24.084676 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000053d-ad4f-4ab0-8518-4f56beac92da None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:24.111744 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:24.113452 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8adf9-594c-43ff-9c4e-f42904d030df None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:24.179888 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a758762-fe20-436f-8efa-b8433afb25f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:24.180531 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a758762-fe20-436f-8efa-b8433afb25f7 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:24.180804 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a758762-fe20-436f-8efa-b8433afb25f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:24.181092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a758762-fe20-436f-8efa-b8433afb25f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:24.197986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06504a7-4e92-4633-99f1-bd36b162094b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:24.199388 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06504a7-4e92-4633-99f1-bd36b162094b None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:24.199665 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06504a7-4e92-4633-99f1-bd36b162094b None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:24.201001 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06504a7-4e92-4633-99f1-bd36b162094b None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:24.202183 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06504a7-4e92-4633-99f1-bd36b162094b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:24.202484 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06504a7-4e92-4633-99f1-bd36b162094b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:24.203893 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06504a7-4e92-4633-99f1-bd36b162094b None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:24.204885 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a758762-fe20-436f-8efa-b8433afb25f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:24.206427 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a758762-fe20-436f-8efa-b8433afb25f7 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:24.221164 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:24.228861 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 240/473] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:24.235145 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06504a7-4e92-4633-99f1-bd36b162094b None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:24.241729 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-9a758762-fe20-436f-8efa-b8433afb25f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:24.241729 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:24.241729 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:24.241729 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:24.241729 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:24.241729 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:24.241729 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:24.241729 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:24.241729 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:24.241729 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:24.241729 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:24.241729 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:24.241729 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:24.241729 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:24.241729 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:24.241729 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:24.242853 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:24.242853 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:24.242853 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:24.242853 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:24.242853 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:24.242853 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:24.242853 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:24.242853 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:24.242853 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:24.242853 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:24.242853 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:24.242853 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:24.242853 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:24.242853 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:24.242853 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:24.242853 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:24.242853 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:24.243718 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:24.243718 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:24.243718 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:24.243718 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 234/474] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:24.247897 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a758762-fe20-436f-8efa-b8433afb25f7 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:24.362192 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06504a7-4e92-4633-99f1-bd36b162094b None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:24.380706 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a758762-fe20-436f-8efa-b8433afb25f7 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:24.403715 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d424f-5106-4bce-b9a2-53491b91ab69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:24.404436 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d424f-5106-4bce-b9a2-53491b91ab69 None admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:24.404789 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d424f-5106-4bce-b9a2-53491b91ab69 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:24.405156 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d424f-5106-4bce-b9a2-53491b91ab69 None admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:24.405946 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d424f-5106-4bce-b9a2-53491b91ab69 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:24.407499 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d424f-5106-4bce-b9a2-53491b91ab69 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:24.430546 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153de46a-3682-476b-ac8b-4fc233d3e700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:24.430546 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153de46a-3682-476b-ac8b-4fc233d3e700 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:24.431176 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153de46a-3682-476b-ac8b-4fc233d3e700 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:24.431176 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153de46a-3682-476b-ac8b-4fc233d3e700 None admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:24.433350 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153de46a-3682-476b-ac8b-4fc233d3e700 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:24.433350 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153de46a-3682-476b-ac8b-4fc233d3e700 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:24.433545 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 241/475] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Sep 26 17:42:24 2022] POST /identity/v3/users => generated 248 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:42:24.433917 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153de46a-3682-476b-ac8b-4fc233d3e700 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:24.437938 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d424f-5106-4bce-b9a2-53491b91ab69 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:24.454669 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 235/476] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:42:24.462203 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153de46a-3682-476b-ac8b-4fc233d3e700 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:24.500117 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:24.520404 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:24.609228 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d424f-5106-4bce-b9a2-53491b91ab69 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:24.624985 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153de46a-3682-476b-ac8b-4fc233d3e700 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:24.663333 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af7b54-dcd4-4249-9c35-8cc2f56d7cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:24.664665 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af7b54-dcd4-4249-9c35-8cc2f56d7cee None admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:24.665313 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af7b54-dcd4-4249-9c35-8cc2f56d7cee None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:24.665792 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af7b54-dcd4-4249-9c35-8cc2f56d7cee None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:24.666774 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af7b54-dcd4-4249-9c35-8cc2f56d7cee None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:24.666949 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21533b12-79a7-4f66-b715-a1290eb467a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:24.667520 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21533b12-79a7-4f66-b715-a1290eb467a7 None admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:24.667800 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21533b12-79a7-4f66-b715-a1290eb467a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:24.668068 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21533b12-79a7-4f66-b715-a1290eb467a7 None admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:24.668706 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21533b12-79a7-4f66-b715-a1290eb467a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:24.670174 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21533b12-79a7-4f66-b715-a1290eb467a7 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:24.670733 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af7b54-dcd4-4249-9c35-8cc2f56d7cee None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:24.680233 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.sql.core [None req-f7af7b54-dcd4-4249-9c35-8cc2f56d7cee None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 26 17:42:24.680233 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 26 17:42:24.680233 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [parameters: {'id': 'f6583c2fe7bb4a0287c4b6c2bf9e53d2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 26 17:42:24.680233 dv-cinder-859318-1-smb devstack@keystone.service[81277]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81277) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 26 17:42:24.695999 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 236/477] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Sep 26 17:42:24 2022] POST /identity/v3/users => generated 249 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:42:24.699477 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-f7af7b54-dcd4-4249-9c35-8cc2f56d7cee None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 26 17:42:24.699477 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:24.699477 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 26 17:42:24.699477 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 26 17:42:24.699477 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 26 17:42:24.699477 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 26 17:42:24.699477 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 26 17:42:24.699477 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application result = self._query(query) Sep 26 17:42:24.699477 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 26 17:42:24.699477 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application conn.query(q) Sep 26 17:42:24.699477 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 26 17:42:24.699477 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 26 17:42:24.699477 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 26 17:42:24.699477 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application result.read() Sep 26 17:42:24.699477 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 26 17:42:24.700361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 26 17:42:24.700361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 26 17:42:24.700361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 26 17:42:24.700361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 26 17:42:24.700361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 26 17:42:24.700361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 26 17:42:24.700361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 26 17:42:24.700361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 26 17:42:24.700361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:24.700361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 26 17:42:24.700361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:24.700361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:24.700361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 26 17:42:24.700361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 26 17:42:24.700361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 26 17:42:24.700361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return ref.to_dict() Sep 26 17:42:24.700361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 26 17:42:24.700361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application next(self.gen) Sep 26 17:42:24.701574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 26 17:42:24.701574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application yield resource Sep 26 17:42:24.701574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 26 17:42:24.701574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application next(self.gen) Sep 26 17:42:24.701574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 26 17:42:24.701574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self.session.rollback() Sep 26 17:42:24.701574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 26 17:42:24.701574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self.force_reraise() Sep 26 17:42:24.701574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 26 17:42:24.701574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise self.value Sep 26 17:42:24.701574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 26 17:42:24.701574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 26 17:42:24.701574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 26 17:42:24.701574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application session.commit() Sep 26 17:42:24.701574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 26 17:42:24.701574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 26 17:42:24.701574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 26 17:42:24.702469 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self._prepare_impl() Sep 26 17:42:24.702469 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 26 17:42:24.702469 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self.session.flush() Sep 26 17:42:24.702469 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 26 17:42:24.702469 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self._flush(objects) Sep 26 17:42:24.702469 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 26 17:42:24.702469 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 26 17:42:24.702469 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 26 17:42:24.702469 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application compat.raise_( Sep 26 17:42:24.702469 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 26 17:42:24.702469 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception Sep 26 17:42:24.702469 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 26 17:42:24.702469 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application flush_context.execute() Sep 26 17:42:24.702469 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 26 17:42:24.702469 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rec.execute(self) Sep 26 17:42:24.702469 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 26 17:42:24.702469 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 26 17:42:24.703361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 26 17:42:24.703361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 26 17:42:24.703361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 26 17:42:24.703361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 26 17:42:24.703361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 26 17:42:24.703361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 26 17:42:24.703361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 26 17:42:24.703361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 26 17:42:24.703361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 26 17:42:24.703361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 26 17:42:24.703361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 26 17:42:24.703361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 26 17:42:24.703361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 26 17:42:24.703361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 26 17:42:24.703361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 26 17:42:24.703361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception Sep 26 17:42:24.704185 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 26 17:42:24.704185 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 26 17:42:24.704185 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 26 17:42:24.704185 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 26 17:42:24.704185 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 26 17:42:24.704185 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application result = self._query(query) Sep 26 17:42:24.704185 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 26 17:42:24.704185 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application conn.query(q) Sep 26 17:42:24.704185 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 26 17:42:24.704185 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 26 17:42:24.704185 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 26 17:42:24.704185 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application result.read() Sep 26 17:42:24.704185 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 26 17:42:24.704185 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 26 17:42:24.704185 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 26 17:42:24.704185 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 26 17:42:24.704961 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 26 17:42:24.704961 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 26 17:42:24.704961 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 26 17:42:24.704961 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 26 17:42:24.704961 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 26 17:42:24.704961 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 26 17:42:24.704961 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [parameters: {'id': 'f6583c2fe7bb4a0287c4b6c2bf9e53d2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 26 17:42:24.704961 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 26 17:42:24.704961 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:24.704961 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 17:42:24.704961 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:24.704961 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:24.704961 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:24.704961 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:24.704961 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:24.704961 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:24.705948 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:24.705948 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:24.705948 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:24.705948 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:24.705948 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:24.705948 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:24.705948 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 26 17:42:24.705948 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 26 17:42:24.705948 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:24.705948 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:24.705948 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 26 17:42:24.705948 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 26 17:42:24.705948 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 26 17:42:24.705948 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 26 17:42:24.705948 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 26 17:42:24.705948 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:24.710176 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 242/478] 10.222.0.62 () {60 vars in 1131 bytes} [Mon Sep 26 17:42:24 2022] POST /identity/v3/roles => generated 144 bytes in 277 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:24.716985 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21533b12-79a7-4f66-b715-a1290eb467a7 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:24.814027 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:24.842739 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21533b12-79a7-4f66-b715-a1290eb467a7 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:24.886246 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d4c5e-732b-466b-b7e1-f048f709aa8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:24.886823 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d4c5e-732b-466b-b7e1-f048f709aa8a None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:24.887105 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d4c5e-732b-466b-b7e1-f048f709aa8a None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:24.887374 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d4c5e-732b-466b-b7e1-f048f709aa8a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:24.900574 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d4c5e-732b-466b-b7e1-f048f709aa8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:42:24.906033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-994d4c5e-732b-466b-b7e1-f048f709aa8a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 17:42:24.906033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:24.906033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:24.906033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:24.906033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:24.906033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:24.906033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:24.906033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:24.906033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:24.906033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:24.906033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:24.906033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:24.906033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:42:24.906033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:42:24.906033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:42:24.906033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:42:24.906918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:42:24.906918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:42:24.906918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:42:24.906918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:42:24.906918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:24.906918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:24.906918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:24.906918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:24.906918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:24.906918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:24.906918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:24.906918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:24.906918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:24.906918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:24.906918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:24.906918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:24.907773 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:24.907773 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:24.907773 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:24.907773 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:24.907773 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:42:24.907773 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:42:24.907773 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:42:24.907773 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:42:24.907773 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:42:24.907773 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:42:24.907773 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 17:42:24.907773 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:24.907773 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 237/479] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Sep 26 17:42:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:24.914624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af7b54-dcd4-4249-9c35-8cc2f56d7cee None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:25.027888 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af7b54-dcd4-4249-9c35-8cc2f56d7cee None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:25.050477 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:25.067712 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1b2d1-4cf5-48bc-9677-4c1e09e45806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:25.068326 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1b2d1-4cf5-48bc-9677-4c1e09e45806 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:25.068610 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1b2d1-4cf5-48bc-9677-4c1e09e45806 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:25.068887 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1b2d1-4cf5-48bc-9677-4c1e09e45806 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:25.069591 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1b2d1-4cf5-48bc-9677-4c1e09e45806 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:25.070473 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1b2d1-4cf5-48bc-9677-4c1e09e45806 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:25.071850 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1b2d1-4cf5-48bc-9677-4c1e09e45806 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:25.080920 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 243/480] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:42:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:26.199757 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ac3d9-806f-4712-ae6e-36e19d1ad970 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:26.200298 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ac3d9-806f-4712-ae6e-36e19d1ad970 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:26.200298 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ac3d9-806f-4712-ae6e-36e19d1ad970 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:26.202271 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 238/481] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:26.207152 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f380f91-59e8-4d61-bcd4-aa3dfe3969af None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:26.207584 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f380f91-59e8-4d61-bcd4-aa3dfe3969af None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:26.207761 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f380f91-59e8-4d61-bcd4-aa3dfe3969af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:26.232019 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-1f380f91-59e8-4d61-bcd4-aa3dfe3969af None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:26.233237 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-1f380f91-59e8-4d61-bcd4-aa3dfe3969af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:26.324562 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 244/482] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 17:42:26.552229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154327c-8441-41db-8496-e4a73de11e53 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:26.552563 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154327c-8441-41db-8496-e4a73de11e53 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:26.552735 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154327c-8441-41db-8496-e4a73de11e53 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:26.554386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 239/483] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:26.560083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2173d8-8b4e-40af-ade1-7be71698523e None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:26.560360 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2173d8-8b4e-40af-ade1-7be71698523e None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:26.560638 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2173d8-8b4e-40af-ade1-7be71698523e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:26.590079 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-5a2173d8-8b4e-40af-ade1-7be71698523e None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:26.591292 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-5a2173d8-8b4e-40af-ade1-7be71698523e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:26.679947 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 245/484] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:42:26.730876 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154327c-8441-41db-8496-e4a73de11e53 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:26.863241 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154327c-8441-41db-8496-e4a73de11e53 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:26.908333 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5fed03-ca07-49ac-87b6-5d835a7ae526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:26.908988 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fed03-ca07-49ac-87b6-5d835a7ae526 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:26.909366 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fed03-ca07-49ac-87b6-5d835a7ae526 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:26.909645 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fed03-ca07-49ac-87b6-5d835a7ae526 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:26.912858 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:26.924860 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5fed03-ca07-49ac-87b6-5d835a7ae526 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:42:26.929849 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-ca5fed03-ca07-49ac-87b6-5d835a7ae526 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:42:26.929849 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:26.929849 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:26.929849 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:26.929849 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:26.929849 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:26.929849 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:26.929849 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:26.929849 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:26.929849 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:26.929849 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:26.929849 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:26.929849 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:42:26.929849 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:42:26.929849 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:42:26.929849 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:42:26.930722 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:42:26.930722 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:42:26.930722 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:42:26.930722 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:42:26.930722 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:26.930722 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:26.930722 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:26.930722 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:26.930722 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:26.930722 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:26.930722 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:26.930722 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:26.930722 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:26.930722 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:26.930722 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:26.930722 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:26.931496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:26.931496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:26.931496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:26.931496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:26.931496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:42:26.931496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:42:26.931496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:42:26.931496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:42:26.931496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:42:26.931496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:42:26.931496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:42:26.931496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:26.931496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 240/485] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Sep 26 17:42:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:26.936805 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2173d8-8b4e-40af-ade1-7be71698523e None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:26.973876 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5fed03-ca07-49ac-87b6-5d835a7ae526 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:27.006147 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:27.113877 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2173d8-8b4e-40af-ade1-7be71698523e None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:27.157673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5fed03-ca07-49ac-87b6-5d835a7ae526 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:27.176850 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65283c66-680a-4fcc-89f6-7e81b85b9a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:27.177500 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65283c66-680a-4fcc-89f6-7e81b85b9a1f None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:27.177778 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65283c66-680a-4fcc-89f6-7e81b85b9a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:27.178051 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65283c66-680a-4fcc-89f6-7e81b85b9a1f None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:27.178716 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65283c66-680a-4fcc-89f6-7e81b85b9a1f None admin] RBAC: Adding query filter params (name=service) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:27.179018 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65283c66-680a-4fcc-89f6-7e81b85b9a1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:27.180423 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65283c66-680a-4fcc-89f6-7e81b85b9a1f None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:27.198327 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 246/486] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Sep 26 17:42:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:27.203930 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65283c66-680a-4fcc-89f6-7e81b85b9a1f None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:27.225641 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a05625-7702-4f76-995d-6db1e34f55fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:27.226327 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a05625-7702-4f76-995d-6db1e34f55fb None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:27.226573 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a05625-7702-4f76-995d-6db1e34f55fb None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:27.226844 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a05625-7702-4f76-995d-6db1e34f55fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:27.245677 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a05625-7702-4f76-995d-6db1e34f55fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:42:27.250942 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-e4a05625-7702-4f76-995d-6db1e34f55fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:42:27.250942 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:27.250942 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:27.250942 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:27.250942 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:27.250942 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:27.250942 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:27.250942 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:27.250942 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:27.250942 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:27.250942 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:27.250942 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:27.250942 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:42:27.250942 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:42:27.250942 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:42:27.250942 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:42:27.251799 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:42:27.251799 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:42:27.251799 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:42:27.251799 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:42:27.251799 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:27.251799 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:27.251799 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:27.251799 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:27.251799 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:27.251799 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:27.251799 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:27.251799 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:27.251799 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:27.251799 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:27.251799 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:27.251799 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:27.252604 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:27.252604 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:27.252604 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:27.252604 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:27.252604 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:42:27.252604 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:42:27.252604 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:42:27.252604 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:42:27.252604 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:42:27.252604 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:42:27.252604 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:42:27.252604 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:27.254453 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 241/487] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Sep 26 17:42:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:42:27.258948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a05625-7702-4f76-995d-6db1e34f55fb None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:27.342002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65283c66-680a-4fcc-89f6-7e81b85b9a1f None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:27.357375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:27.370856 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:27.393612 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29450e9e-940b-474d-b781-78fcbb46d276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:27.394735 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29450e9e-940b-474d-b781-78fcbb46d276 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:27.395220 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29450e9e-940b-474d-b781-78fcbb46d276 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:27.395693 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29450e9e-940b-474d-b781-78fcbb46d276 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:27.417131 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29450e9e-940b-474d-b781-78fcbb46d276 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:27.418628 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29450e9e-940b-474d-b781-78fcbb46d276 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:27.434744 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-29450e9e-940b-474d-b781-78fcbb46d276 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:27.434744 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:27.434744 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:27.434744 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:27.434744 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:27.434744 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:27.434744 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:27.434744 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:27.434744 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:27.434744 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:27.434744 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:27.434744 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:27.434744 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:27.434744 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:27.434744 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:27.434744 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:27.435690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:27.435690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:27.435690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:27.435690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:27.435690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:27.435690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:27.435690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:27.435690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:27.435690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:27.435690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:27.435690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:27.435690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:27.435690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:27.435690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:27.435690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:27.435690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:27.435690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:27.436531 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:27.436531 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:27.436531 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:27.436531 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 247/488] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:27.437409 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da779e94-17ee-4dc9-b668-7664e510fed8 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:27.441951 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da779e94-17ee-4dc9-b668-7664e510fed8 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:27.441951 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da779e94-17ee-4dc9-b668-7664e510fed8 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:27.443672 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 248/489] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:27.444492 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da779e94-17ee-4dc9-b668-7664e510fed8 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:27.457560 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a05625-7702-4f76-995d-6db1e34f55fb None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:27.497826 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a7836-7380-43ae-8db0-e7e8685e21db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:27.498961 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a7836-7380-43ae-8db0-e7e8685e21db None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:27.499438 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a7836-7380-43ae-8db0-e7e8685e21db None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:27.499973 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a7836-7380-43ae-8db0-e7e8685e21db None admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:27.500817 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a7836-7380-43ae-8db0-e7e8685e21db None admin] RBAC: Adding query filter params (name=service) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:27.501317 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a7836-7380-43ae-8db0-e7e8685e21db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:27.503078 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a7836-7380-43ae-8db0-e7e8685e21db None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:27.512232 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 242/490] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Sep 26 17:42:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:27.518044 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef81c6-065d-450b-954c-822a4212bcef None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:27.518336 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef81c6-065d-450b-954c-822a4212bcef None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:27.518614 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef81c6-065d-450b-954c-822a4212bcef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:27.539422 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-e6ef81c6-065d-450b-954c-822a4212bcef None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:27.540664 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-e6ef81c6-065d-450b-954c-822a4212bcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:27.563763 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da779e94-17ee-4dc9-b668-7664e510fed8 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:27.600692 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f594d-8bfa-4aed-822f-24a69b1a5b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:27.601469 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f594d-8bfa-4aed-822f-24a69b1a5b7f None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:27.601741 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f594d-8bfa-4aed-822f-24a69b1a5b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:27.602003 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f594d-8bfa-4aed-822f-24a69b1a5b7f None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:27.602650 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f594d-8bfa-4aed-822f-24a69b1a5b7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:27.602948 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f594d-8bfa-4aed-822f-24a69b1a5b7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:27.604453 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f594d-8bfa-4aed-822f-24a69b1a5b7f None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:27.614704 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 243/491] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:42:27.622212 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 249/492] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:27.622212 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f594d-8bfa-4aed-822f-24a69b1a5b7f None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:27.622399 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b92db0-b1f4-4d96-a8f3-53a44ddd078b None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:27.623053 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b92db0-b1f4-4d96-a8f3-53a44ddd078b None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:27.623053 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b92db0-b1f4-4d96-a8f3-53a44ddd078b None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:27.628279 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 244/493] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:27.628279 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b92db0-b1f4-4d96-a8f3-53a44ddd078b None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:27.649371 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:27.694441 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:27.749335 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f594d-8bfa-4aed-822f-24a69b1a5b7f None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:27.763557 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b92db0-b1f4-4d96-a8f3-53a44ddd078b None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:27.794170 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a0fe79-b4fb-47b8-a946-e10948710ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:27.795162 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0fe79-b4fb-47b8-a946-e10948710ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:27.795777 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0fe79-b4fb-47b8-a946-e10948710ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:27.796616 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0fe79-b4fb-47b8-a946-e10948710ae6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:27.805894 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66dd49-518a-4aed-aab5-5d59a1ace853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:27.806532 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66dd49-518a-4aed-aab5-5d59a1ace853 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:27.806811 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66dd49-518a-4aed-aab5-5d59a1ace853 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:27.807132 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66dd49-518a-4aed-aab5-5d59a1ace853 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:27.810608 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0fe79-b4fb-47b8-a946-e10948710ae6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:27.812854 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0fe79-b4fb-47b8-a946-e10948710ae6 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:27.815770 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66dd49-518a-4aed-aab5-5d59a1ace853 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:27.817566 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66dd49-518a-4aed-aab5-5d59a1ace853 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:27.829937 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-58a0fe79-b4fb-47b8-a946-e10948710ae6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:27.829937 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:27.829937 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:27.829937 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:27.829937 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:27.829937 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:27.829937 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:27.829937 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:27.829937 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:27.829937 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:27.829937 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:27.829937 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:27.829937 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:27.829937 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:27.829937 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:27.829937 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:27.830936 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:27.830936 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:27.830936 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:27.830936 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:27.830936 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:27.830936 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:27.830936 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:27.830936 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:27.830936 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:27.830936 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:27.830936 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:27.830936 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:27.830936 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:27.830936 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:27.830936 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:27.830936 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:27.830936 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:27.831809 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:27.831809 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:27.831809 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:27.832376 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-1f66dd49-518a-4aed-aab5-5d59a1ace853 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 17:42:27.832376 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:27.832376 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:27.832376 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:27.832376 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:27.832376 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:27.832376 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:27.832376 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:27.832376 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:27.832376 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:27.832376 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:27.832376 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:27.832376 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 17:42:27.832376 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 17:42:27.832376 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 17:42:27.832376 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 17:42:27.833248 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:27.833248 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:27.833248 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 17:42:27.833248 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:42:27.833248 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 17:42:27.833248 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:42:27.833248 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:27.833248 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:27.833248 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:27.833248 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:27.833248 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:27.833248 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:27.833248 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:27.833248 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:27.833248 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:27.833248 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:27.833248 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:27.833248 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:27.834175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:27.834175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:27.834175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 17:42:27.834175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 17:42:27.834175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 17:42:27.834175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 17:42:27.834175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 17:42:27.834175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 17:42:27.834175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 17:42:27.834175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:27.836951 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 250/494] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:27.838594 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432a9c6-19a5-4bbf-8523-e10f1c4a2f83 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:27.839073 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432a9c6-19a5-4bbf-8523-e10f1c4a2f83 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:27.839561 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432a9c6-19a5-4bbf-8523-e10f1c4a2f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:27.840650 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 245/495] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Sep 26 17:42:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:27.842634 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66dd49-518a-4aed-aab5-5d59a1ace853 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:27.864936 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-1432a9c6-19a5-4bbf-8523-e10f1c4a2f83 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:27.866286 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-1432a9c6-19a5-4bbf-8523-e10f1c4a2f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:27.936153 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:27.945156 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 251/496] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:42:27.947140 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432a9c6-19a5-4bbf-8523-e10f1c4a2f83 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:27.958083 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66dd49-518a-4aed-aab5-5d59a1ace853 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:27.970601 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:27.998293 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d90fb-b9f0-49db-bdd0-52c009c0ddf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:27.998897 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d90fb-b9f0-49db-bdd0-52c009c0ddf4 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:27.999240 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d90fb-b9f0-49db-bdd0-52c009c0ddf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:27.999438 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d90fb-b9f0-49db-bdd0-52c009c0ddf4 None admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:28.000080 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d90fb-b9f0-49db-bdd0-52c009c0ddf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:28.000401 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d90fb-b9f0-49db-bdd0-52c009c0ddf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:28.001845 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d90fb-b9f0-49db-bdd0-52c009c0ddf4 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:28.018276 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 246/497] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:42:28.018276 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d90fb-b9f0-49db-bdd0-52c009c0ddf4 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:28.086177 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432a9c6-19a5-4bbf-8523-e10f1c4a2f83 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:28.121623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254c36e-02ab-44a2-a306-110d021e3405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:28.122227 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254c36e-02ab-44a2-a306-110d021e3405 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:28.122503 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254c36e-02ab-44a2-a306-110d021e3405 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:28.122774 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254c36e-02ab-44a2-a306-110d021e3405 None admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:28.123658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7254c36e-02ab-44a2-a306-110d021e3405 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:28.124084 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7254c36e-02ab-44a2-a306-110d021e3405 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:28.125534 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7254c36e-02ab-44a2-a306-110d021e3405 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:28.126810 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d90fb-b9f0-49db-bdd0-52c009c0ddf4 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:28.162090 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6125e3-f191-4ded-9d7a-55d0b6a74ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:28.162722 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6125e3-f191-4ded-9d7a-55d0b6a74ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:28.163004 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6125e3-f191-4ded-9d7a-55d0b6a74ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:28.163276 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6125e3-f191-4ded-9d7a-55d0b6a74ac5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:28.167401 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 252/498] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Sep 26 17:42:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:28.168369 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254c36e-02ab-44a2-a306-110d021e3405 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:28.181273 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6125e3-f191-4ded-9d7a-55d0b6a74ac5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:42:28.186109 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-1e6125e3-f191-4ded-9d7a-55d0b6a74ac5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:42:28.186109 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:28.186109 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:28.186109 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:28.186109 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:28.186109 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:28.186109 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:28.186109 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:28.186109 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:28.186109 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:28.186109 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:28.186109 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:28.186109 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:42:28.186109 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:42:28.186109 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:42:28.186109 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:42:28.187215 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:42:28.187215 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:42:28.187215 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:42:28.187215 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:42:28.187215 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:28.187215 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:28.187215 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:28.187215 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:28.187215 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:28.187215 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:28.187215 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:28.187215 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:28.187215 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:28.187215 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:28.187215 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:28.187215 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:28.188147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:28.188147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:28.188147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:28.188147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:28.188147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:42:28.188147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:42:28.188147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:42:28.188147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:42:28.188147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:42:28.188147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:42:28.188147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:42:28.188147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:28.188147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 247/499] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Sep 26 17:42:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:28.188944 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea2e2c-19aa-41bf-a512-be39e86b26f3 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:28.188944 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea2e2c-19aa-41bf-a512-be39e86b26f3 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:28.188944 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea2e2c-19aa-41bf-a512-be39e86b26f3 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:28.190122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 248/500] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:28.194997 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea2e2c-19aa-41bf-a512-be39e86b26f3 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:28.224093 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:28.236786 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:28.280869 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254c36e-02ab-44a2-a306-110d021e3405 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:28.300005 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea2e2c-19aa-41bf-a512-be39e86b26f3 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:28.314930 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff46cd-263d-4d9c-9f28-8d4d2b1daa23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:28.315563 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff46cd-263d-4d9c-9f28-8d4d2b1daa23 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:28.315841 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff46cd-263d-4d9c-9f28-8d4d2b1daa23 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:28.316113 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff46cd-263d-4d9c-9f28-8d4d2b1daa23 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:28.323070 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff46cd-263d-4d9c-9f28-8d4d2b1daa23 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:28.324519 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff46cd-263d-4d9c-9f28-8d4d2b1daa23 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:28.334305 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d90998-0fd4-4099-9f3e-f3e1e8e5cea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:28.334906 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d90998-0fd4-4099-9f3e-f3e1e8e5cea9 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:28.335182 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d90998-0fd4-4099-9f3e-f3e1e8e5cea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:28.335990 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d90998-0fd4-4099-9f3e-f3e1e8e5cea9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:28.338020 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-caff46cd-263d-4d9c-9f28-8d4d2b1daa23 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 26 17:42:28.338020 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:28.338020 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:28.338020 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:28.338020 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:28.338020 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:28.338020 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:28.338020 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:28.338020 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:28.338020 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:28.338020 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:28.338020 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:28.338020 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 17:42:28.338020 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 17:42:28.338020 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 17:42:28.338020 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 17:42:28.339083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:28.339083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:28.339083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 17:42:28.339083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:42:28.339083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 17:42:28.339083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:42:28.339083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:28.339083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:28.339083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:28.339083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:28.339083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:28.339083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:28.339083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:28.339083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:28.339083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:28.339083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:28.339083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:28.339083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:28.340026 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:28.340026 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:28.340026 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 17:42:28.340026 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 17:42:28.340026 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 17:42:28.340026 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 17:42:28.340026 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 17:42:28.340026 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 17:42:28.340026 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 26 17:42:28.340026 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:28.340026 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 253/501] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:42:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:28.340026 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff46cd-263d-4d9c-9f28-8d4d2b1daa23 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:28.410972 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d90998-0fd4-4099-9f3e-f3e1e8e5cea9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:28.412454 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d90998-0fd4-4099-9f3e-f3e1e8e5cea9 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:28.439282 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:28.446785 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff46cd-263d-4d9c-9f28-8d4d2b1daa23 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:28.463009 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:28.481137 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048a3a2-9188-4f76-9989-ed594202e467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:28.481765 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048a3a2-9188-4f76-9989-ed594202e467 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:28.482024 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048a3a2-9188-4f76-9989-ed594202e467 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:28.482294 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048a3a2-9188-4f76-9989-ed594202e467 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:28.482949 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3048a3a2-9188-4f76-9989-ed594202e467 None admin] RBAC: Adding query filter params (name=service) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:28.483245 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3048a3a2-9188-4f76-9989-ed594202e467 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:28.484615 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3048a3a2-9188-4f76-9989-ed594202e467 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:28.492965 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 254/502] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Sep 26 17:42:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:28.493978 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb718f1-53ee-491a-92ae-d759dd2f57ef None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:28.494259 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb718f1-53ee-491a-92ae-d759dd2f57ef None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:28.494528 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb718f1-53ee-491a-92ae-d759dd2f57ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:28.512177 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-beb718f1-53ee-491a-92ae-d759dd2f57ef None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:28.513405 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-beb718f1-53ee-491a-92ae-d759dd2f57ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:28.520771 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 249/503] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:42:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 17:42:28.521723 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d90998-0fd4-4099-9f3e-f3e1e8e5cea9 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:28.583059 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 255/504] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:42:28.583986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb718f1-53ee-491a-92ae-d759dd2f57ef None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:28.629635 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d90998-0fd4-4099-9f3e-f3e1e8e5cea9 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:28.657183 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:28.665892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70aa3a-f3d6-4966-85ed-b1d74f4d4b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:28.666516 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70aa3a-f3d6-4966-85ed-b1d74f4d4b1b None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:28.666792 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70aa3a-f3d6-4966-85ed-b1d74f4d4b1b None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:28.667060 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70aa3a-f3d6-4966-85ed-b1d74f4d4b1b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:28.677882 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb70aa3a-f3d6-4966-85ed-b1d74f4d4b1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:42:28.682777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-cb70aa3a-f3d6-4966-85ed-b1d74f4d4b1b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:42:28.682777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:28.682777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:28.682777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:28.682777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:28.682777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:28.682777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:28.682777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:28.682777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:28.682777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:28.682777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:28.682777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:28.682777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:42:28.682777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:42:28.682777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:42:28.682777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:42:28.683655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:42:28.683655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:42:28.683655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:42:28.683655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:42:28.683655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:28.683655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:28.683655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:28.683655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:28.683655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:28.683655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:28.683655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:28.683655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:28.683655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:28.683655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:28.683655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:28.683655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:28.684445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:28.684445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:28.684445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:28.684445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:28.684445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:42:28.684445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:42:28.684445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:42:28.684445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:42:28.684445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:42:28.684445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:42:28.684445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:42:28.684445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:28.684445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 250/505] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Sep 26 17:42:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:28.685118 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70aa3a-f3d6-4966-85ed-b1d74f4d4b1b None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:28.715702 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb718f1-53ee-491a-92ae-d759dd2f57ef None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:28.726149 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:28.753169 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e68f95-b78d-4c93-9a26-55869b7227c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:28.754010 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e68f95-b78d-4c93-9a26-55869b7227c4 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:28.754010 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e68f95-b78d-4c93-9a26-55869b7227c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:28.754299 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e68f95-b78d-4c93-9a26-55869b7227c4 None admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:28.755015 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e68f95-b78d-4c93-9a26-55869b7227c4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:28.755311 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e68f95-b78d-4c93-9a26-55869b7227c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:28.756750 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e68f95-b78d-4c93-9a26-55869b7227c4 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:28.775100 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 256/506] 10.222.0.62 () {56 vars in 1137 bytes} [Mon Sep 26 17:42:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:28.775747 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e68f95-b78d-4c93-9a26-55869b7227c4 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:28.793837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70aa3a-f3d6-4966-85ed-b1d74f4d4b1b None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:28.831781 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb3926-fbb1-4dbd-864c-b8d4b25d703a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:28.832408 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb3926-fbb1-4dbd-864c-b8d4b25d703a None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:28.832683 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb3926-fbb1-4dbd-864c-b8d4b25d703a None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:28.832957 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb3926-fbb1-4dbd-864c-b8d4b25d703a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:28.843922 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb3926-fbb1-4dbd-864c-b8d4b25d703a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:28.845404 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb3926-fbb1-4dbd-864c-b8d4b25d703a None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:28.860812 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-afdb3926-fbb1-4dbd-864c-b8d4b25d703a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:28.860812 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:28.860812 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:28.860812 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:28.860812 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:28.860812 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:28.860812 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:28.860812 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:28.860812 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:28.860812 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:28.860812 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:28.860812 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:28.860812 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:28.860812 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:28.860812 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:28.860812 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:28.861744 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:28.861744 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:28.861744 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:28.861744 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:28.861744 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:28.861744 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:28.861744 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:28.861744 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:28.861744 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:28.861744 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:28.861744 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:28.861744 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:28.861744 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:28.861744 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:28.861744 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:28.861744 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:28.861744 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:28.862567 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:28.862567 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:28.862567 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:28.862567 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 251/507] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:28.862782 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb3926-fbb1-4dbd-864c-b8d4b25d703a None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:28.882535 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e68f95-b78d-4c93-9a26-55869b7227c4 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:28.905439 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:28.917822 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1e350-6d54-4f72-b109-e6a4880397ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:28.918456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1e350-6d54-4f72-b109-e6a4880397ed None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:28.918731 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1e350-6d54-4f72-b109-e6a4880397ed None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:28.919001 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1e350-6d54-4f72-b109-e6a4880397ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:28.928745 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1e350-6d54-4f72-b109-e6a4880397ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:28.930246 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1e350-6d54-4f72-b109-e6a4880397ed None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:28.944539 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-03e1e350-6d54-4f72-b109-e6a4880397ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:28.944539 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:28.944539 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:28.944539 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:28.944539 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:28.944539 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:28.944539 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:28.944539 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:28.944539 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:28.944539 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:28.944539 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:28.944539 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:28.944539 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:28.944539 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:28.944539 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:28.944539 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:28.945590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:28.945590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:28.945590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:28.945590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:28.945590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:28.945590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:28.945590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:28.945590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:28.945590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:28.945590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:28.945590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:28.945590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:28.945590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:28.945590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:28.945590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:28.945590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:28.945590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:28.946524 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:28.946524 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:28.946524 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:28.946524 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 257/508] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:28.946524 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1e350-6d54-4f72-b109-e6a4880397ed None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:28.965352 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:28.966353 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb3926-fbb1-4dbd-864c-b8d4b25d703a None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:28.999140 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81f02f-a966-4036-a52e-dfbc65574d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:28.999730 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81f02f-a966-4036-a52e-dfbc65574d10 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:29.000003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81f02f-a966-4036-a52e-dfbc65574d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:29.000272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81f02f-a966-4036-a52e-dfbc65574d10 None admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:29.000957 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81f02f-a966-4036-a52e-dfbc65574d10 None admin] RBAC: Adding query filter params (name=service) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:29.001286 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81f02f-a966-4036-a52e-dfbc65574d10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:29.002644 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81f02f-a966-4036-a52e-dfbc65574d10 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:29.011236 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 252/509] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Sep 26 17:42:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:29.012241 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81f02f-a966-4036-a52e-dfbc65574d10 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:29.045963 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1e350-6d54-4f72-b109-e6a4880397ed None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:29.079823 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1d8b1-0f26-4978-a528-ba0f91629596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:29.080426 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1d8b1-0f26-4978-a528-ba0f91629596 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:29.080704 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1d8b1-0f26-4978-a528-ba0f91629596 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:29.080975 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1d8b1-0f26-4978-a528-ba0f91629596 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:29.110624 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81f02f-a966-4036-a52e-dfbc65574d10 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:29.112127 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:29.144918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194319e3-7ce6-4790-93de-d834dbcacbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:29.145560 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194319e3-7ce6-4790-93de-d834dbcacbbb None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:29.145832 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194319e3-7ce6-4790-93de-d834dbcacbbb None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:29.146099 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194319e3-7ce6-4790-93de-d834dbcacbbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:29.147325 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db1d8b1-0f26-4978-a528-ba0f91629596 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:29.149392 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db1d8b1-0f26-4978-a528-ba0f91629596 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:29.156327 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194319e3-7ce6-4790-93de-d834dbcacbbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:29.157798 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194319e3-7ce6-4790-93de-d834dbcacbbb None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:29.168234 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:29.171742 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-194319e3-7ce6-4790-93de-d834dbcacbbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:29.171742 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:29.171742 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:29.171742 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:29.171742 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:29.171742 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:29.171742 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:29.171742 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:29.171742 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:29.171742 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:29.171742 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:29.171742 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:29.171742 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:29.171742 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:29.171742 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:29.171742 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:29.172796 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:29.172796 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:29.172796 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:29.172796 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:29.172796 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:29.172796 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:29.172796 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:29.172796 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:29.172796 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:29.172796 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:29.172796 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:29.172796 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:29.172796 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:29.172796 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:29.172796 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:29.172796 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:29.172796 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:29.173755 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:29.173755 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:29.173755 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:29.173755 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 253/510] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:29.174011 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194319e3-7ce6-4790-93de-d834dbcacbbb None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:29.257027 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 258/511] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:42:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 17:42:29.258308 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1d8b1-0f26-4978-a528-ba0f91629596 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:29.278464 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194319e3-7ce6-4790-93de-d834dbcacbbb None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:29.314020 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e27c8-d9e2-4a89-af4a-421526e288ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:29.314657 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e27c8-d9e2-4a89-af4a-421526e288ff None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:29.314917 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e27c8-d9e2-4a89-af4a-421526e288ff None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:29.315185 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e27c8-d9e2-4a89-af4a-421526e288ff None admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:29.315821 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e27c8-d9e2-4a89-af4a-421526e288ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:29.316118 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e27c8-d9e2-4a89-af4a-421526e288ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:29.317623 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e27c8-d9e2-4a89-af4a-421526e288ff None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:29.329711 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 254/512] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:29.330502 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e27c8-d9e2-4a89-af4a-421526e288ff None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:29.345992 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:29.359913 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1d8b1-0f26-4978-a528-ba0f91629596 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:29.377546 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:29.395773 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f15c8a-76e2-4869-a2b4-e64168dedd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:29.396380 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f15c8a-76e2-4869-a2b4-e64168dedd65 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:29.396650 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f15c8a-76e2-4869-a2b4-e64168dedd65 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:29.396914 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f15c8a-76e2-4869-a2b4-e64168dedd65 None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:29.397581 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f15c8a-76e2-4869-a2b4-e64168dedd65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:29.397934 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f15c8a-76e2-4869-a2b4-e64168dedd65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:29.399289 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f15c8a-76e2-4869-a2b4-e64168dedd65 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:29.415739 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 259/513] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:29.415739 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f15c8a-76e2-4869-a2b4-e64168dedd65 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:29.434117 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e27c8-d9e2-4a89-af4a-421526e288ff None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:29.467410 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d6e40-6c28-4771-9d3f-e9d41d28c334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:29.468039 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d6e40-6c28-4771-9d3f-e9d41d28c334 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:29.468320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d6e40-6c28-4771-9d3f-e9d41d28c334 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:29.468596 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d6e40-6c28-4771-9d3f-e9d41d28c334 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:29.478985 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d6e40-6c28-4771-9d3f-e9d41d28c334 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:29.480444 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d6e40-6c28-4771-9d3f-e9d41d28c334 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:29.496344 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-e84d6e40-6c28-4771-9d3f-e9d41d28c334 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:29.496344 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:29.496344 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:29.496344 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:29.496344 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:29.496344 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:29.496344 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:29.496344 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:29.496344 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:29.496344 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:29.496344 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:29.496344 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:29.496344 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:29.496344 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:29.496344 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:29.496344 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:29.497453 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:29.497453 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:29.497453 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:29.497453 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:29.497453 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:29.497453 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:29.497453 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:29.497453 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:29.497453 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:29.497453 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:29.497453 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:29.497453 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:29.497453 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:29.497453 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:29.497453 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:29.497453 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:29.497453 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:29.503159 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:29.503159 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:29.503159 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:29.503159 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 255/514] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:29.503159 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d6e40-6c28-4771-9d3f-e9d41d28c334 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:29.510011 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f15c8a-76e2-4869-a2b4-e64168dedd65 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:29.542945 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e8f01-ac23-41ea-a3ca-a59e666fad06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:29.543543 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e8f01-ac23-41ea-a3ca-a59e666fad06 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:29.543819 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e8f01-ac23-41ea-a3ca-a59e666fad06 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:29.544088 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e8f01-ac23-41ea-a3ca-a59e666fad06 None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:29.544713 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e8f01-ac23-41ea-a3ca-a59e666fad06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:29.545038 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e8f01-ac23-41ea-a3ca-a59e666fad06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:29.546384 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e8f01-ac23-41ea-a3ca-a59e666fad06 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:29.558126 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 260/515] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:29.558906 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e8f01-ac23-41ea-a3ca-a59e666fad06 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:29.567106 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:29.602062 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d6e40-6c28-4771-9d3f-e9d41d28c334 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:29.602465 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:29.637523 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbce516-63d2-47a0-bc78-ea904fe2ce5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:29.638259 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbce516-63d2-47a0-bc78-ea904fe2ce5e None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:29.638534 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbce516-63d2-47a0-bc78-ea904fe2ce5e None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:29.638807 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbce516-63d2-47a0-bc78-ea904fe2ce5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:29.650434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbce516-63d2-47a0-bc78-ea904fe2ce5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:29.651899 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbce516-63d2-47a0-bc78-ea904fe2ce5e None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:29.666898 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-9dbce516-63d2-47a0-bc78-ea904fe2ce5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:29.666898 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:29.666898 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:29.666898 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:29.666898 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:29.666898 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:29.666898 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:29.666898 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:29.666898 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:29.666898 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:29.666898 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:29.666898 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:29.666898 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:29.666898 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:29.666898 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:29.666898 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:29.667990 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:29.667990 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:29.667990 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:29.667990 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:29.667990 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:29.667990 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:29.667990 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:29.667990 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:29.667990 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:29.667990 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:29.667990 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:29.667990 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:29.667990 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:29.667990 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:29.667990 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:29.667990 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:29.667990 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:29.668877 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:29.668877 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:29.668877 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:29.669070 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e8f01-ac23-41ea-a3ca-a59e666fad06 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:29.669145 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 256/516] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:29.669145 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbce516-63d2-47a0-bc78-ea904fe2ce5e None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:29.705920 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c123336c-baaf-4442-b900-7a699b2566a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:29.706527 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123336c-baaf-4442-b900-7a699b2566a9 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:29.706808 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123336c-baaf-4442-b900-7a699b2566a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:29.707074 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123336c-baaf-4442-b900-7a699b2566a9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:29.714048 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c123336c-baaf-4442-b900-7a699b2566a9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:29.715497 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c123336c-baaf-4442-b900-7a699b2566a9 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:29.726717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-c123336c-baaf-4442-b900-7a699b2566a9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 17:42:29.726717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:29.726717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:29.726717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:29.726717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:29.726717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:29.726717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:29.726717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:29.726717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:29.726717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:29.726717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:29.726717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:29.726717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 17:42:29.726717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 17:42:29.726717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 17:42:29.726717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 17:42:29.727819 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:29.727819 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:29.727819 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 17:42:29.727819 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:42:29.727819 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 17:42:29.727819 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:42:29.727819 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:29.727819 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:29.727819 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:29.727819 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:29.727819 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:29.727819 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:29.727819 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:29.727819 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:29.727819 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:29.727819 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:29.727819 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:29.727819 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:29.728704 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:29.728704 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:29.728704 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 17:42:29.728704 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 17:42:29.728704 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 17:42:29.728704 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 17:42:29.728704 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 17:42:29.728704 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 17:42:29.728704 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 17:42:29.728704 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:29.728704 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 261/517] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:42:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:29.728704 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c123336c-baaf-4442-b900-7a699b2566a9 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:29.775695 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbce516-63d2-47a0-bc78-ea904fe2ce5e None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:29.792305 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:29.809238 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7574c8-91f4-42ca-b3b6-5e7a3f8003da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:29.809857 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7574c8-91f4-42ca-b3b6-5e7a3f8003da None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:29.810133 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7574c8-91f4-42ca-b3b6-5e7a3f8003da None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:29.810398 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7574c8-91f4-42ca-b3b6-5e7a3f8003da None admin] PATH_INFO: `/v3/projects/service` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:29.816802 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7574c8-91f4-42ca-b3b6-5e7a3f8003da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:29.818278 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7574c8-91f4-42ca-b3b6-5e7a3f8003da None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:29.827559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:29.831088 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c123336c-baaf-4442-b900-7a699b2566a9 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:29.834126 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-bb7574c8-91f4-42ca-b3b6-5e7a3f8003da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:42:29.834126 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:29.834126 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:29.834126 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:29.834126 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:29.834126 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:29.834126 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:29.834126 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:29.834126 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:29.834126 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:29.834126 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:29.834126 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:29.834126 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 17:42:29.834126 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 17:42:29.834126 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 17:42:29.835139 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 17:42:29.835139 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:29.835139 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:29.835139 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:29.835139 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:29.835139 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:29.835139 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:29.835139 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:29.835139 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:29.835139 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:29.835139 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:29.835139 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:29.835139 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:29.835139 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:29.835139 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:29.835139 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:29.835139 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:29.836213 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 17:42:29.836213 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 17:42:29.836213 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 17:42:29.836213 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 17:42:29.836213 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 17:42:29.836213 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 17:42:29.836213 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:42:29.836213 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:29.836213 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 257/518] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:42:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:29.836213 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7574c8-91f4-42ca-b3b6-5e7a3f8003da None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:29.869542 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0abebb-6101-4ed7-9eaa-923f0efad29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:29.870199 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0abebb-6101-4ed7-9eaa-923f0efad29d None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:29.870483 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0abebb-6101-4ed7-9eaa-923f0efad29d None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:29.870752 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0abebb-6101-4ed7-9eaa-923f0efad29d None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:29.871414 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0abebb-6101-4ed7-9eaa-923f0efad29d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:29.871716 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0abebb-6101-4ed7-9eaa-923f0efad29d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:29.873148 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0abebb-6101-4ed7-9eaa-923f0efad29d None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:29.885817 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 262/519] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:29.886614 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0abebb-6101-4ed7-9eaa-923f0efad29d None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:29.940650 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7574c8-91f4-42ca-b3b6-5e7a3f8003da None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:29.977464 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213165b-ba75-4946-bcbc-a503e7bb08a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:29.978072 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213165b-ba75-4946-bcbc-a503e7bb08a5 None admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:29.978351 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213165b-ba75-4946-bcbc-a503e7bb08a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:29.978626 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213165b-ba75-4946-bcbc-a503e7bb08a5 None admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:29.979272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f213165b-ba75-4946-bcbc-a503e7bb08a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:29.980722 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f213165b-ba75-4946-bcbc-a503e7bb08a5 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:29.984146 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0abebb-6101-4ed7-9eaa-923f0efad29d None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:30.003067 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 258/520] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Sep 26 17:42:29 2022] POST /identity/v3/users => generated 247 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:42:30.003898 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213165b-ba75-4946-bcbc-a503e7bb08a5 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:30.022710 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4b751-63c6-46aa-bb37-2d48e78913de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:30.023409 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4b751-63c6-46aa-bb37-2d48e78913de None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:30.023687 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4b751-63c6-46aa-bb37-2d48e78913de None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:30.023956 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4b751-63c6-46aa-bb37-2d48e78913de None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:30.024964 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4b751-63c6-46aa-bb37-2d48e78913de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:30.025302 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4b751-63c6-46aa-bb37-2d48e78913de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:30.026779 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4b751-63c6-46aa-bb37-2d48e78913de None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:30.045375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 263/521] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:30.045375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4b751-63c6-46aa-bb37-2d48e78913de None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:30.051180 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:30.066677 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:30.129298 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213165b-ba75-4946-bcbc-a503e7bb08a5 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:30.158565 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4b751-63c6-46aa-bb37-2d48e78913de None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:30.167011 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c492b33-1a8c-48f3-a167-2774243bb32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:30.167655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c492b33-1a8c-48f3-a167-2774243bb32f None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:30.167934 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c492b33-1a8c-48f3-a167-2774243bb32f None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:30.168206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c492b33-1a8c-48f3-a167-2774243bb32f None admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:30.168933 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c492b33-1a8c-48f3-a167-2774243bb32f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:30.169272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c492b33-1a8c-48f3-a167-2774243bb32f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:30.170715 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c492b33-1a8c-48f3-a167-2774243bb32f None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:30.203886 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc6073-8b8b-4715-9358-87b735e2d4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:30.204495 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc6073-8b8b-4715-9358-87b735e2d4dd None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:30.204778 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc6073-8b8b-4715-9358-87b735e2d4dd None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:30.205119 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc6073-8b8b-4715-9358-87b735e2d4dd None admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:30.205813 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc6073-8b8b-4715-9358-87b735e2d4dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:30.206122 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc6073-8b8b-4715-9358-87b735e2d4dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:30.208168 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc6073-8b8b-4715-9358-87b735e2d4dd None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:30.210680 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 259/522] 10.222.0.62 () {56 vars in 1137 bytes} [Mon Sep 26 17:42:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:30.211426 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c492b33-1a8c-48f3-a167-2774243bb32f None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:30.230116 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 264/523] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Sep 26 17:42:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:30.231281 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc6073-8b8b-4715-9358-87b735e2d4dd None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:30.315890 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:30.317479 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:30.328090 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c492b33-1a8c-48f3-a167-2774243bb32f None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:30.341468 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc6073-8b8b-4715-9358-87b735e2d4dd None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:30.364744 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848c358-05e2-4e44-a048-d5f090121f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:30.365693 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848c358-05e2-4e44-a048-d5f090121f03 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:30.366130 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848c358-05e2-4e44-a048-d5f090121f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:30.366404 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848c358-05e2-4e44-a048-d5f090121f03 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:30.374677 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848c358-05e2-4e44-a048-d5f090121f03 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:30.376150 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848c358-05e2-4e44-a048-d5f090121f03 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:30.376362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb27039-da42-468a-bbe3-8ddbb09482c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:30.379655 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb27039-da42-468a-bbe3-8ddbb09482c1 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:30.379655 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb27039-da42-468a-bbe3-8ddbb09482c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:30.379655 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb27039-da42-468a-bbe3-8ddbb09482c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:30.384564 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb27039-da42-468a-bbe3-8ddbb09482c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:30.386053 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb27039-da42-468a-bbe3-8ddbb09482c1 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:30.391624 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-8848c358-05e2-4e44-a048-d5f090121f03 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 26 17:42:30.391624 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:30.391624 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:30.391624 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:30.391624 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:30.391624 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:30.391624 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:30.391624 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:30.391624 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:30.391624 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:30.391624 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:30.391624 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:30.391624 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 17:42:30.391624 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 17:42:30.391624 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 17:42:30.391624 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 17:42:30.392527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:30.392527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:30.392527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 17:42:30.392527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:42:30.392527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 17:42:30.392527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:42:30.392527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:30.392527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:30.392527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:30.392527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:30.392527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:30.392527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:30.392527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:30.392527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:30.392527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:30.392527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:30.392527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:30.392527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:30.393466 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:30.393466 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:30.393466 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 17:42:30.393466 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 17:42:30.393466 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 17:42:30.393466 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 17:42:30.393466 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 17:42:30.393466 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 17:42:30.393466 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 26 17:42:30.393466 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:30.397453 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 260/524] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Sep 26 17:42:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:30.398836 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848c358-05e2-4e44-a048-d5f090121f03 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:30.401266 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-4bb27039-da42-468a-bbe3-8ddbb09482c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:42:30.401266 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:30.401266 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:30.401266 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:30.401266 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:30.401266 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:30.401266 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:30.401266 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:30.401266 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:30.401266 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:30.401266 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:30.401266 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:30.401266 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 17:42:30.401266 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 17:42:30.401266 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 17:42:30.402090 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 17:42:30.402090 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:30.402090 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:30.402090 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:30.402090 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:30.402090 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:30.402090 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:30.402090 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:30.402090 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:30.402090 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:30.402090 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:30.402090 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:30.402090 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:30.402090 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:30.402090 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:30.402090 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:30.402090 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:30.402909 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 17:42:30.402909 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 17:42:30.402909 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 17:42:30.402909 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 17:42:30.402909 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 17:42:30.402909 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 17:42:30.402909 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:42:30.402909 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:30.402909 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 265/525] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:42:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:30.403487 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb27039-da42-468a-bbe3-8ddbb09482c1 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:30.509490 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848c358-05e2-4e44-a048-d5f090121f03 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:30.516508 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb27039-da42-468a-bbe3-8ddbb09482c1 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:30.549467 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8eb26b-8495-4aab-9b8a-377af252711f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:30.550141 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8eb26b-8495-4aab-9b8a-377af252711f None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:30.550468 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8eb26b-8495-4aab-9b8a-377af252711f None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:30.550736 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8eb26b-8495-4aab-9b8a-377af252711f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:30.554501 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20588cde-c3ed-42bb-8702-fda8ba715c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:30.555110 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20588cde-c3ed-42bb-8702-fda8ba715c87 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:30.555389 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20588cde-c3ed-42bb-8702-fda8ba715c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:30.555660 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20588cde-c3ed-42bb-8702-fda8ba715c87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:30.556379 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20588cde-c3ed-42bb-8702-fda8ba715c87 None admin] RBAC: Adding query filter params (role.id=4685fd1f2f284d4498281231160a5f27, scope.project.id=125361b23eb14b53aca5e0139919881e, user.id=1792e79b9c9a47e1923f19bfd2cd495b) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:30.556686 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20588cde-c3ed-42bb-8702-fda8ba715c87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:30.558158 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20588cde-c3ed-42bb-8702-fda8ba715c87 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:30.564569 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 266/526] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:42:30 2022] GET /identity/v3/role_assignments?user.id=1792e79b9c9a47e1923f19bfd2cd495b&scope.project.id=125361b23eb14b53aca5e0139919881e&role.id=4685fd1f2f284d4498281231160a5f27 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:30.565734 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20588cde-c3ed-42bb-8702-fda8ba715c87 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:30.576435 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:30.585998 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:30.655082 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8eb26b-8495-4aab-9b8a-377af252711f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:30.656601 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8eb26b-8495-4aab-9b8a-377af252711f None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:30.699024 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20588cde-c3ed-42bb-8702-fda8ba715c87 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:30.739149 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88200c9-d844-4a6e-9121-262c7726989d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:30.740611 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88200c9-d844-4a6e-9121-262c7726989d None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:30.741343 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88200c9-d844-4a6e-9121-262c7726989d None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:30.742399 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88200c9-d844-4a6e-9121-262c7726989d None admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:30.743396 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88200c9-d844-4a6e-9121-262c7726989d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:30.743909 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88200c9-d844-4a6e-9121-262c7726989d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:30.745647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88200c9-d844-4a6e-9121-262c7726989d None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:30.773041 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 267/527] 10.222.0.62 () {56 vars in 1139 bytes} [Mon Sep 26 17:42:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:30.773041 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88200c9-d844-4a6e-9121-262c7726989d None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:30.777936 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 261/528] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:42:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 17:42:30.783310 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8eb26b-8495-4aab-9b8a-377af252711f None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:30.838303 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:30.852980 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:30.892290 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8eb26b-8495-4aab-9b8a-377af252711f None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:30.903095 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88200c9-d844-4a6e-9121-262c7726989d None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:30.930229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4383ec5-8758-4eaa-bc56-5f4c802362b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:30.931172 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4383ec5-8758-4eaa-bc56-5f4c802362b5 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:30.931599 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4383ec5-8758-4eaa-bc56-5f4c802362b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:30.932014 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4383ec5-8758-4eaa-bc56-5f4c802362b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:30.944476 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4383ec5-8758-4eaa-bc56-5f4c802362b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:30.946737 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4383ec5-8758-4eaa-bc56-5f4c802362b5 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:30.948194 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7e5bb-0701-419f-b5cb-475e2a0f30db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:30.948813 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7e5bb-0701-419f-b5cb-475e2a0f30db None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:30.949113 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7e5bb-0701-419f-b5cb-475e2a0f30db None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:30.949591 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7e5bb-0701-419f-b5cb-475e2a0f30db None admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:30.950289 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7e5bb-0701-419f-b5cb-475e2a0f30db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:30.950968 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7e5bb-0701-419f-b5cb-475e2a0f30db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:30.952659 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7e5bb-0701-419f-b5cb-475e2a0f30db None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:30.964590 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-f4383ec5-8758-4eaa-bc56-5f4c802362b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:30.964590 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:30.964590 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:30.964590 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:30.964590 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:30.964590 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:30.964590 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:30.964590 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:30.964590 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:30.964590 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:30.964590 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:30.964590 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:30.964590 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:30.964590 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:30.964590 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:30.964590 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:30.965767 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:30.965767 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:30.965767 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:30.965767 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:30.965767 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:30.965767 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:30.965767 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:30.965767 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:30.965767 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:30.965767 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:30.965767 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:30.965767 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:30.965767 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:30.965767 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:30.965767 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:30.965767 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:30.965767 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:30.966634 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:30.966634 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:30.966634 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:30.966796 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 268/529] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Sep 26 17:42:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:30.967144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7e5bb-0701-419f-b5cb-475e2a0f30db None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:30.972944 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 262/530] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:42:30.974070 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4383ec5-8758-4eaa-bc56-5f4c802362b5 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:31.085854 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7e5bb-0701-419f-b5cb-475e2a0f30db None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:31.097500 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4383ec5-8758-4eaa-bc56-5f4c802362b5 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:31.100593 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:31.109763 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:31.125420 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a918706-b0dd-40c6-8fcc-c30e3530a140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:31.126337 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a918706-b0dd-40c6-8fcc-c30e3530a140 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:31.126814 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a918706-b0dd-40c6-8fcc-c30e3530a140 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:31.127275 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a918706-b0dd-40c6-8fcc-c30e3530a140 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:31.140872 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca16857-9db0-473c-939e-d7ee8af589c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:31.141529 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca16857-9db0-473c-939e-d7ee8af589c4 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:31.141810 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca16857-9db0-473c-939e-d7ee8af589c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:31.142228 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca16857-9db0-473c-939e-d7ee8af589c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:31.143091 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca16857-9db0-473c-939e-d7ee8af589c4 None admin] RBAC: Adding query filter params (role.id=4685fd1f2f284d4498281231160a5f27, scope.project.id=125361b23eb14b53aca5e0139919881e, user.id=ab3b7ac09599477bb0c6c1d32e2d5dbe) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:31.143402 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca16857-9db0-473c-939e-d7ee8af589c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:31.145049 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca16857-9db0-473c-939e-d7ee8af589c4 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:31.152931 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 263/531] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:42:30 2022] GET /identity/v3/role_assignments?user.id=ab3b7ac09599477bb0c6c1d32e2d5dbe&scope.project.id=125361b23eb14b53aca5e0139919881e&role.id=4685fd1f2f284d4498281231160a5f27 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:31.153774 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca16857-9db0-473c-939e-d7ee8af589c4 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:31.271494 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a918706-b0dd-40c6-8fcc-c30e3530a140 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:31.273951 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a918706-b0dd-40c6-8fcc-c30e3530a140 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:31.365738 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca16857-9db0-473c-939e-d7ee8af589c4 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:31.433837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611f0a7-8ced-40fc-b3fe-967f1d392b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:31.434445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611f0a7-8ced-40fc-b3fe-967f1d392b3e None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:31.434726 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611f0a7-8ced-40fc-b3fe-967f1d392b3e None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:31.434997 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611f0a7-8ced-40fc-b3fe-967f1d392b3e None admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:31.435646 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4611f0a7-8ced-40fc-b3fe-967f1d392b3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:31.435945 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4611f0a7-8ced-40fc-b3fe-967f1d392b3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:31.437340 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4611f0a7-8ced-40fc-b3fe-967f1d392b3e None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:31.452415 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 269/532] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:42:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 17:42:31.462816 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 264/533] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:31.464240 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a918706-b0dd-40c6-8fcc-c30e3530a140 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:31.472959 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611f0a7-8ced-40fc-b3fe-967f1d392b3e None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:31.499730 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:31.550484 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:31.612171 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a918706-b0dd-40c6-8fcc-c30e3530a140 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:31.676361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9675d44-682e-4961-835c-d0c256fff3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:31.677124 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9675d44-682e-4961-835c-d0c256fff3be None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:31.678279 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9675d44-682e-4961-835c-d0c256fff3be None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:31.678560 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9675d44-682e-4961-835c-d0c256fff3be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:31.695241 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611f0a7-8ced-40fc-b3fe-967f1d392b3e None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:31.699400 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9675d44-682e-4961-835c-d0c256fff3be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:31.700880 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9675d44-682e-4961-835c-d0c256fff3be None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:31.716582 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-e9675d44-682e-4961-835c-d0c256fff3be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:31.716582 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:31.716582 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:31.716582 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:31.716582 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:31.716582 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:31.716582 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:31.716582 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:31.716582 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:31.716582 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:31.716582 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:31.716582 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:31.716582 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:31.716582 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:31.716582 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:31.716582 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:31.717571 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:31.717571 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:31.717571 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:31.717571 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:31.717571 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:31.717571 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:31.717571 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:31.717571 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:31.717571 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:31.717571 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:31.717571 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:31.717571 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:31.717571 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:31.717571 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:31.717571 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:31.717571 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:31.717571 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:31.718398 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:31.718398 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:31.718398 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:31.718398 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 270/534] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:31.730595 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9675d44-682e-4961-835c-d0c256fff3be None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:31.749596 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a944be9-8f16-444c-a07d-b37b87637ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:31.750280 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a944be9-8f16-444c-a07d-b37b87637ce3 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:31.750558 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a944be9-8f16-444c-a07d-b37b87637ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:31.750880 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a944be9-8f16-444c-a07d-b37b87637ce3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:31.759150 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a944be9-8f16-444c-a07d-b37b87637ce3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:31.760604 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a944be9-8f16-444c-a07d-b37b87637ce3 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:31.772386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-1a944be9-8f16-444c-a07d-b37b87637ce3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:42:31.772386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:31.772386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:31.772386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:31.772386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:31.772386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:31.772386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:31.772386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:31.772386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:31.772386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:31.772386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:31.772386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:31.772386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 17:42:31.772386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 17:42:31.772386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 17:42:31.773384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 17:42:31.773384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:31.773384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:31.773384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:31.773384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:31.773384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:31.773384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:31.773384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:31.773384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:31.773384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:31.773384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:31.773384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:31.773384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:31.773384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:31.773384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:31.773384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:31.773384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:31.774212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 17:42:31.774212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 17:42:31.774212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 17:42:31.774212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 17:42:31.774212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 17:42:31.774212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 17:42:31.774212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:42:31.774212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:31.774212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 265/535] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:42:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:31.779511 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a944be9-8f16-444c-a07d-b37b87637ce3 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:31.848471 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:31.889483 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9675d44-682e-4961-835c-d0c256fff3be None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:31.929792 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4e691-47ab-44c1-94c8-1cb7ab86f532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:31.931292 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4e691-47ab-44c1-94c8-1cb7ab86f532 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:31.931723 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4e691-47ab-44c1-94c8-1cb7ab86f532 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:31.932310 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4e691-47ab-44c1-94c8-1cb7ab86f532 None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:31.933135 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a4e691-47ab-44c1-94c8-1cb7ab86f532 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:31.933587 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a4e691-47ab-44c1-94c8-1cb7ab86f532 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:31.935129 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a4e691-47ab-44c1-94c8-1cb7ab86f532 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:31.964182 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 271/536] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:42:31.973175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4e691-47ab-44c1-94c8-1cb7ab86f532 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:31.976826 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:32.001236 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a944be9-8f16-444c-a07d-b37b87637ce3 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:32.064038 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f2885-1020-4cab-a2f1-6368be9be2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:32.064651 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f2885-1020-4cab-a2f1-6368be9be2b4 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:32.064930 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f2885-1020-4cab-a2f1-6368be9be2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:32.065227 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f2885-1020-4cab-a2f1-6368be9be2b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:32.065928 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f2885-1020-4cab-a2f1-6368be9be2b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:32.066234 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f2885-1020-4cab-a2f1-6368be9be2b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:32.071509 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f2885-1020-4cab-a2f1-6368be9be2b4 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:32.105492 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 266/537] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Sep 26 17:42:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:42:32.111995 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f2885-1020-4cab-a2f1-6368be9be2b4 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:32.155367 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4e691-47ab-44c1-94c8-1cb7ab86f532 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:32.214687 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:32.221737 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe47be-0943-4e5c-bf15-03caa7e45b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:32.222378 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe47be-0943-4e5c-bf15-03caa7e45b73 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:32.222655 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe47be-0943-4e5c-bf15-03caa7e45b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:32.222928 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe47be-0943-4e5c-bf15-03caa7e45b73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:32.236067 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe47be-0943-4e5c-bf15-03caa7e45b73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:32.237538 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe47be-0943-4e5c-bf15-03caa7e45b73 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:32.262717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-90fe47be-0943-4e5c-bf15-03caa7e45b73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:42:32.262717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:32.262717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:32.262717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:32.262717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:32.262717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:32.262717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:32.262717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:32.262717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:32.262717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:32.262717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:32.262717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:32.262717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 17:42:32.262717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 17:42:32.262717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 17:42:32.263612 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 17:42:32.263612 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:32.263612 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:32.263612 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:32.263612 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:32.263612 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:32.263612 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:32.263612 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:32.263612 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:32.263612 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:32.263612 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:32.263612 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:32.263612 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:32.263612 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:32.263612 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:32.263612 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:32.263612 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:32.264442 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 17:42:32.264442 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 17:42:32.264442 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 17:42:32.264442 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 17:42:32.264442 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 17:42:32.264442 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 17:42:32.264442 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:42:32.264442 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:32.264442 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 272/538] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:42:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:32.273025 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe47be-0943-4e5c-bf15-03caa7e45b73 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:32.303798 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f2885-1020-4cab-a2f1-6368be9be2b4 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:32.353530 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef277ed0-8187-4aa8-8487-901621d7ddf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:32.354573 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef277ed0-8187-4aa8-8487-901621d7ddf5 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:32.354854 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef277ed0-8187-4aa8-8487-901621d7ddf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:32.355125 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef277ed0-8187-4aa8-8487-901621d7ddf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:32.356126 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef277ed0-8187-4aa8-8487-901621d7ddf5 None admin] RBAC: Adding query filter params (role.id=4685fd1f2f284d4498281231160a5f27, scope.project.id=125361b23eb14b53aca5e0139919881e, user.id=14b32df88c21499d9ca81e439b129431) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:32.356435 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef277ed0-8187-4aa8-8487-901621d7ddf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:32.358188 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef277ed0-8187-4aa8-8487-901621d7ddf5 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:32.366521 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 267/539] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:42:32 2022] GET /identity/v3/role_assignments?user.id=14b32df88c21499d9ca81e439b129431&scope.project.id=125361b23eb14b53aca5e0139919881e&role.id=4685fd1f2f284d4498281231160a5f27 => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:32.368035 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d709f2-e561-4134-b3df-32161d22fe8c None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:32.368327 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d709f2-e561-4134-b3df-32161d22fe8c None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:32.368647 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d709f2-e561-4134-b3df-32161d22fe8c None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:32.370366 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 268/540] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:32.376198 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38003273-7b20-4a00-b686-1492c988bba8 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:32.376543 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38003273-7b20-4a00-b686-1492c988bba8 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:32.376747 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38003273-7b20-4a00-b686-1492c988bba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:32.396635 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-38003273-7b20-4a00-b686-1492c988bba8 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:32.398049 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-38003273-7b20-4a00-b686-1492c988bba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:32.406720 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:32.427022 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe47be-0943-4e5c-bf15-03caa7e45b73 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:32.473201 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a38fc9-cafc-4fa7-80f9-a1270a3f685c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:32.474187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a38fc9-cafc-4fa7-80f9-a1270a3f685c None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:32.474694 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a38fc9-cafc-4fa7-80f9-a1270a3f685c None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:32.475174 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a38fc9-cafc-4fa7-80f9-a1270a3f685c None admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:32.476671 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a38fc9-cafc-4fa7-80f9-a1270a3f685c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:32.477219 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a38fc9-cafc-4fa7-80f9-a1270a3f685c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:32.479199 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a38fc9-cafc-4fa7-80f9-a1270a3f685c None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:32.479944 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 269/541] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 17:42:32.494420 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 273/542] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Sep 26 17:42:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:32.502865 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38003273-7b20-4a00-b686-1492c988bba8 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:32.648393 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38003273-7b20-4a00-b686-1492c988bba8 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:32.687387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e7a75-a337-4609-a02b-f6e826cbb406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:32.688356 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e7a75-a337-4609-a02b-f6e826cbb406 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:32.688838 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e7a75-a337-4609-a02b-f6e826cbb406 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:32.689431 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e7a75-a337-4609-a02b-f6e826cbb406 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:32.690360 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e7a75-a337-4609-a02b-f6e826cbb406 None admin] RBAC: Adding query filter params (role.id=4685fd1f2f284d4498281231160a5f27, scope.project.id=125361b23eb14b53aca5e0139919881e, user.id=a0ed50f4edcf468192a053b1e0fd6910) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:32.690870 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e7a75-a337-4609-a02b-f6e826cbb406 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:32.692897 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e7a75-a337-4609-a02b-f6e826cbb406 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:32.699783 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 270/543] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:42:32 2022] GET /identity/v3/role_assignments?user.id=a0ed50f4edcf468192a053b1e0fd6910&scope.project.id=125361b23eb14b53aca5e0139919881e&role.id=4685fd1f2f284d4498281231160a5f27 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:32.824556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a38fc9-cafc-4fa7-80f9-a1270a3f685c None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:32.884775 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:32.937625 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a38fc9-cafc-4fa7-80f9-a1270a3f685c None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:32.983455 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81f3b4-ed69-4bb8-abd4-712c5d5ea6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:32.984475 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81f3b4-ed69-4bb8-abd4-712c5d5ea6bc None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:32.984990 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81f3b4-ed69-4bb8-abd4-712c5d5ea6bc None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:32.985489 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81f3b4-ed69-4bb8-abd4-712c5d5ea6bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:32.998747 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af81f3b4-ed69-4bb8-abd4-712c5d5ea6bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:42:33.004375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-af81f3b4-ed69-4bb8-abd4-712c5d5ea6bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:42:33.004375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:33.004375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:33.004375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:33.004375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:33.004375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:33.004375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:33.004375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:33.004375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:33.004375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:33.004375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:33.004375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:33.004375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:42:33.004375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:42:33.004375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:42:33.004375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:42:33.005418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:42:33.005418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:42:33.005418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:42:33.005418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:42:33.005418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:33.005418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:33.005418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:33.005418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:33.005418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:33.005418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:33.005418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:33.005418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:33.005418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:33.005418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:33.005418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:33.005418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:33.006193 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:33.006193 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:33.006193 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:33.006193 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:33.006193 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:42:33.006193 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:42:33.006193 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:42:33.006193 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:42:33.006193 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:42:33.006193 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:42:33.006193 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:42:33.006193 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:33.008881 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 274/544] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Sep 26 17:42:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:33.015581 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e7a75-a337-4609-a02b-f6e826cbb406 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:33.033106 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:33.161984 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e7a75-a337-4609-a02b-f6e826cbb406 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:33.215078 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29096a-3d50-493d-ae11-3af15940e3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:33.215687 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29096a-3d50-493d-ae11-3af15940e3c0 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:33.215970 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29096a-3d50-493d-ae11-3af15940e3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:33.216245 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29096a-3d50-493d-ae11-3af15940e3c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:33.216914 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de29096a-3d50-493d-ae11-3af15940e3c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:33.217252 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de29096a-3d50-493d-ae11-3af15940e3c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:33.218632 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de29096a-3d50-493d-ae11-3af15940e3c0 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:33.229110 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 271/545] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Sep 26 17:42:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:33.234478 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81f3b4-ed69-4bb8-abd4-712c5d5ea6bc None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:33.295060 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce115d-993b-46d4-8cb1-485f60db6714 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:33.295402 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce115d-993b-46d4-8cb1-485f60db6714 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:33.295674 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce115d-993b-46d4-8cb1-485f60db6714 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:33.297324 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 272/546] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:33.302508 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79dc58-b33f-455e-ab09-5ef6997298b3 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:33.302789 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79dc58-b33f-455e-ab09-5ef6997298b3 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:33.303057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79dc58-b33f-455e-ab09-5ef6997298b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:33.338042 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-1f79dc58-b33f-455e-ab09-5ef6997298b3 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:33.339237 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-1f79dc58-b33f-455e-ab09-5ef6997298b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:33.353816 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81f3b4-ed69-4bb8-abd4-712c5d5ea6bc None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:33.368218 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:33.396121 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46bc6c-ed20-4455-b8ec-8f846ada0ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:33.396760 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46bc6c-ed20-4455-b8ec-8f846ada0ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:33.397055 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46bc6c-ed20-4455-b8ec-8f846ada0ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:33.397333 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46bc6c-ed20-4455-b8ec-8f846ada0ff0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:33.420460 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46bc6c-ed20-4455-b8ec-8f846ada0ff0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:33.423969 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46bc6c-ed20-4455-b8ec-8f846ada0ff0 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:33.453304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-eb46bc6c-ed20-4455-b8ec-8f846ada0ff0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:33.453304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:33.453304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:33.453304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:33.453304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:33.453304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:33.453304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:33.453304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:33.453304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:33.453304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:33.453304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:33.453304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:33.453304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:33.453304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:33.453304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:33.453304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:33.454265 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:33.454265 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:33.454265 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:33.454265 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:33.454265 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:33.454265 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:33.454265 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:33.454265 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:33.454265 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:33.454265 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:33.454265 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:33.454265 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:33.454265 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:33.454265 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:33.454265 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:33.454265 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:33.454265 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:33.455107 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:33.455107 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:33.455107 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:33.457104 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 275/547] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:33.464309 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46bc6c-ed20-4455-b8ec-8f846ada0ff0 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:33.470083 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:33.481072 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 273/548] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 17:42:33.574344 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efe850-d053-40b9-9f6b-29b7fc7a323c None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:33.574665 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efe850-d053-40b9-9f6b-29b7fc7a323c None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:33.574908 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efe850-d053-40b9-9f6b-29b7fc7a323c None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:33.577570 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 274/549] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 17:42:33.587316 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bbafa-7929-4179-b24b-475dfe5ef01b None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:33.587609 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bbafa-7929-4179-b24b-475dfe5ef01b None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:33.587856 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bbafa-7929-4179-b24b-475dfe5ef01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:33.593208 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46bc6c-ed20-4455-b8ec-8f846ada0ff0 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:33.606397 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-2b6bbafa-7929-4179-b24b-475dfe5ef01b None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:33.607687 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-2b6bbafa-7929-4179-b24b-475dfe5ef01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:33.638960 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6d4f0-116d-41c9-89f5-888094b5460b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:33.639564 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6d4f0-116d-41c9-89f5-888094b5460b None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:33.639855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6d4f0-116d-41c9-89f5-888094b5460b None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:33.640105 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6d4f0-116d-41c9-89f5-888094b5460b None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:33.640747 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af6d4f0-116d-41c9-89f5-888094b5460b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:33.641063 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af6d4f0-116d-41c9-89f5-888094b5460b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:33.642429 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af6d4f0-116d-41c9-89f5-888094b5460b None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:33.669333 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 276/550] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:42:33.675140 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6d4f0-116d-41c9-89f5-888094b5460b None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:33.714864 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 275/551] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 17:42:33.732144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:33.844279 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6bbafa-7929-4179-b24b-475dfe5ef01b None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:33.869067 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6d4f0-116d-41c9-89f5-888094b5460b None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:33.930702 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfdf7fa-b5eb-4cd9-8c03-a0c41da2fef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:33.931769 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdf7fa-b5eb-4cd9-8c03-a0c41da2fef2 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:33.934743 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdf7fa-b5eb-4cd9-8c03-a0c41da2fef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:33.935175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdf7fa-b5eb-4cd9-8c03-a0c41da2fef2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:33.947220 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfdf7fa-b5eb-4cd9-8c03-a0c41da2fef2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:33.949074 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfdf7fa-b5eb-4cd9-8c03-a0c41da2fef2 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:33.974762 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-cdfdf7fa-b5eb-4cd9-8c03-a0c41da2fef2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 26 17:42:33.974762 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:33.974762 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:33.974762 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:33.974762 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:33.974762 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:33.974762 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:33.974762 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:33.974762 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:33.974762 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:33.974762 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:33.974762 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:33.974762 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 17:42:33.974762 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 17:42:33.974762 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 17:42:33.974762 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 17:42:33.976446 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:33.976446 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:33.976446 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 17:42:33.976446 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:42:33.976446 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 17:42:33.976446 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:42:33.976446 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:33.976446 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:33.976446 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:33.976446 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:33.976446 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:33.976446 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:33.976446 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:33.976446 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:33.976446 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:33.976446 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:33.976446 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:33.976446 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:33.978010 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:33.978010 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:33.978010 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 17:42:33.978010 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 17:42:33.978010 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 17:42:33.978010 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 17:42:33.978010 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 17:42:33.978010 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 17:42:33.978010 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 26 17:42:33.978010 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:33.978795 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 277/552] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Sep 26 17:42:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:42:33.985224 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfdf7fa-b5eb-4cd9-8c03-a0c41da2fef2 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:34.025975 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6bbafa-7929-4179-b24b-475dfe5ef01b None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:34.054806 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:34.062830 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d278e0-9398-4f31-b86b-e1214486bf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:34.063554 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d278e0-9398-4f31-b86b-e1214486bf35 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:34.063905 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d278e0-9398-4f31-b86b-e1214486bf35 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:34.064274 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d278e0-9398-4f31-b86b-e1214486bf35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:34.075182 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d278e0-9398-4f31-b86b-e1214486bf35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:42:34.080423 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-b3d278e0-9398-4f31-b86b-e1214486bf35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:42:34.080423 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:34.080423 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:34.080423 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:34.080423 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:34.080423 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:34.080423 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:34.080423 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:34.080423 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:34.080423 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:34.080423 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:34.080423 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:34.080423 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:42:34.080423 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:42:34.080423 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:42:34.080423 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:42:34.081525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:42:34.081525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:42:34.081525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:42:34.081525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:42:34.081525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:34.081525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:34.081525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:34.081525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:34.081525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:34.081525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:34.081525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:34.081525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:34.081525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:34.081525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:34.081525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:34.081525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:34.082333 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:34.082333 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:34.082333 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:34.082333 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:34.082333 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:42:34.082333 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:42:34.082333 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:42:34.082333 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:42:34.082333 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:42:34.082333 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:42:34.082333 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:42:34.082333 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:34.082333 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 276/553] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Sep 26 17:42:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:42:34.083023 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d278e0-9398-4f31-b86b-e1214486bf35 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:34.111058 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfdf7fa-b5eb-4cd9-8c03-a0c41da2fef2 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:34.126729 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:34.148729 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44e8b8-f41c-45cb-8aa4-df7bb97d438b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:34.149359 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44e8b8-f41c-45cb-8aa4-df7bb97d438b None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:34.149634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44e8b8-f41c-45cb-8aa4-df7bb97d438b None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:34.149903 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44e8b8-f41c-45cb-8aa4-df7bb97d438b None admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:34.150619 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44e8b8-f41c-45cb-8aa4-df7bb97d438b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:34.151020 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44e8b8-f41c-45cb-8aa4-df7bb97d438b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:34.152615 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44e8b8-f41c-45cb-8aa4-df7bb97d438b None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:34.170741 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 278/554] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Sep 26 17:42:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:34.171757 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44e8b8-f41c-45cb-8aa4-df7bb97d438b None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:34.187659 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d278e0-9398-4f31-b86b-e1214486bf35 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:34.224445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d52fc-9201-4a04-a14a-1449e95942ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:34.225275 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d52fc-9201-4a04-a14a-1449e95942ad None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:34.225651 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d52fc-9201-4a04-a14a-1449e95942ad None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:34.226053 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d52fc-9201-4a04-a14a-1449e95942ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:34.236496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d52fc-9201-4a04-a14a-1449e95942ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:42:34.242468 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-c56d52fc-9201-4a04-a14a-1449e95942ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:42:34.242468 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:34.242468 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:34.242468 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:34.242468 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:34.242468 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:34.242468 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:34.242468 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:34.242468 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:34.242468 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:34.242468 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:34.242468 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:34.242468 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:42:34.242468 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:42:34.242468 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:42:34.242468 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:42:34.243640 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:42:34.243640 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:42:34.243640 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:42:34.243640 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:42:34.243640 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:34.243640 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:34.243640 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:34.243640 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:34.243640 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:34.243640 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:34.243640 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:34.243640 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:34.243640 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:34.243640 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:34.243640 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:34.243640 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:34.244578 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:34.244578 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:34.244578 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:34.244578 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:34.244578 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:42:34.244578 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:42:34.244578 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:42:34.244578 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:42:34.244578 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:42:34.244578 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:42:34.244578 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:42:34.244578 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:34.246447 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 277/555] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Sep 26 17:42:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:34.247324 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d52fc-9201-4a04-a14a-1449e95942ad None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:34.275827 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44e8b8-f41c-45cb-8aa4-df7bb97d438b None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:34.297354 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:34.313948 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54281d36-c5da-46ae-b151-b1cb9fa3a328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:34.314769 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54281d36-c5da-46ae-b151-b1cb9fa3a328 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:34.315316 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54281d36-c5da-46ae-b151-b1cb9fa3a328 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:34.315721 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54281d36-c5da-46ae-b151-b1cb9fa3a328 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:34.316619 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54281d36-c5da-46ae-b151-b1cb9fa3a328 None admin] RBAC: Adding query filter params (name=service) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:34.317129 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54281d36-c5da-46ae-b151-b1cb9fa3a328 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:34.318691 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54281d36-c5da-46ae-b151-b1cb9fa3a328 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:34.328494 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 279/556] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Sep 26 17:42:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:34.329775 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54281d36-c5da-46ae-b151-b1cb9fa3a328 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:34.334864 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:34.359677 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d52fc-9201-4a04-a14a-1449e95942ad None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:34.401222 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be69256-2171-4d44-a558-694082531f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:34.401891 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be69256-2171-4d44-a558-694082531f63 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:34.402171 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be69256-2171-4d44-a558-694082531f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:34.402496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be69256-2171-4d44-a558-694082531f63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:34.440338 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54281d36-c5da-46ae-b151-b1cb9fa3a328 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:34.479079 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee4687-52c0-4375-9e1c-61a14abfdc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:34.480228 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee4687-52c0-4375-9e1c-61a14abfdc34 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:34.480757 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee4687-52c0-4375-9e1c-61a14abfdc34 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:34.481236 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee4687-52c0-4375-9e1c-61a14abfdc34 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:34.482089 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee4687-52c0-4375-9e1c-61a14abfdc34 None admin] RBAC: Adding query filter params (name=service) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:34.482572 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee4687-52c0-4375-9e1c-61a14abfdc34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:34.483064 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be69256-2171-4d44-a558-694082531f63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:34.484597 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be69256-2171-4d44-a558-694082531f63 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:34.485231 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee4687-52c0-4375-9e1c-61a14abfdc34 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:34.494636 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 280/557] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Sep 26 17:42:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:34.495999 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee4687-52c0-4375-9e1c-61a14abfdc34 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:34.543783 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:34.575460 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:34.618616 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 278/558] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:42:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 17:42:34.619750 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be69256-2171-4d44-a558-694082531f63 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:34.619907 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee4687-52c0-4375-9e1c-61a14abfdc34 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:34.664958 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403abe2-992c-45f8-9d4f-7fee823e6cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:34.665642 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403abe2-992c-45f8-9d4f-7fee823e6cfe None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:34.665925 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403abe2-992c-45f8-9d4f-7fee823e6cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:34.666198 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403abe2-992c-45f8-9d4f-7fee823e6cfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:34.679871 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f403abe2-992c-45f8-9d4f-7fee823e6cfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:34.681364 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f403abe2-992c-45f8-9d4f-7fee823e6cfe None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:34.699187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-f403abe2-992c-45f8-9d4f-7fee823e6cfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:34.699187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:34.699187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:34.699187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:34.699187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:34.699187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:34.699187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:34.699187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:34.699187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:34.699187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:34.699187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:34.699187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:34.699187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:34.699187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:34.699187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:34.699187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:34.700118 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:34.700118 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:34.700118 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:34.700118 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:34.700118 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:34.700118 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:34.700118 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:34.700118 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:34.700118 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:34.700118 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:34.700118 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:34.700118 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:34.700118 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:34.700118 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:34.700118 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:34.700118 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:34.700118 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:34.701039 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:34.701039 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:34.701039 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:34.701039 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 281/559] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:34.701039 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403abe2-992c-45f8-9d4f-7fee823e6cfe None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:34.748991 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be69256-2171-4d44-a558-694082531f63 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:34.787718 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770617ce-7dbe-4ce1-9e2f-b20875681e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:34.788881 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770617ce-7dbe-4ce1-9e2f-b20875681e93 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:34.789182 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770617ce-7dbe-4ce1-9e2f-b20875681e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:34.789453 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770617ce-7dbe-4ce1-9e2f-b20875681e93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:34.805188 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770617ce-7dbe-4ce1-9e2f-b20875681e93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:34.806683 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770617ce-7dbe-4ce1-9e2f-b20875681e93 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:34.818136 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:34.827748 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-770617ce-7dbe-4ce1-9e2f-b20875681e93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:34.827748 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:34.827748 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:34.827748 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:34.827748 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:34.827748 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:34.827748 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:34.827748 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:34.827748 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:34.827748 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:34.827748 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:34.827748 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:34.827748 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:34.827748 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:34.827748 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:34.827748 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:34.828964 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:34.828964 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:34.828964 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:34.828964 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:34.828964 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:34.828964 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:34.828964 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:34.828964 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:34.828964 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:34.828964 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:34.828964 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:34.828964 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:34.828964 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:34.828964 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:34.828964 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:34.828964 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:34.828964 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:34.830064 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:34.830064 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:34.830064 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:34.832545 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 279/560] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:34.834176 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770617ce-7dbe-4ce1-9e2f-b20875681e93 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:34.844425 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403abe2-992c-45f8-9d4f-7fee823e6cfe None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:34.866139 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:34.887514 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17426c6-cc5a-4fde-a25f-a3a60bbcf747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:34.888985 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17426c6-cc5a-4fde-a25f-a3a60bbcf747 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:34.889493 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17426c6-cc5a-4fde-a25f-a3a60bbcf747 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:34.889957 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17426c6-cc5a-4fde-a25f-a3a60bbcf747 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:34.902472 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17426c6-cc5a-4fde-a25f-a3a60bbcf747 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:34.904193 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17426c6-cc5a-4fde-a25f-a3a60bbcf747 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:34.918894 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-e17426c6-cc5a-4fde-a25f-a3a60bbcf747 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:34.918894 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:34.918894 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:34.918894 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:34.918894 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:34.918894 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:34.918894 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:34.918894 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:34.918894 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:34.918894 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:34.918894 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:34.918894 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:34.918894 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:34.918894 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:34.918894 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:34.918894 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:34.920082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:34.920082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:34.920082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:34.920082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:34.920082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:34.920082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:34.920082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:34.920082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:34.920082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:34.920082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:34.920082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:34.920082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:34.920082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:34.920082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:34.920082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:34.920082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:34.920082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:34.920958 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:34.920958 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:34.920958 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:34.923119 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 282/561] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:34.924259 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17426c6-cc5a-4fde-a25f-a3a60bbcf747 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:34.969576 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770617ce-7dbe-4ce1-9e2f-b20875681e93 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:35.004672 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3c1d5-8755-4fd2-9e30-31899f832b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:35.005347 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3c1d5-8755-4fd2-9e30-31899f832b94 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:35.005584 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3c1d5-8755-4fd2-9e30-31899f832b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:35.005852 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3c1d5-8755-4fd2-9e30-31899f832b94 None admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:35.006486 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3c1d5-8755-4fd2-9e30-31899f832b94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:35.006783 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3c1d5-8755-4fd2-9e30-31899f832b94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:35.008722 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3c1d5-8755-4fd2-9e30-31899f832b94 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:35.020444 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 280/562] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:35.021285 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3c1d5-8755-4fd2-9e30-31899f832b94 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:35.050528 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17426c6-cc5a-4fde-a25f-a3a60bbcf747 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:35.085892 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe347a8-7004-45a6-b2ae-2a934ad93d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:35.086102 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:35.086840 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe347a8-7004-45a6-b2ae-2a934ad93d76 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:35.087330 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe347a8-7004-45a6-b2ae-2a934ad93d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:35.087623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe347a8-7004-45a6-b2ae-2a934ad93d76 None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:35.088728 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe347a8-7004-45a6-b2ae-2a934ad93d76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:35.089230 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe347a8-7004-45a6-b2ae-2a934ad93d76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:35.090617 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe347a8-7004-45a6-b2ae-2a934ad93d76 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:35.103729 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 283/563] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:35.104961 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a656ae1-7f39-45ad-86c9-c181f88d900e None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:35.105281 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a656ae1-7f39-45ad-86c9-c181f88d900e None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:35.105524 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a656ae1-7f39-45ad-86c9-c181f88d900e None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:35.106882 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 284/564] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:35.109963 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a656ae1-7f39-45ad-86c9-c181f88d900e None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:35.136519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3c1d5-8755-4fd2-9e30-31899f832b94 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:35.142073 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:35.174952 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812b9b2-327d-4547-97ec-fc87c8e642e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:35.175892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812b9b2-327d-4547-97ec-fc87c8e642e4 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:35.176367 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812b9b2-327d-4547-97ec-fc87c8e642e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:35.176872 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812b9b2-327d-4547-97ec-fc87c8e642e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:35.177669 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812b9b2-327d-4547-97ec-fc87c8e642e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:35.177980 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812b9b2-327d-4547-97ec-fc87c8e642e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:35.179396 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812b9b2-327d-4547-97ec-fc87c8e642e4 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:35.196157 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 281/565] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:35.197208 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812b9b2-327d-4547-97ec-fc87c8e642e4 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:35.216110 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a656ae1-7f39-45ad-86c9-c181f88d900e None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:35.259232 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beccfe0-fb1a-48ff-b1b4-fa3d14597a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:35.259822 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beccfe0-fb1a-48ff-b1b4-fa3d14597a61 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:35.260080 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beccfe0-fb1a-48ff-b1b4-fa3d14597a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:35.260344 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beccfe0-fb1a-48ff-b1b4-fa3d14597a61 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:35.270193 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beccfe0-fb1a-48ff-b1b4-fa3d14597a61 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:35.272250 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beccfe0-fb1a-48ff-b1b4-fa3d14597a61 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:35.287852 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-3beccfe0-fb1a-48ff-b1b4-fa3d14597a61 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 17:42:35.287852 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:35.287852 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:35.287852 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:35.287852 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:35.287852 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:35.287852 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:35.287852 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:35.287852 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:35.287852 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:35.287852 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:35.287852 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:35.287852 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 17:42:35.287852 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 17:42:35.287852 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 17:42:35.287852 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 17:42:35.288907 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:35.288907 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:35.288907 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 17:42:35.288907 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:42:35.288907 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 17:42:35.288907 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:42:35.288907 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:35.288907 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:35.288907 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:35.288907 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:35.288907 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:35.288907 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:35.288907 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:35.288907 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:35.288907 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:35.288907 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:35.288907 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:35.288907 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:35.290304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:35.290304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:35.290304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 17:42:35.290304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 17:42:35.290304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 17:42:35.290304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 17:42:35.290304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 17:42:35.290304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 17:42:35.290304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 17:42:35.290304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:35.290304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 285/566] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Sep 26 17:42:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:35.290304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d729c09-933e-49d7-9f83-a15fd2a578c9 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:35.290973 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d729c09-933e-49d7-9f83-a15fd2a578c9 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:35.290973 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d729c09-933e-49d7-9f83-a15fd2a578c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:35.309530 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-2d729c09-933e-49d7-9f83-a15fd2a578c9 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:35.310720 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-2d729c09-933e-49d7-9f83-a15fd2a578c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:35.314101 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812b9b2-327d-4547-97ec-fc87c8e642e4 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:35.336628 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:35.352981 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469b0d5-7481-4368-8bb6-ae4badc6bf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:35.353658 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469b0d5-7481-4368-8bb6-ae4badc6bf1f None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:35.353938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469b0d5-7481-4368-8bb6-ae4badc6bf1f None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:35.354212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469b0d5-7481-4368-8bb6-ae4badc6bf1f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:35.361988 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1469b0d5-7481-4368-8bb6-ae4badc6bf1f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:35.363442 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1469b0d5-7481-4368-8bb6-ae4badc6bf1f None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:35.374727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-1469b0d5-7481-4368-8bb6-ae4badc6bf1f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 26 17:42:35.374727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:35.374727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:35.374727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:35.374727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:35.374727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:35.374727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:35.374727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:35.374727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:35.374727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:35.374727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:35.374727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:35.374727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 17:42:35.374727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 17:42:35.374727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 17:42:35.374727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 17:42:35.375646 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:35.375646 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:35.375646 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 17:42:35.375646 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:42:35.375646 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 17:42:35.375646 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:42:35.375646 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:35.375646 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:35.375646 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:35.375646 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:35.375646 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:35.375646 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:35.375646 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:35.375646 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:35.375646 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:35.375646 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:35.375646 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:35.375646 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:35.376610 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:35.376610 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:35.376610 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 17:42:35.376610 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 17:42:35.376610 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 17:42:35.376610 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 17:42:35.376610 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 17:42:35.376610 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 17:42:35.376610 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 26 17:42:35.376610 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:35.376610 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 282/567] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:42:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:35.376610 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469b0d5-7481-4368-8bb6-ae4badc6bf1f None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:35.386126 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 286/568] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:42:35.386989 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d729c09-933e-49d7-9f83-a15fd2a578c9 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:35.414331 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:35.494404 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d729c09-933e-49d7-9f83-a15fd2a578c9 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:35.497216 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469b0d5-7481-4368-8bb6-ae4badc6bf1f None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:35.528575 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c4695-1f27-4b10-b2cc-73310a1081a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:35.529127 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c4695-1f27-4b10-b2cc-73310a1081a9 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:35.529405 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c4695-1f27-4b10-b2cc-73310a1081a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:35.529672 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c4695-1f27-4b10-b2cc-73310a1081a9 None admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:35.530385 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c4695-1f27-4b10-b2cc-73310a1081a9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:35.530683 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c4695-1f27-4b10-b2cc-73310a1081a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:35.532098 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb4cd5-0f48-4a34-95bf-2161f9c8ecf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:35.532214 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c4695-1f27-4b10-b2cc-73310a1081a9 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:35.532730 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb4cd5-0f48-4a34-95bf-2161f9c8ecf0 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:35.533043 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb4cd5-0f48-4a34-95bf-2161f9c8ecf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:35.533316 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb4cd5-0f48-4a34-95bf-2161f9c8ecf0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:35.541162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb4cd5-0f48-4a34-95bf-2161f9c8ecf0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:35.542632 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb4cd5-0f48-4a34-95bf-2161f9c8ecf0 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:35.553767 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 287/569] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Sep 26 17:42:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:35.553767 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c189c2c-d6a6-411c-9465-481fa1efa897 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:35.553767 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c189c2c-d6a6-411c-9465-481fa1efa897 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:35.553767 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c189c2c-d6a6-411c-9465-481fa1efa897 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:35.553767 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 288/570] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:35.553767 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c189c2c-d6a6-411c-9465-481fa1efa897 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:35.555235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-16bb4cd5-0f48-4a34-95bf-2161f9c8ecf0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:42:35.555235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:35.555235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:35.555235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:35.555235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:35.555235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:35.555235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:35.555235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:35.555235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:35.555235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:35.555235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:35.555235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:35.555235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 17:42:35.555235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 17:42:35.555235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 17:42:35.556086 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 17:42:35.556086 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:35.556086 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:35.556086 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:35.556086 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:35.556086 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:35.556086 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:35.556086 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:35.556086 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:35.556086 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:35.556086 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:35.556086 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:35.556086 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:35.556086 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:35.556086 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:35.556086 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:35.556086 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:35.556961 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 17:42:35.556961 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 17:42:35.556961 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 17:42:35.556961 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 17:42:35.556961 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 17:42:35.556961 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 17:42:35.556961 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:42:35.556961 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:35.556961 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 283/571] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:42:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:35.562027 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb4cd5-0f48-4a34-95bf-2161f9c8ecf0 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:35.603203 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:35.645594 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:35.661157 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb4cd5-0f48-4a34-95bf-2161f9c8ecf0 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:35.671847 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c189c2c-d6a6-411c-9465-481fa1efa897 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:35.702647 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42ae18-47b9-42eb-99d2-0c9860c3590f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:35.703399 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42ae18-47b9-42eb-99d2-0c9860c3590f None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:35.703766 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42ae18-47b9-42eb-99d2-0c9860c3590f None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:35.704042 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42ae18-47b9-42eb-99d2-0c9860c3590f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:35.707333 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ecf79-cb06-4dc9-9353-6dbd3eb6e026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:35.707939 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ecf79-cb06-4dc9-9353-6dbd3eb6e026 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:35.708218 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ecf79-cb06-4dc9-9353-6dbd3eb6e026 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:35.708487 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ecf79-cb06-4dc9-9353-6dbd3eb6e026 None admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:35.709261 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ecf79-cb06-4dc9-9353-6dbd3eb6e026 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:35.709565 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ecf79-cb06-4dc9-9353-6dbd3eb6e026 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:35.712075 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ecf79-cb06-4dc9-9353-6dbd3eb6e026 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:35.715429 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42ae18-47b9-42eb-99d2-0c9860c3590f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:35.716976 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42ae18-47b9-42eb-99d2-0c9860c3590f None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:35.730871 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 289/572] 10.222.0.62 () {56 vars in 1137 bytes} [Mon Sep 26 17:42:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:35.731765 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-1b42ae18-47b9-42eb-99d2-0c9860c3590f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:35.731765 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:35.731765 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:35.731765 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:35.731765 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:35.731765 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:35.731765 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:35.731765 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:35.731765 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:35.731765 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:35.731765 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:35.731765 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:35.731765 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:35.731765 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:35.731765 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:35.731765 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:35.732672 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:35.732672 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:35.732672 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:35.732672 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:35.732672 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:35.732672 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:35.732672 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:35.732672 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:35.732672 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:35.732672 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:35.732672 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:35.732672 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:35.732672 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:35.732672 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:35.732672 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:35.732672 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:35.732672 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:35.733582 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:35.733582 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:35.733582 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:35.733784 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c8511-38a0-4921-b888-b580026ee7cc None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:35.733784 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c8511-38a0-4921-b888-b580026ee7cc None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:35.733784 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c8511-38a0-4921-b888-b580026ee7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:35.733973 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 284/573] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:35.733973 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42ae18-47b9-42eb-99d2-0c9860c3590f None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:35.754854 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-209c8511-38a0-4921-b888-b580026ee7cc None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:35.756041 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-209c8511-38a0-4921-b888-b580026ee7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:35.822970 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 290/574] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:42:35.823761 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c8511-38a0-4921-b888-b580026ee7cc None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:35.832593 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:35.842414 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42ae18-47b9-42eb-99d2-0c9860c3590f None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:35.878809 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89718c71-c659-4503-a844-8d013395b721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:35.879465 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89718c71-c659-4503-a844-8d013395b721 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:35.879743 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89718c71-c659-4503-a844-8d013395b721 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:35.880306 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89718c71-c659-4503-a844-8d013395b721 None admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:35.880748 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89718c71-c659-4503-a844-8d013395b721 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:35.881083 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89718c71-c659-4503-a844-8d013395b721 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:35.882615 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89718c71-c659-4503-a844-8d013395b721 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:35.893675 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:35.894988 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 285/575] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Sep 26 17:42:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:35.895774 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89718c71-c659-4503-a844-8d013395b721 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:35.934630 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c8511-38a0-4921-b888-b580026ee7cc None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:35.970187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb79cf5-8856-4c23-bab8-a306d2c4581c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:35.970819 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb79cf5-8856-4c23-bab8-a306d2c4581c None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:35.971099 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb79cf5-8856-4c23-bab8-a306d2c4581c None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:35.971379 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb79cf5-8856-4c23-bab8-a306d2c4581c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:35.982337 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb79cf5-8856-4c23-bab8-a306d2c4581c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:42:35.987162 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-4fb79cf5-8856-4c23-bab8-a306d2c4581c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:42:35.987162 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:35.987162 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:35.987162 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:35.987162 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:35.987162 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:35.987162 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:35.987162 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:35.987162 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:35.987162 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:35.987162 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:35.987162 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:35.987162 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:42:35.987162 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:42:35.987162 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:42:35.987162 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:42:35.988244 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:42:35.988244 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:42:35.988244 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:42:35.988244 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:42:35.988244 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:35.988244 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:35.988244 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:35.988244 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:35.988244 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:35.988244 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:35.988244 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:35.988244 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:35.988244 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:35.988244 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:35.988244 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:35.988244 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:35.989105 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:35.989105 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:35.989105 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:35.989105 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:35.989105 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:42:35.989105 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:42:35.989105 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:42:35.989105 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:42:35.989105 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:42:35.989105 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:42:35.989105 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:42:35.989105 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:35.989105 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 291/576] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Sep 26 17:42:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:35.989105 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb79cf5-8856-4c23-bab8-a306d2c4581c None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:36.004917 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89718c71-c659-4503-a844-8d013395b721 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:36.042840 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14142c6-b7d0-44f0-9bb4-40a9db876f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:36.043470 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14142c6-b7d0-44f0-9bb4-40a9db876f5f None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:36.043753 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14142c6-b7d0-44f0-9bb4-40a9db876f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:36.044024 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14142c6-b7d0-44f0-9bb4-40a9db876f5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:36.054288 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14142c6-b7d0-44f0-9bb4-40a9db876f5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:36.055742 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14142c6-b7d0-44f0-9bb4-40a9db876f5f None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:36.071235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-e14142c6-b7d0-44f0-9bb4-40a9db876f5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:36.071235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:36.071235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:36.071235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:36.071235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:36.071235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:36.071235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:36.071235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:36.071235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:36.071235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:36.071235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:36.071235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:36.071235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:36.071235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:36.071235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:36.071235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:36.072705 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:36.072705 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:36.072705 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:36.072705 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:36.072705 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:36.072705 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:36.072705 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:36.072705 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:36.072705 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:36.072705 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:36.072705 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:36.072705 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:36.072705 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:36.072705 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:36.072705 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:36.072705 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:36.072705 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:36.074158 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:36.074158 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:36.074158 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:36.074158 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 286/577] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:36.074158 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14142c6-b7d0-44f0-9bb4-40a9db876f5f None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:36.078889 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:36.122685 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb79cf5-8856-4c23-bab8-a306d2c4581c None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:36.149590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:36.158901 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b3754-18b2-43e0-860a-d4b313809c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:36.159513 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b3754-18b2-43e0-860a-d4b313809c51 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:36.159810 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b3754-18b2-43e0-860a-d4b313809c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:36.160083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b3754-18b2-43e0-860a-d4b313809c51 None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:36.160728 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b3754-18b2-43e0-860a-d4b313809c51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:36.161044 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b3754-18b2-43e0-860a-d4b313809c51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:36.162435 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b3754-18b2-43e0-860a-d4b313809c51 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:36.173800 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 292/578] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:36.174586 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b3754-18b2-43e0-860a-d4b313809c51 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:36.175114 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14142c6-b7d0-44f0-9bb4-40a9db876f5f None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:36.208820 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc820e-f7a9-4fe4-a243-fdb0f31832bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:36.209443 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc820e-f7a9-4fe4-a243-fdb0f31832bb None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:36.209718 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc820e-f7a9-4fe4-a243-fdb0f31832bb None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:36.209985 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc820e-f7a9-4fe4-a243-fdb0f31832bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:36.211284 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc820e-f7a9-4fe4-a243-fdb0f31832bb None admin] RBAC: Adding query filter params (role.id=4685fd1f2f284d4498281231160a5f27, scope.project.id=125361b23eb14b53aca5e0139919881e, user.id=ea49cd9839474232a0cbe66ccffbf082) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:36.211589 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc820e-f7a9-4fe4-a243-fdb0f31832bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:36.213049 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc820e-f7a9-4fe4-a243-fdb0f31832bb None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:36.218222 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 287/579] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:42:36 2022] GET /identity/v3/role_assignments?user.id=ea49cd9839474232a0cbe66ccffbf082&scope.project.id=125361b23eb14b53aca5e0139919881e&role.id=4685fd1f2f284d4498281231160a5f27 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:36.219067 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc820e-f7a9-4fe4-a243-fdb0f31832bb None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:36.285096 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b3754-18b2-43e0-860a-d4b313809c51 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:36.304367 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:36.323407 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f343692-a1ba-4518-8182-d7e21d495923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:36.324026 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f343692-a1ba-4518-8182-d7e21d495923 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:36.324373 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f343692-a1ba-4518-8182-d7e21d495923 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:36.324575 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f343692-a1ba-4518-8182-d7e21d495923 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:36.325270 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f343692-a1ba-4518-8182-d7e21d495923 None admin] RBAC: Adding query filter params (name=service) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:36.325570 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f343692-a1ba-4518-8182-d7e21d495923 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:36.327210 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f343692-a1ba-4518-8182-d7e21d495923 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:36.336415 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 293/580] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Sep 26 17:42:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:36.336415 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f343692-a1ba-4518-8182-d7e21d495923 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:36.348810 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc820e-f7a9-4fe4-a243-fdb0f31832bb None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:36.395373 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96baadd8-7594-4174-bdc2-e0d81e1c4f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:36.395991 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96baadd8-7594-4174-bdc2-e0d81e1c4f73 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:36.396267 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96baadd8-7594-4174-bdc2-e0d81e1c4f73 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:36.396538 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96baadd8-7594-4174-bdc2-e0d81e1c4f73 None admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:36.397210 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96baadd8-7594-4174-bdc2-e0d81e1c4f73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:36.397511 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96baadd8-7594-4174-bdc2-e0d81e1c4f73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:36.398941 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96baadd8-7594-4174-bdc2-e0d81e1c4f73 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:36.400900 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:36.418805 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 288/581] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:36.421875 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96baadd8-7594-4174-bdc2-e0d81e1c4f73 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:36.459982 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f343692-a1ba-4518-8182-d7e21d495923 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:36.496131 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457a05ed-7f08-4820-9353-b099f05e83fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:36.496755 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a05ed-7f08-4820-9353-b099f05e83fc None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:36.497058 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a05ed-7f08-4820-9353-b099f05e83fc None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:36.497447 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a05ed-7f08-4820-9353-b099f05e83fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:36.509440 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457a05ed-7f08-4820-9353-b099f05e83fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:42:36.514745 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-457a05ed-7f08-4820-9353-b099f05e83fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:42:36.514745 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:36.514745 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:36.514745 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:36.514745 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:36.514745 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:36.514745 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:36.514745 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:36.514745 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:36.514745 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:36.514745 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:36.514745 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:36.514745 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:42:36.514745 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:42:36.514745 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:42:36.514745 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:42:36.515670 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:42:36.515670 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:42:36.515670 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:42:36.515670 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:42:36.515670 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:36.515670 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:36.515670 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:36.515670 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:36.515670 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:36.515670 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:36.515670 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:36.515670 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:36.515670 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:36.515670 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:36.515670 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:36.515670 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:36.516498 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:36.516498 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:36.516498 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:36.516498 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:36.516498 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:42:36.516498 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:42:36.516498 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:42:36.516498 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:42:36.516498 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:42:36.516498 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:42:36.516498 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:42:36.516498 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:36.520914 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 294/582] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Sep 26 17:42:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:36.521862 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457a05ed-7f08-4820-9353-b099f05e83fc None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:36.531185 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96baadd8-7594-4174-bdc2-e0d81e1c4f73 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:36.559669 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:36.568408 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f91e8d-4bfc-41ce-8177-9a4d5f93cca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:36.569060 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f91e8d-4bfc-41ce-8177-9a4d5f93cca2 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:36.569339 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f91e8d-4bfc-41ce-8177-9a4d5f93cca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:36.570168 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f91e8d-4bfc-41ce-8177-9a4d5f93cca2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:36.577649 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f91e8d-4bfc-41ce-8177-9a4d5f93cca2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:36.579256 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f91e8d-4bfc-41ce-8177-9a4d5f93cca2 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:36.592039 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-f9f91e8d-4bfc-41ce-8177-9a4d5f93cca2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:42:36.592039 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:36.592039 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:36.592039 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:36.592039 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:36.592039 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:36.592039 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:36.592039 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:36.592039 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:36.592039 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:36.592039 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:36.592039 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:36.592039 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 17:42:36.592039 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 17:42:36.592039 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 17:42:36.593040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 17:42:36.593040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:36.593040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:36.593040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:36.593040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:36.593040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:36.593040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:36.593040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:36.593040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:36.593040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:36.593040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:36.593040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:36.593040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:36.593040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:36.593040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:36.593040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:36.593040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:36.593953 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 17:42:36.593953 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 17:42:36.593953 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 17:42:36.593953 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 17:42:36.593953 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 17:42:36.593953 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 17:42:36.593953 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:42:36.593953 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:36.593953 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 289/583] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:42:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:36.593953 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f91e8d-4bfc-41ce-8177-9a4d5f93cca2 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:36.641114 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457a05ed-7f08-4820-9353-b099f05e83fc None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:36.650030 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:36.674968 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4788a9e-3776-49d6-bd8b-300b9d593ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:36.675684 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4788a9e-3776-49d6-bd8b-300b9d593ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:36.676036 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4788a9e-3776-49d6-bd8b-300b9d593ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:36.676377 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4788a9e-3776-49d6-bd8b-300b9d593ce6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:36.688000 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4788a9e-3776-49d6-bd8b-300b9d593ce6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:36.689515 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4788a9e-3776-49d6-bd8b-300b9d593ce6 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:36.705379 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-f4788a9e-3776-49d6-bd8b-300b9d593ce6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:36.705379 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:36.705379 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:36.705379 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:36.705379 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:36.705379 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:36.705379 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:36.705379 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:36.705379 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:36.705379 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:36.705379 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:36.705379 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:36.705379 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:36.705379 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:36.705379 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:36.705379 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:36.706382 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:36.706382 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:36.706382 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:36.706382 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:36.706382 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:36.706382 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:36.706382 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:36.706382 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:36.706382 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:36.706382 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:36.706382 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:36.706382 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:36.706382 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:36.706382 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:36.706382 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:36.706382 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:36.706382 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:36.707290 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:36.707290 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:36.707290 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:36.707290 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 295/584] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:36.707290 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4788a9e-3776-49d6-bd8b-300b9d593ce6 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:36.712448 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f91e8d-4bfc-41ce-8177-9a4d5f93cca2 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:36.748947 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7561f3-d188-4df4-b34a-7b7cd946cdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:36.749607 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7561f3-d188-4df4-b34a-7b7cd946cdc8 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:36.749882 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7561f3-d188-4df4-b34a-7b7cd946cdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:36.750157 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7561f3-d188-4df4-b34a-7b7cd946cdc8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:36.757765 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7561f3-d188-4df4-b34a-7b7cd946cdc8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:36.759211 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7561f3-d188-4df4-b34a-7b7cd946cdc8 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:36.770864 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-cc7561f3-d188-4df4-b34a-7b7cd946cdc8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:42:36.770864 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:36.770864 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:36.770864 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:36.770864 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:36.770864 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:36.770864 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:36.770864 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:36.770864 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:36.770864 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:36.770864 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:36.770864 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:36.770864 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 17:42:36.770864 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 17:42:36.770864 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 17:42:36.771948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 17:42:36.771948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:36.771948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:36.771948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:36.771948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:36.771948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:36.771948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:36.771948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:36.771948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:36.771948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:36.771948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:36.771948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:36.771948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:36.771948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:36.771948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:36.771948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:36.771948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:36.777662 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 17:42:36.777662 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 17:42:36.777662 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 17:42:36.777662 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 17:42:36.777662 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 17:42:36.777662 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 17:42:36.777662 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:42:36.777662 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:36.777662 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 290/585] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:42:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:36.777662 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7561f3-d188-4df4-b34a-7b7cd946cdc8 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:36.828226 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4788a9e-3776-49d6-bd8b-300b9d593ce6 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:36.828426 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:36.867045 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb1857-d525-4bee-b381-fb9ffda5c039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:36.867757 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb1857-d525-4bee-b381-fb9ffda5c039 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:36.868102 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb1857-d525-4bee-b381-fb9ffda5c039 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:36.868446 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb1857-d525-4bee-b381-fb9ffda5c039 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:36.869214 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb1857-d525-4bee-b381-fb9ffda5c039 None admin] RBAC: Adding query filter params (name=service) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:36.869595 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb1857-d525-4bee-b381-fb9ffda5c039 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:36.871034 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb1857-d525-4bee-b381-fb9ffda5c039 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:36.883411 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7561f3-d188-4df4-b34a-7b7cd946cdc8 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:36.885042 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 296/586] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Sep 26 17:42:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:36.886141 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb1857-d525-4bee-b381-fb9ffda5c039 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:36.913968 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:36.919146 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0bda25-dc61-4800-9957-8bcfa0883084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:36.919759 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bda25-dc61-4800-9957-8bcfa0883084 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:36.920041 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bda25-dc61-4800-9957-8bcfa0883084 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:36.920380 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bda25-dc61-4800-9957-8bcfa0883084 None admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:36.921122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0bda25-dc61-4800-9957-8bcfa0883084 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:36.921434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0bda25-dc61-4800-9957-8bcfa0883084 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:36.923000 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0bda25-dc61-4800-9957-8bcfa0883084 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:36.938734 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 291/587] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Sep 26 17:42:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:36.939647 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0bda25-dc61-4800-9957-8bcfa0883084 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:37.006164 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb1857-d525-4bee-b381-fb9ffda5c039 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:37.041966 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0bda25-dc61-4800-9957-8bcfa0883084 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:37.044819 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443646bb-405e-4899-98e6-c46eb218b628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:37.044819 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443646bb-405e-4899-98e6-c46eb218b628 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:37.045160 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443646bb-405e-4899-98e6-c46eb218b628 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:37.045363 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443646bb-405e-4899-98e6-c46eb218b628 None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:37.045999 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443646bb-405e-4899-98e6-c46eb218b628 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:37.046297 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443646bb-405e-4899-98e6-c46eb218b628 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:37.047646 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443646bb-405e-4899-98e6-c46eb218b628 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:37.053101 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:37.065912 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 297/588] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:37.065912 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443646bb-405e-4899-98e6-c46eb218b628 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:37.084146 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a2405-5665-4672-98bb-8aed1c2806f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:37.084760 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a2405-5665-4672-98bb-8aed1c2806f1 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:37.085630 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a2405-5665-4672-98bb-8aed1c2806f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:37.085964 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a2405-5665-4672-98bb-8aed1c2806f1 None admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:37.086881 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a2405-5665-4672-98bb-8aed1c2806f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:37.087282 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a2405-5665-4672-98bb-8aed1c2806f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:37.088772 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a2405-5665-4672-98bb-8aed1c2806f1 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:37.102318 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 292/589] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Sep 26 17:42:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:37.103144 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a2405-5665-4672-98bb-8aed1c2806f1 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:37.158705 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:37.180398 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443646bb-405e-4899-98e6-c46eb218b628 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:37.203016 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a2405-5665-4672-98bb-8aed1c2806f1 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:37.216127 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6043c-11b9-461e-a0fa-130c415300b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:37.216868 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6043c-11b9-461e-a0fa-130c415300b8 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:37.217349 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6043c-11b9-461e-a0fa-130c415300b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:37.217689 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6043c-11b9-461e-a0fa-130c415300b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:37.229257 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6043c-11b9-461e-a0fa-130c415300b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:37.230698 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6043c-11b9-461e-a0fa-130c415300b8 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:37.236380 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef01a1-ca3a-40c5-b36d-470bba08177b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:37.237155 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef01a1-ca3a-40c5-b36d-470bba08177b None admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:37.237509 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef01a1-ca3a-40c5-b36d-470bba08177b None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:37.237875 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef01a1-ca3a-40c5-b36d-470bba08177b None admin] PATH_INFO: `/v3/projects/125361b23eb14b53aca5e0139919881e/users/1792e79b9c9a47e1923f19bfd2cd495b/roles/4685fd1f2f284d4498281231160a5f27` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:37.245318 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-18c6043c-11b9-461e-a0fa-130c415300b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:37.245318 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:37.245318 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:37.245318 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:37.245318 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:37.245318 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:37.245318 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:37.245318 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:37.245318 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:37.245318 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:37.245318 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:37.245318 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:37.245318 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:37.245318 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:37.245318 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:37.245318 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:37.246422 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:37.246422 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:37.246422 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:37.246422 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:37.246422 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:37.246422 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:37.246422 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:37.246422 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:37.246422 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:37.246422 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:37.246422 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:37.246422 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:37.246422 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:37.246422 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:37.246422 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:37.246422 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:37.246422 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:37.247486 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:37.247486 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:37.247486 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:37.249315 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 298/590] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:37.250295 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6043c-11b9-461e-a0fa-130c415300b8 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:37.256156 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef01a1-ca3a-40c5-b36d-470bba08177b None admin] RBAC: Authorizing `identity:create_grant(project_id=125361b23eb14b53aca5e0139919881e, user_id=1792e79b9c9a47e1923f19bfd2cd495b, role_id=4685fd1f2f284d4498281231160a5f27)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:37.257751 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef01a1-ca3a-40c5-b36d-470bba08177b None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:37.272083 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 293/591] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Sep 26 17:42:37 2022] PUT /identity/v3/projects/125361b23eb14b53aca5e0139919881e/users/1792e79b9c9a47e1923f19bfd2cd495b/roles/4685fd1f2f284d4498281231160a5f27 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:42:37.273536 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef01a1-ca3a-40c5-b36d-470bba08177b None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:37.306927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:37.380398 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6043c-11b9-461e-a0fa-130c415300b8 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:37.428049 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef01a1-ca3a-40c5-b36d-470bba08177b None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:37.436029 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc897a-f4da-4741-8797-767745516870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:37.436956 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc897a-f4da-4741-8797-767745516870 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:37.437428 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc897a-f4da-4741-8797-767745516870 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:37.437854 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc897a-f4da-4741-8797-767745516870 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:37.441954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:37.451057 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc897a-f4da-4741-8797-767745516870 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:37.453095 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc897a-f4da-4741-8797-767745516870 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:37.471629 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-ffcc897a-f4da-4741-8797-767745516870 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 17:42:37.471629 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:37.471629 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:37.471629 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:37.471629 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:37.471629 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:37.471629 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:37.471629 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:37.471629 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:37.471629 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:37.471629 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:37.471629 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:37.471629 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 17:42:37.471629 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 17:42:37.471629 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 17:42:37.471629 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 17:42:37.472912 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:37.472912 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:37.472912 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 17:42:37.472912 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:42:37.472912 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 17:42:37.472912 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:42:37.472912 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:37.472912 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:37.472912 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:37.472912 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:37.472912 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:37.472912 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:37.472912 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:37.472912 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:37.472912 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:37.472912 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:37.472912 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:37.472912 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:37.474503 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:37.474503 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:37.474503 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 17:42:37.474503 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 17:42:37.474503 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 17:42:37.474503 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 17:42:37.474503 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 17:42:37.474503 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 17:42:37.474503 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 17:42:37.474503 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:37.474503 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 299/592] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:42:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:37.474503 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc897a-f4da-4741-8797-767745516870 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:37.481761 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cae27e-ea2a-4ea4-8387-f48694fd9113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:37.482784 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cae27e-ea2a-4ea4-8387-f48694fd9113 None admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:37.483269 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cae27e-ea2a-4ea4-8387-f48694fd9113 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:37.483824 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cae27e-ea2a-4ea4-8387-f48694fd9113 None admin] PATH_INFO: `/v3/projects/125361b23eb14b53aca5e0139919881e/users/ab3b7ac09599477bb0c6c1d32e2d5dbe/roles/4685fd1f2f284d4498281231160a5f27` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:37.504408 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cae27e-ea2a-4ea4-8387-f48694fd9113 None admin] RBAC: Authorizing `identity:create_grant(project_id=125361b23eb14b53aca5e0139919881e, user_id=ab3b7ac09599477bb0c6c1d32e2d5dbe, role_id=4685fd1f2f284d4498281231160a5f27)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:37.505892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cae27e-ea2a-4ea4-8387-f48694fd9113 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:37.524544 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 294/593] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Sep 26 17:42:37 2022] PUT /identity/v3/projects/125361b23eb14b53aca5e0139919881e/users/ab3b7ac09599477bb0c6c1d32e2d5dbe/roles/4685fd1f2f284d4498281231160a5f27 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:42:37.525198 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cae27e-ea2a-4ea4-8387-f48694fd9113 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:37.613975 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc897a-f4da-4741-8797-767745516870 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:37.627507 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:37.669345 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe070a-bb05-4b16-a3f1-f93641b8f8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:37.669889 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe070a-bb05-4b16-a3f1-f93641b8f8a1 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:37.670170 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe070a-bb05-4b16-a3f1-f93641b8f8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:37.670406 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cae27e-ea2a-4ea4-8387-f48694fd9113 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:37.670519 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe070a-bb05-4b16-a3f1-f93641b8f8a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:37.671106 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe070a-bb05-4b16-a3f1-f93641b8f8a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:37.671409 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe070a-bb05-4b16-a3f1-f93641b8f8a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:37.673204 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe070a-bb05-4b16-a3f1-f93641b8f8a1 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:37.691424 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 300/594] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:37.697650 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe070a-bb05-4b16-a3f1-f93641b8f8a1 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:37.718265 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05162ea0-715a-48f0-b2df-45f2220180ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:37.719128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05162ea0-715a-48f0-b2df-45f2220180ef None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:37.719404 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05162ea0-715a-48f0-b2df-45f2220180ef None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:37.719671 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05162ea0-715a-48f0-b2df-45f2220180ef None admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:37.720400 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05162ea0-715a-48f0-b2df-45f2220180ef None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:37.720761 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05162ea0-715a-48f0-b2df-45f2220180ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:37.722295 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05162ea0-715a-48f0-b2df-45f2220180ef None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:37.744747 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 295/595] 10.222.0.62 () {56 vars in 1137 bytes} [Mon Sep 26 17:42:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:37.750729 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05162ea0-715a-48f0-b2df-45f2220180ef None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:37.767119 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:37.836993 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe070a-bb05-4b16-a3f1-f93641b8f8a1 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:37.903600 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420da79-8ec3-48db-8a43-96ea4af73eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:37.907500 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420da79-8ec3-48db-8a43-96ea4af73eeb None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:37.907500 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420da79-8ec3-48db-8a43-96ea4af73eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:37.907500 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420da79-8ec3-48db-8a43-96ea4af73eeb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:37.912706 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05162ea0-715a-48f0-b2df-45f2220180ef None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:37.921281 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420da79-8ec3-48db-8a43-96ea4af73eeb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:37.922739 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420da79-8ec3-48db-8a43-96ea4af73eeb None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:37.944104 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-e420da79-8ec3-48db-8a43-96ea4af73eeb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 26 17:42:37.944104 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:37.944104 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:37.944104 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:37.944104 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:37.944104 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:37.944104 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:37.944104 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:37.944104 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:37.944104 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:37.944104 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:37.944104 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:37.944104 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 17:42:37.944104 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 17:42:37.944104 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 17:42:37.944104 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 17:42:37.945879 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:37.945879 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:37.945879 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 17:42:37.945879 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:42:37.945879 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 17:42:37.945879 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:42:37.945879 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:37.945879 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:37.945879 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:37.945879 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:37.945879 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:37.945879 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:37.945879 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:37.945879 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:37.945879 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:37.945879 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:37.945879 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:37.945879 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:37.946987 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:37.946987 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:37.946987 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 17:42:37.946987 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 17:42:37.946987 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 17:42:37.946987 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 17:42:37.946987 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 17:42:37.946987 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 17:42:37.946987 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 26 17:42:37.946987 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:37.946987 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 301/596] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Sep 26 17:42:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:37.953634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420da79-8ec3-48db-8a43-96ea4af73eeb None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:37.978656 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:38.013739 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138552c-e740-42e8-a7ab-5d6c566c22f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:38.014426 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138552c-e740-42e8-a7ab-5d6c566c22f6 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:38.014757 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138552c-e740-42e8-a7ab-5d6c566c22f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:38.015038 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138552c-e740-42e8-a7ab-5d6c566c22f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:38.036000 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138552c-e740-42e8-a7ab-5d6c566c22f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:38.037543 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138552c-e740-42e8-a7ab-5d6c566c22f6 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:38.063777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-b138552c-e740-42e8-a7ab-5d6c566c22f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:38.063777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:38.063777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:38.063777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:38.063777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:38.063777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:38.063777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:38.063777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:38.063777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:38.063777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:38.063777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:38.063777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:38.063777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:38.063777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:38.063777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:38.063777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:38.064955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:38.064955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:38.064955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:38.064955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:38.064955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:38.064955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:38.064955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:38.064955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:38.064955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:38.064955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:38.064955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:38.064955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:38.064955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:38.064955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:38.064955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:38.064955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:38.064955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:38.070732 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:38.070732 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:38.070732 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:38.072505 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 296/597] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:38.072851 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420da79-8ec3-48db-8a43-96ea4af73eeb None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:38.077752 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138552c-e740-42e8-a7ab-5d6c566c22f6 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:38.089887 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:38.114358 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01681e5-1fef-478c-ab44-092ef69a7e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:38.115371 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01681e5-1fef-478c-ab44-092ef69a7e07 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:38.115912 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01681e5-1fef-478c-ab44-092ef69a7e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:38.116902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01681e5-1fef-478c-ab44-092ef69a7e07 None admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:38.118384 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01681e5-1fef-478c-ab44-092ef69a7e07 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:38.118938 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01681e5-1fef-478c-ab44-092ef69a7e07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:38.120583 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01681e5-1fef-478c-ab44-092ef69a7e07 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:38.142440 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 302/598] 10.222.0.62 () {56 vars in 1139 bytes} [Mon Sep 26 17:42:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:38.148426 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01681e5-1fef-478c-ab44-092ef69a7e07 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:38.267493 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01681e5-1fef-478c-ab44-092ef69a7e07 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:38.307047 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138552c-e740-42e8-a7ab-5d6c566c22f6 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:38.309296 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95582774-0123-4a4b-b5aa-3b98e19c9627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:38.310172 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95582774-0123-4a4b-b5aa-3b98e19c9627 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:38.310669 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95582774-0123-4a4b-b5aa-3b98e19c9627 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:38.311148 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95582774-0123-4a4b-b5aa-3b98e19c9627 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:38.324176 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95582774-0123-4a4b-b5aa-3b98e19c9627 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:38.326028 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95582774-0123-4a4b-b5aa-3b98e19c9627 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:38.343884 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-95582774-0123-4a4b-b5aa-3b98e19c9627 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:38.343884 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:38.343884 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:38.343884 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:38.343884 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:38.343884 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:38.343884 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:38.343884 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:38.343884 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:38.343884 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:38.343884 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:38.343884 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:38.343884 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:38.343884 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:38.343884 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:38.343884 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:38.344883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:38.344883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:38.344883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:38.344883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:38.344883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:38.344883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:38.344883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:38.344883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:38.344883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:38.344883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:38.344883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:38.344883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:38.344883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:38.344883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:38.344883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:38.344883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:38.344883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:38.345806 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:38.345806 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:38.345806 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:38.348443 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 303/599] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:42:38.356031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95582774-0123-4a4b-b5aa-3b98e19c9627 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:38.401481 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6d4d5-b2c4-425a-91ed-1108b01b0f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:38.402541 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6d4d5-b2c4-425a-91ed-1108b01b0f5f None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:38.404073 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6d4d5-b2c4-425a-91ed-1108b01b0f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:38.404571 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6d4d5-b2c4-425a-91ed-1108b01b0f5f None admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:38.406907 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6d4d5-b2c4-425a-91ed-1108b01b0f5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:38.407435 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6d4d5-b2c4-425a-91ed-1108b01b0f5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:38.410433 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6d4d5-b2c4-425a-91ed-1108b01b0f5f None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:38.427034 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:38.440688 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 297/600] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:42:38.443191 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6d4d5-b2c4-425a-91ed-1108b01b0f5f None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:38.508328 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:38.533227 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95582774-0123-4a4b-b5aa-3b98e19c9627 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:38.579320 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4da867-789d-4a96-89fa-897947a7a52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:38.579934 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4da867-789d-4a96-89fa-897947a7a52e None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:38.580216 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4da867-789d-4a96-89fa-897947a7a52e None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:38.580490 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4da867-789d-4a96-89fa-897947a7a52e None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:38.581180 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4da867-789d-4a96-89fa-897947a7a52e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:38.581527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6d4d5-b2c4-425a-91ed-1108b01b0f5f None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:38.581979 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4da867-789d-4a96-89fa-897947a7a52e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:38.583792 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4da867-789d-4a96-89fa-897947a7a52e None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:38.601682 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 304/601] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:38.601682 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c7ca7-8292-4113-8443-fcd6783fa70f None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:38.601682 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c7ca7-8292-4113-8443-fcd6783fa70f None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:38.601682 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c7ca7-8292-4113-8443-fcd6783fa70f None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:38.601682 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 305/602] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:38.610682 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9078a2f-b8a3-4a03-8d4f-83e7e70d7319 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:38.611027 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9078a2f-b8a3-4a03-8d4f-83e7e70d7319 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:38.611225 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9078a2f-b8a3-4a03-8d4f-83e7e70d7319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:38.633490 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-d9078a2f-b8a3-4a03-8d4f-83e7e70d7319 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:38.634797 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-d9078a2f-b8a3-4a03-8d4f-83e7e70d7319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:38.635180 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7b213-17c5-4e44-9f47-87003df3ef15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:38.636377 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7b213-17c5-4e44-9f47-87003df3ef15 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:38.637210 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7b213-17c5-4e44-9f47-87003df3ef15 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:38.638663 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7b213-17c5-4e44-9f47-87003df3ef15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:38.647480 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db7b213-17c5-4e44-9f47-87003df3ef15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:38.649858 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db7b213-17c5-4e44-9f47-87003df3ef15 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:38.665630 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-6db7b213-17c5-4e44-9f47-87003df3ef15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:42:38.665630 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:38.665630 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:38.665630 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:38.665630 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:38.665630 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:38.665630 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:38.665630 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:38.665630 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:38.665630 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:38.665630 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:38.665630 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:38.665630 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 17:42:38.665630 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 17:42:38.665630 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 17:42:38.666530 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 17:42:38.666530 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:38.666530 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:38.666530 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:38.666530 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:38.666530 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:38.666530 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:38.666530 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:38.666530 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:38.666530 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:38.666530 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:38.666530 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:38.666530 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:38.666530 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:38.666530 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:38.666530 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:38.666530 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:38.667416 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 17:42:38.667416 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 17:42:38.667416 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 17:42:38.667416 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 17:42:38.667416 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 17:42:38.667416 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 17:42:38.667416 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:42:38.667416 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:38.669970 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 298/603] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:42:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:38.671183 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7b213-17c5-4e44-9f47-87003df3ef15 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:38.721172 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 306/604] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:42:38.722527 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9078a2f-b8a3-4a03-8d4f-83e7e70d7319 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:38.754965 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:38.819391 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:38.823446 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7b213-17c5-4e44-9f47-87003df3ef15 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:38.872030 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9078a2f-b8a3-4a03-8d4f-83e7e70d7319 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:38.907939 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1137d-3028-4229-8e9c-7d90a35bb160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:38.908788 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1137d-3028-4229-8e9c-7d90a35bb160 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:38.909314 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1137d-3028-4229-8e9c-7d90a35bb160 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:38.910061 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1137d-3028-4229-8e9c-7d90a35bb160 None admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:38.910927 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1137d-3028-4229-8e9c-7d90a35bb160 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:38.911397 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1137d-3028-4229-8e9c-7d90a35bb160 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:38.912959 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1137d-3028-4229-8e9c-7d90a35bb160 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:38.925553 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 307/605] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Sep 26 17:42:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:38.932425 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1137d-3028-4229-8e9c-7d90a35bb160 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:38.953747 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59e1e1-e9f3-4204-b981-9854bfa18c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:38.954401 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59e1e1-e9f3-4204-b981-9854bfa18c9d None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:38.954684 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59e1e1-e9f3-4204-b981-9854bfa18c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:38.954958 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59e1e1-e9f3-4204-b981-9854bfa18c9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:38.981410 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e59e1e1-e9f3-4204-b981-9854bfa18c9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:38.981410 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e59e1e1-e9f3-4204-b981-9854bfa18c9d None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:39.007525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-9e59e1e1-e9f3-4204-b981-9854bfa18c9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:42:39.007525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:39.007525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:39.007525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:39.007525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:39.007525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:39.007525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:39.007525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:39.007525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:39.007525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:39.007525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:39.007525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:39.007525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 17:42:39.007525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 17:42:39.007525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 17:42:39.008660 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 17:42:39.008660 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:39.008660 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:39.008660 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:39.008660 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:39.008660 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:39.008660 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:39.008660 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:39.008660 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:39.008660 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:39.008660 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:39.008660 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:39.008660 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:39.008660 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:39.008660 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:39.008660 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:39.008660 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:39.009759 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 17:42:39.009759 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 17:42:39.009759 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 17:42:39.009759 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 17:42:39.009759 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 17:42:39.009759 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 17:42:39.009759 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:42:39.009759 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:39.009759 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 299/606] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:42:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:39.018909 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59e1e1-e9f3-4204-b981-9854bfa18c9d None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:39.024512 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:39.056074 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1137d-3028-4229-8e9c-7d90a35bb160 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:39.094527 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5d46f-af5b-47cd-b512-a06e9afec5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:39.095624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5d46f-af5b-47cd-b512-a06e9afec5dd None admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:39.096104 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5d46f-af5b-47cd-b512-a06e9afec5dd None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:39.096569 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5d46f-af5b-47cd-b512-a06e9afec5dd None admin] PATH_INFO: `/v3/projects/125361b23eb14b53aca5e0139919881e/users/14b32df88c21499d9ca81e439b129431/roles/4685fd1f2f284d4498281231160a5f27` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:39.112539 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5d46f-af5b-47cd-b512-a06e9afec5dd None admin] RBAC: Authorizing `identity:create_grant(project_id=125361b23eb14b53aca5e0139919881e, user_id=14b32df88c21499d9ca81e439b129431, role_id=4685fd1f2f284d4498281231160a5f27)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:39.114413 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5d46f-af5b-47cd-b512-a06e9afec5dd None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:39.132519 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 308/607] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Sep 26 17:42:38 2022] PUT /identity/v3/projects/125361b23eb14b53aca5e0139919881e/users/14b32df88c21499d9ca81e439b129431/roles/4685fd1f2f284d4498281231160a5f27 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:42:39.133982 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5d46f-af5b-47cd-b512-a06e9afec5dd None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:39.150522 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59e1e1-e9f3-4204-b981-9854bfa18c9d None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:39.197062 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ecb7f-a124-44cd-b585-3d171d5225ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:39.197696 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ecb7f-a124-44cd-b585-3d171d5225ca None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:39.197979 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ecb7f-a124-44cd-b585-3d171d5225ca None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:39.198255 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ecb7f-a124-44cd-b585-3d171d5225ca None admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:39.198966 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ecb7f-a124-44cd-b585-3d171d5225ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:39.199271 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ecb7f-a124-44cd-b585-3d171d5225ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:39.200808 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ecb7f-a124-44cd-b585-3d171d5225ca None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:39.222908 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 300/608] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Sep 26 17:42:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:39.225074 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ecb7f-a124-44cd-b585-3d171d5225ca None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:39.249815 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:39.263576 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5d46f-af5b-47cd-b512-a06e9afec5dd None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:39.299022 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:39.328633 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e0e70-439a-4769-bc72-244b1bf560a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:39.329731 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e0e70-439a-4769-bc72-244b1bf560a1 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:39.330217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e0e70-439a-4769-bc72-244b1bf560a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:39.331225 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e0e70-439a-4769-bc72-244b1bf560a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:39.357300 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e0e70-439a-4769-bc72-244b1bf560a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:42:39.364152 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-310e0e70-439a-4769-bc72-244b1bf560a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:42:39.364152 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:39.364152 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:39.364152 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:39.364152 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:39.364152 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:39.364152 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:39.364152 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:39.364152 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:39.364152 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:39.364152 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:39.364152 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:39.364152 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:42:39.364152 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:42:39.364152 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:42:39.364152 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:42:39.365175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:42:39.365175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:42:39.365175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:42:39.365175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:42:39.365175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:39.365175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:39.365175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:39.365175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:39.365175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:39.365175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:39.365175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:39.365175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:39.365175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:39.365175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:39.365175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:39.365175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:39.366018 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:39.366018 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:39.366018 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:39.366018 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:39.366018 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:42:39.366018 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:42:39.366018 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:42:39.366018 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:42:39.366018 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:42:39.366018 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:42:39.366018 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:42:39.366018 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:39.375310 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 309/609] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Sep 26 17:42:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:39.377000 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e0e70-439a-4769-bc72-244b1bf560a1 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:39.410034 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ecb7f-a124-44cd-b585-3d171d5225ca None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:39.454907 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78b595-27d9-4f45-aebc-5f89de40b1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:39.455575 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78b595-27d9-4f45-aebc-5f89de40b1e7 None admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:39.455855 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78b595-27d9-4f45-aebc-5f89de40b1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:39.456138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78b595-27d9-4f45-aebc-5f89de40b1e7 None admin] PATH_INFO: `/v3/projects/125361b23eb14b53aca5e0139919881e/users/a0ed50f4edcf468192a053b1e0fd6910/roles/4685fd1f2f284d4498281231160a5f27` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:39.472695 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78b595-27d9-4f45-aebc-5f89de40b1e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=125361b23eb14b53aca5e0139919881e, user_id=a0ed50f4edcf468192a053b1e0fd6910, role_id=4685fd1f2f284d4498281231160a5f27)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:39.474567 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78b595-27d9-4f45-aebc-5f89de40b1e7 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:39.496992 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 301/610] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Sep 26 17:42:39 2022] PUT /identity/v3/projects/125361b23eb14b53aca5e0139919881e/users/a0ed50f4edcf468192a053b1e0fd6910/roles/4685fd1f2f284d4498281231160a5f27 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:42:39.531294 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e0e70-439a-4769-bc72-244b1bf560a1 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:39.583852 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244dc976-9003-453c-b179-d495bae55816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:39.584583 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244dc976-9003-453c-b179-d495bae55816 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:39.584885 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244dc976-9003-453c-b179-d495bae55816 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:39.585708 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244dc976-9003-453c-b179-d495bae55816 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:39.586392 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244dc976-9003-453c-b179-d495bae55816 None admin] RBAC: Adding query filter params (name=service) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:39.586747 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244dc976-9003-453c-b179-d495bae55816 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:39.588235 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244dc976-9003-453c-b179-d495bae55816 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:39.603553 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 310/611] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Sep 26 17:42:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:42:39.609856 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78b595-27d9-4f45-aebc-5f89de40b1e7 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:39.694565 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:39.733802 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78b595-27d9-4f45-aebc-5f89de40b1e7 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:39.771407 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a82ec-6aec-4920-98f8-0a7df7139749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:39.772046 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a82ec-6aec-4920-98f8-0a7df7139749 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:39.772327 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a82ec-6aec-4920-98f8-0a7df7139749 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:39.772669 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a82ec-6aec-4920-98f8-0a7df7139749 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:39.783771 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a82ec-6aec-4920-98f8-0a7df7139749 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:39.785353 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a82ec-6aec-4920-98f8-0a7df7139749 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:39.801372 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-094a82ec-6aec-4920-98f8-0a7df7139749 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:39.801372 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:39.801372 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:39.801372 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:39.801372 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:39.801372 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:39.801372 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:39.801372 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:39.801372 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:39.801372 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:39.801372 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:39.801372 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:39.801372 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:39.801372 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:39.801372 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:39.801372 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:39.802340 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:39.802340 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:39.802340 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:39.802340 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:39.802340 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:39.802340 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:39.802340 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:39.802340 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:39.802340 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:39.802340 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:39.802340 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:39.802340 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:39.802340 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:39.802340 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:39.802340 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:39.802340 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:39.802340 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:39.803407 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:39.803407 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:39.803407 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:39.803407 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 302/612] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:39.810839 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244dc976-9003-453c-b179-d495bae55816 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:39.880327 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:39.949747 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244dc976-9003-453c-b179-d495bae55816 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:39.988428 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f632d68-8d10-4c4e-be53-cbb7b7657c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:39.989089 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f632d68-8d10-4c4e-be53-cbb7b7657c0d None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:39.989371 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f632d68-8d10-4c4e-be53-cbb7b7657c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:39.989640 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f632d68-8d10-4c4e-be53-cbb7b7657c0d None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:39.990304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f632d68-8d10-4c4e-be53-cbb7b7657c0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:39.990603 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f632d68-8d10-4c4e-be53-cbb7b7657c0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:39.992210 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f632d68-8d10-4c4e-be53-cbb7b7657c0d None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:40.006389 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 311/613] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:40.012336 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a82ec-6aec-4920-98f8-0a7df7139749 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:40.049992 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f74d5-b985-4503-b287-d4bb6d148dc2 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:40.050377 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f74d5-b985-4503-b287-d4bb6d148dc2 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:40.050787 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f74d5-b985-4503-b287-d4bb6d148dc2 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:40.052794 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 312/614] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 17:42:40.064785 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eade4e-751b-406e-aba7-2372b05a9480 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:40.065103 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eade4e-751b-406e-aba7-2372b05a9480 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:40.065384 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eade4e-751b-406e-aba7-2372b05a9480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:40.089929 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-91eade4e-751b-406e-aba7-2372b05a9480 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:40.091381 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-91eade4e-751b-406e-aba7-2372b05a9480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:40.158169 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a82ec-6aec-4920-98f8-0a7df7139749 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:40.171814 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 313/615] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 17:42:40.173401 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e57af-a40f-4225-b928-c9cda2964d9b None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:40.173692 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e57af-a40f-4225-b928-c9cda2964d9b None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:40.174018 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e57af-a40f-4225-b928-c9cda2964d9b None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:40.175521 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 314/616] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:40.181075 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8d2a6-d914-4ce7-8906-d197d5b6ef6a None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:40.181356 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8d2a6-d914-4ce7-8906-d197d5b6ef6a None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:40.181623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8d2a6-d914-4ce7-8906-d197d5b6ef6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:40.198692 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2badfbe7-4ee9-4a49-af66-2253b4d5dfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:40.199329 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badfbe7-4ee9-4a49-af66-2253b4d5dfa7 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:40.199613 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badfbe7-4ee9-4a49-af66-2253b4d5dfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:40.199893 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badfbe7-4ee9-4a49-af66-2253b4d5dfa7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:40.200938 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-51d8d2a6-d914-4ce7-8906-d197d5b6ef6a None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:40.202530 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-51d8d2a6-d914-4ce7-8906-d197d5b6ef6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:40.202924 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:40.208288 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2badfbe7-4ee9-4a49-af66-2253b4d5dfa7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:40.210050 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2badfbe7-4ee9-4a49-af66-2253b4d5dfa7 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:40.221647 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-2badfbe7-4ee9-4a49-af66-2253b4d5dfa7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 26 17:42:40.221647 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:40.221647 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:40.221647 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:40.221647 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:40.221647 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:40.221647 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:40.221647 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:40.221647 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:40.221647 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:40.221647 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:40.221647 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:40.221647 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 17:42:40.221647 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 17:42:40.221647 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 17:42:40.221647 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 17:42:40.222679 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:40.222679 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:40.222679 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 17:42:40.222679 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:42:40.222679 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 17:42:40.222679 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:42:40.222679 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:40.222679 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:40.222679 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:40.222679 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:40.222679 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:40.222679 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:40.222679 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:40.222679 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:40.222679 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:40.222679 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:40.222679 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:40.222679 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:40.223635 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:40.223635 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:40.223635 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 17:42:40.223635 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 17:42:40.223635 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 17:42:40.223635 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 17:42:40.223635 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 17:42:40.223635 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 17:42:40.223635 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 26 17:42:40.223635 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:40.223635 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 303/617] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Sep 26 17:42:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:40.229926 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2badfbe7-4ee9-4a49-af66-2253b4d5dfa7 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:40.241120 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:40.290335 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 315/618] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 17:42:40.368557 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2badfbe7-4ee9-4a49-af66-2253b4d5dfa7 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:40.419792 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de71d5c-b3e6-4cf8-90a4-34c16a9b6960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:40.420371 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de71d5c-b3e6-4cf8-90a4-34c16a9b6960 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:40.420651 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de71d5c-b3e6-4cf8-90a4-34c16a9b6960 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:40.420923 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de71d5c-b3e6-4cf8-90a4-34c16a9b6960 None admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:40.421674 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de71d5c-b3e6-4cf8-90a4-34c16a9b6960 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:40.421978 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de71d5c-b3e6-4cf8-90a4-34c16a9b6960 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:40.423417 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de71d5c-b3e6-4cf8-90a4-34c16a9b6960 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:40.448324 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 304/619] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Sep 26 17:42:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:40.454461 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8d2a6-d914-4ce7-8906-d197d5b6ef6a None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:40.491503 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de71d5c-b3e6-4cf8-90a4-34c16a9b6960 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:40.549770 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:40.642883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8d2a6-d914-4ce7-8906-d197d5b6ef6a None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:40.658860 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de71d5c-b3e6-4cf8-90a4-34c16a9b6960 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:40.707994 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1735b06-8151-49be-a8f1-69e06558dea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:40.710135 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1735b06-8151-49be-a8f1-69e06558dea6 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:40.710817 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1735b06-8151-49be-a8f1-69e06558dea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:40.711808 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1735b06-8151-49be-a8f1-69e06558dea6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:40.717065 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07561fc8-8d8d-454d-8291-e1143e2ad2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:40.718613 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07561fc8-8d8d-454d-8291-e1143e2ad2e8 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:40.719302 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07561fc8-8d8d-454d-8291-e1143e2ad2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:40.721875 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07561fc8-8d8d-454d-8291-e1143e2ad2e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:40.735121 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1735b06-8151-49be-a8f1-69e06558dea6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:42:40.742535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-f1735b06-8151-49be-a8f1-69e06558dea6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:42:40.742535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:40.742535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:40.742535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:40.742535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:40.742535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:40.742535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:40.742535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:40.742535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:40.742535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:40.742535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:40.742535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:40.742535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:42:40.742535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:42:40.742535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:42:40.742535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:42:40.743547 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:42:40.743547 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:42:40.743547 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:42:40.743547 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:42:40.743547 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:40.743547 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:40.743547 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:40.743547 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:40.743547 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:40.743547 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:40.743547 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:40.743547 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:40.743547 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:40.743547 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:40.743547 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:40.743547 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:40.744407 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:40.744407 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:40.744407 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:40.744407 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:40.744407 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:42:40.744407 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:42:40.744407 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:42:40.744407 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:42:40.744407 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:42:40.744407 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:42:40.744407 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:42:40.744407 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:40.745077 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07561fc8-8d8d-454d-8291-e1143e2ad2e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:40.745077 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07561fc8-8d8d-454d-8291-e1143e2ad2e8 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:40.748492 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 305/620] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Sep 26 17:42:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:42:40.754163 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1735b06-8151-49be-a8f1-69e06558dea6 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:40.760526 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-07561fc8-8d8d-454d-8291-e1143e2ad2e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:40.760526 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:40.760526 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:40.760526 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:40.760526 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:40.760526 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:40.760526 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:40.760526 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:40.760526 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:40.760526 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:40.760526 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:40.760526 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:40.760526 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:40.760526 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:40.760526 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:40.760526 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:40.761525 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:40.761525 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:40.761525 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:40.761525 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:40.761525 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:40.761525 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:40.761525 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:40.761525 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:40.761525 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:40.761525 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:40.761525 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:40.761525 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:40.761525 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:40.761525 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:40.761525 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:40.761525 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:40.761525 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:40.762430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:40.762430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:40.762430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:40.762430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 316/621] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:40.763942 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07561fc8-8d8d-454d-8291-e1143e2ad2e8 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:40.781666 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:40.865521 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07561fc8-8d8d-454d-8291-e1143e2ad2e8 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:40.870322 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:40.875356 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1735b06-8151-49be-a8f1-69e06558dea6 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:40.901664 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8d062-251a-41be-8ee0-567251bed866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:40.902271 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8d062-251a-41be-8ee0-567251bed866 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:40.902549 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8d062-251a-41be-8ee0-567251bed866 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:40.902819 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8d062-251a-41be-8ee0-567251bed866 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:40.903480 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace8d062-251a-41be-8ee0-567251bed866 None admin] RBAC: Adding query filter params (name=service) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:40.903782 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace8d062-251a-41be-8ee0-567251bed866 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:40.905450 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace8d062-251a-41be-8ee0-567251bed866 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:40.918939 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 317/622] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Sep 26 17:42:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:40.918939 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8d062-251a-41be-8ee0-567251bed866 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:40.920302 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ae828-af5b-44a2-bf0f-eb495762fb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:40.921215 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ae828-af5b-44a2-bf0f-eb495762fb2d None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:40.921709 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ae828-af5b-44a2-bf0f-eb495762fb2d None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:40.922188 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ae828-af5b-44a2-bf0f-eb495762fb2d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:40.934991 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ae828-af5b-44a2-bf0f-eb495762fb2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:42:40.940525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-fb1ae828-af5b-44a2-bf0f-eb495762fb2d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:42:40.940525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:40.940525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:40.940525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:40.940525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:40.940525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:40.940525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:40.940525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:40.940525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:40.940525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:40.940525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:40.940525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:40.940525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:42:40.940525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:42:40.940525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:42:40.940525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:42:40.941458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:42:40.941458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:42:40.941458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:42:40.941458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:42:40.941458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:40.941458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:40.941458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:40.941458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:40.941458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:40.941458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:40.941458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:40.941458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:40.941458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:40.941458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:40.941458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:40.941458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:40.942293 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:40.942293 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:40.942293 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:40.942293 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:40.942293 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:42:40.942293 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:42:40.942293 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:42:40.942293 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:42:40.942293 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:42:40.942293 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:42:40.942293 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:42:40.942293 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:40.946619 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 306/623] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Sep 26 17:42:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:40.947731 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ae828-af5b-44a2-bf0f-eb495762fb2d None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:41.018414 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:41.044000 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8d062-251a-41be-8ee0-567251bed866 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:41.067832 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ae828-af5b-44a2-bf0f-eb495762fb2d None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:41.086523 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fe772-a2a2-4122-b490-9dc18e3929a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:41.087393 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fe772-a2a2-4122-b490-9dc18e3929a0 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:41.087673 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fe772-a2a2-4122-b490-9dc18e3929a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:41.087950 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fe772-a2a2-4122-b490-9dc18e3929a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:41.088991 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fe772-a2a2-4122-b490-9dc18e3929a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:41.089329 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fe772-a2a2-4122-b490-9dc18e3929a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:41.090686 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fe772-a2a2-4122-b490-9dc18e3929a0 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:41.106066 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 318/624] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:41.107446 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fe772-a2a2-4122-b490-9dc18e3929a0 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:41.108127 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced65de-6110-4efd-8a7a-985cdfb1720b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:41.109003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced65de-6110-4efd-8a7a-985cdfb1720b None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:41.109530 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced65de-6110-4efd-8a7a-985cdfb1720b None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:41.110022 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced65de-6110-4efd-8a7a-985cdfb1720b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:41.126839 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ced65de-6110-4efd-8a7a-985cdfb1720b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:41.129203 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ced65de-6110-4efd-8a7a-985cdfb1720b None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:41.144858 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-1ced65de-6110-4efd-8a7a-985cdfb1720b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:41.144858 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:41.144858 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:41.144858 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:41.144858 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:41.144858 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:41.144858 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:41.144858 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:41.144858 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:41.144858 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:41.144858 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:41.144858 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:41.144858 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:41.144858 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:41.144858 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:41.144858 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:41.145887 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:41.145887 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:41.145887 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:41.145887 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:41.145887 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:41.145887 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:41.145887 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:41.145887 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:41.145887 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:41.145887 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:41.145887 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:41.145887 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:41.145887 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:41.145887 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:41.145887 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:41.145887 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:41.145887 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:41.146791 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:41.146791 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:41.146791 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:41.153303 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 307/625] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:41.154837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced65de-6110-4efd-8a7a-985cdfb1720b None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:41.177514 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:41.227591 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fe772-a2a2-4122-b490-9dc18e3929a0 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:41.267918 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f46f3-1dcd-44f2-a895-4b6eb8cd8696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:41.269239 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f46f3-1dcd-44f2-a895-4b6eb8cd8696 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:41.269239 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f46f3-1dcd-44f2-a895-4b6eb8cd8696 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:41.269563 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f46f3-1dcd-44f2-a895-4b6eb8cd8696 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:41.270147 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f46f3-1dcd-44f2-a895-4b6eb8cd8696 None admin] RBAC: Adding query filter params (name=service) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:41.270450 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f46f3-1dcd-44f2-a895-4b6eb8cd8696 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:41.271812 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f46f3-1dcd-44f2-a895-4b6eb8cd8696 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:41.285112 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 319/626] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Sep 26 17:42:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:41.286299 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f46f3-1dcd-44f2-a895-4b6eb8cd8696 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:41.289404 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:41.292459 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced65de-6110-4efd-8a7a-985cdfb1720b None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:41.336064 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c31248-8a14-4a5e-a394-d5e35d067f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:41.336796 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c31248-8a14-4a5e-a394-d5e35d067f07 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:41.337117 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c31248-8a14-4a5e-a394-d5e35d067f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:41.337447 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c31248-8a14-4a5e-a394-d5e35d067f07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:41.347800 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c31248-8a14-4a5e-a394-d5e35d067f07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:41.349752 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c31248-8a14-4a5e-a394-d5e35d067f07 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:41.362187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-79c31248-8a14-4a5e-a394-d5e35d067f07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:42:41.362187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:41.362187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:41.362187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:41.362187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:41.362187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:41.362187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:41.362187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:41.362187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:41.362187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:41.362187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:41.362187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:41.362187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 17:42:41.362187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 17:42:41.362187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 17:42:41.363322 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 17:42:41.363322 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:41.363322 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:41.363322 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:41.363322 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:41.363322 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:41.363322 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:41.363322 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:41.363322 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:41.363322 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:41.363322 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:41.363322 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:41.363322 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:41.363322 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:41.363322 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:41.363322 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:41.363322 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:41.364234 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 17:42:41.364234 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 17:42:41.364234 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 17:42:41.364234 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 17:42:41.364234 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 17:42:41.364234 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 17:42:41.364234 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:42:41.364234 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:41.367858 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 308/627] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:42:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:41.368871 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c31248-8a14-4a5e-a394-d5e35d067f07 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:41.405238 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f46f3-1dcd-44f2-a895-4b6eb8cd8696 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:41.443840 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda110f-e6a4-4cfd-9d85-d99b2489ea0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:41.444255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda110f-e6a4-4cfd-9d85-d99b2489ea0e None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:41.445076 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda110f-e6a4-4cfd-9d85-d99b2489ea0e None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:41.445349 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda110f-e6a4-4cfd-9d85-d99b2489ea0e None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:41.445992 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda110f-e6a4-4cfd-9d85-d99b2489ea0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:41.446295 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda110f-e6a4-4cfd-9d85-d99b2489ea0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:41.447667 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda110f-e6a4-4cfd-9d85-d99b2489ea0e None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:41.448756 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:41.468453 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 320/628] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:41.468453 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda110f-e6a4-4cfd-9d85-d99b2489ea0e None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:41.491235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c31248-8a14-4a5e-a394-d5e35d067f07 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:41.532277 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d635559-4e7f-4a31-94dd-26ce40c01d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:41.533323 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d635559-4e7f-4a31-94dd-26ce40c01d3a None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:41.533807 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d635559-4e7f-4a31-94dd-26ce40c01d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:41.534380 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d635559-4e7f-4a31-94dd-26ce40c01d3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:41.537511 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:41.548439 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d635559-4e7f-4a31-94dd-26ce40c01d3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:41.550493 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d635559-4e7f-4a31-94dd-26ce40c01d3a None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:41.566643 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-9d635559-4e7f-4a31-94dd-26ce40c01d3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:41.566643 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:41.566643 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:41.566643 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:41.566643 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:41.566643 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:41.566643 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:41.566643 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:41.566643 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:41.566643 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:41.566643 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:41.566643 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:41.566643 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:41.566643 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:41.566643 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:41.566643 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:41.567623 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:41.567623 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:41.567623 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:41.567623 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:41.567623 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:41.567623 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:41.567623 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:41.567623 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:41.567623 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:41.567623 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:41.567623 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:41.567623 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:41.567623 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:41.567623 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:41.567623 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:41.567623 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:41.567623 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:41.568500 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:41.568500 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:41.568500 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:41.575854 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 309/629] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:41.577347 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d635559-4e7f-4a31-94dd-26ce40c01d3a None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:41.579571 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda110f-e6a4-4cfd-9d85-d99b2489ea0e None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:41.626633 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a82277-611c-4755-9800-000c0ab5f360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:41.627560 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a82277-611c-4755-9800-000c0ab5f360 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:41.627840 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a82277-611c-4755-9800-000c0ab5f360 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:41.628129 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a82277-611c-4755-9800-000c0ab5f360 None admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:41.628859 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a82277-611c-4755-9800-000c0ab5f360 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:41.629264 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a82277-611c-4755-9800-000c0ab5f360 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:41.631101 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a82277-611c-4755-9800-000c0ab5f360 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:41.647198 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 321/630] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Sep 26 17:42:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:41.648255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a82277-611c-4755-9800-000c0ab5f360 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:41.702470 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d635559-4e7f-4a31-94dd-26ce40c01d3a None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:41.732725 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:41.747953 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cfea5f-dc5a-4ad8-b30c-7524fc137d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:41.748938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfea5f-dc5a-4ad8-b30c-7524fc137d01 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:41.749463 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfea5f-dc5a-4ad8-b30c-7524fc137d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:41.749946 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfea5f-dc5a-4ad8-b30c-7524fc137d01 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:41.758550 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cfea5f-dc5a-4ad8-b30c-7524fc137d01 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:41.760394 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cfea5f-dc5a-4ad8-b30c-7524fc137d01 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:41.774430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-34cfea5f-dc5a-4ad8-b30c-7524fc137d01 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 17:42:41.774430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:41.774430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:41.774430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:41.774430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:41.774430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:41.774430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:41.774430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:41.774430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:41.774430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:41.774430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:41.774430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:41.774430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 17:42:41.774430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 17:42:41.774430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 17:42:41.774430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 17:42:41.775451 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:41.775451 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:41.775451 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 17:42:41.775451 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:42:41.775451 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 17:42:41.775451 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:42:41.775451 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:41.775451 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:41.775451 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:41.775451 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:41.775451 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:41.775451 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:41.775451 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:41.775451 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:41.775451 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:41.775451 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:41.775451 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:41.775451 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:41.776391 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:41.776391 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:41.776391 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 17:42:41.776391 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 17:42:41.776391 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 17:42:41.776391 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 17:42:41.776391 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 17:42:41.776391 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 17:42:41.776391 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 17:42:41.776391 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:41.776926 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a82277-611c-4755-9800-000c0ab5f360 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:41.783875 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 310/631] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Sep 26 17:42:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:41.785394 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cfea5f-dc5a-4ad8-b30c-7524fc137d01 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:41.806549 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:41.823022 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a41e2-6194-4195-a0c9-8dfee7731a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:41.823637 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a41e2-6194-4195-a0c9-8dfee7731a41 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:41.823926 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a41e2-6194-4195-a0c9-8dfee7731a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:41.824200 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a41e2-6194-4195-a0c9-8dfee7731a41 None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:41.824843 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a41e2-6194-4195-a0c9-8dfee7731a41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:41.825172 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a41e2-6194-4195-a0c9-8dfee7731a41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:41.827050 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a41e2-6194-4195-a0c9-8dfee7731a41 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:41.848334 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 322/632] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:41.848334 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a41e2-6194-4195-a0c9-8dfee7731a41 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:41.909395 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cfea5f-dc5a-4ad8-b30c-7524fc137d01 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:41.946052 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e08cc-ca9b-4f10-8842-8374ce36c2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:41.946833 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e08cc-ca9b-4f10-8842-8374ce36c2fb None admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:41.947116 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e08cc-ca9b-4f10-8842-8374ce36c2fb None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:41.947391 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e08cc-ca9b-4f10-8842-8374ce36c2fb None admin] PATH_INFO: `/v3/projects/125361b23eb14b53aca5e0139919881e/users/ea49cd9839474232a0cbe66ccffbf082/roles/4685fd1f2f284d4498281231160a5f27` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:41.963384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e08cc-ca9b-4f10-8842-8374ce36c2fb None admin] RBAC: Authorizing `identity:create_grant(project_id=125361b23eb14b53aca5e0139919881e, user_id=ea49cd9839474232a0cbe66ccffbf082, role_id=4685fd1f2f284d4498281231160a5f27)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:41.963679 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a41e2-6194-4195-a0c9-8dfee7731a41 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:41.964838 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e08cc-ca9b-4f10-8842-8374ce36c2fb None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:41.989053 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 311/633] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Sep 26 17:42:41 2022] PUT /identity/v3/projects/125361b23eb14b53aca5e0139919881e/users/ea49cd9839474232a0cbe66ccffbf082/roles/4685fd1f2f284d4498281231160a5f27 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:42:41.989053 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e08cc-ca9b-4f10-8842-8374ce36c2fb None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:42.017449 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:42.018784 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb0a1c-d670-4f76-b1d8-fa46bfbb85e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:42.019473 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb0a1c-d670-4f76-b1d8-fa46bfbb85e5 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:42.019732 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb0a1c-d670-4f76-b1d8-fa46bfbb85e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:42.020048 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb0a1c-d670-4f76-b1d8-fa46bfbb85e5 None admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:42.021426 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb0a1c-d670-4f76-b1d8-fa46bfbb85e5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:42.021719 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb0a1c-d670-4f76-b1d8-fa46bfbb85e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:42.024115 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb0a1c-d670-4f76-b1d8-fa46bfbb85e5 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:42.045171 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 323/634] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Sep 26 17:42:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:42.045171 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebd9e9-9534-469f-8d53-5069488c6f04 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:42.045171 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebd9e9-9534-469f-8d53-5069488c6f04 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:42.045171 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebd9e9-9534-469f-8d53-5069488c6f04 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:42.050609 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 324/635] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:42.052249 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4a0fd-0793-468b-a00c-2d5e43120ea6 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:42.052536 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4a0fd-0793-468b-a00c-2d5e43120ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:42.052815 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4a0fd-0793-468b-a00c-2d5e43120ea6 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:42.054582 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 325/636] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:42.055398 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4a0fd-0793-468b-a00c-2d5e43120ea6 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:42.103709 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e08cc-ca9b-4f10-8842-8374ce36c2fb None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:42.106206 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:42.142059 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67e332-d9dd-42ed-8be1-c517f707f5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:42.142712 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67e332-d9dd-42ed-8be1-c517f707f5b1 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:42.142986 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67e332-d9dd-42ed-8be1-c517f707f5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:42.143252 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67e332-d9dd-42ed-8be1-c517f707f5b1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:42.152375 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e67e332-d9dd-42ed-8be1-c517f707f5b1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:42.153870 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e67e332-d9dd-42ed-8be1-c517f707f5b1 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:42.167855 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-6e67e332-d9dd-42ed-8be1-c517f707f5b1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 26 17:42:42.167855 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:42.167855 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:42.167855 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:42.167855 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:42.167855 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:42.167855 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:42.167855 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:42.167855 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:42.167855 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:42.167855 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:42.167855 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:42.167855 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 17:42:42.167855 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 17:42:42.167855 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 17:42:42.167855 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 17:42:42.168857 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:42.168857 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:42.168857 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 17:42:42.168857 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:42:42.168857 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 17:42:42.168857 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:42:42.168857 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:42.168857 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:42.168857 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:42.168857 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:42.168857 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:42.168857 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:42.168857 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:42.168857 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:42.168857 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:42.168857 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:42.168857 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:42.168857 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:42.169856 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:42.169856 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:42.169856 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 17:42:42.169856 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 17:42:42.169856 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 17:42:42.169856 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 17:42:42.169856 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 17:42:42.169856 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 17:42:42.169856 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 26 17:42:42.169856 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:42.169856 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 312/637] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:42:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:42.170447 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490dd1d-dd30-4faf-994c-9bd044a472a3 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:42.170447 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490dd1d-dd30-4faf-994c-9bd044a472a3 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:42.170447 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490dd1d-dd30-4faf-994c-9bd044a472a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:42.183932 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4a0fd-0793-468b-a00c-2d5e43120ea6 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:42.191012 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-3490dd1d-dd30-4faf-994c-9bd044a472a3 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:42.192182 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-3490dd1d-dd30-4faf-994c-9bd044a472a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:42.222006 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21cd342-a9a0-4201-aacf-6f51d39adc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:42.222619 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21cd342-a9a0-4201-aacf-6f51d39adc2f None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:42.223048 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21cd342-a9a0-4201-aacf-6f51d39adc2f None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:42.223323 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21cd342-a9a0-4201-aacf-6f51d39adc2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:42.273034 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 313/638] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:42:42.273034 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3ab16-3859-46b0-a02d-d0664f2992ce None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:42.273034 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3ab16-3859-46b0-a02d-d0664f2992ce None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:42.273034 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3ab16-3859-46b0-a02d-d0664f2992ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:42.289946 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-0ff3ab16-3859-46b0-a02d-d0664f2992ce None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:42.291189 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-0ff3ab16-3859-46b0-a02d-d0664f2992ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:42.301648 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21cd342-a9a0-4201-aacf-6f51d39adc2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:42.303036 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21cd342-a9a0-4201-aacf-6f51d39adc2f None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:42.310014 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:42.346616 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:42.369376 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 314/639] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:42:42.370722 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3ab16-3859-46b0-a02d-d0664f2992ce None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:42.448971 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 326/640] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:42:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 17:42:42.460689 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21cd342-a9a0-4201-aacf-6f51d39adc2f None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:42.494970 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3ab16-3859-46b0-a02d-d0664f2992ce None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:42.532544 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f61071-68e8-4b6c-8ca5-f71941ea0ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:42.533671 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f61071-68e8-4b6c-8ca5-f71941ea0ca3 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:42.534160 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f61071-68e8-4b6c-8ca5-f71941ea0ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:42.534620 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f61071-68e8-4b6c-8ca5-f71941ea0ca3 None admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:42.535617 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f61071-68e8-4b6c-8ca5-f71941ea0ca3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:42.536113 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f61071-68e8-4b6c-8ca5-f71941ea0ca3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:42.538428 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f61071-68e8-4b6c-8ca5-f71941ea0ca3 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:42.558019 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 315/641] 10.222.0.62 () {56 vars in 1137 bytes} [Mon Sep 26 17:42:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:42.563715 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f61071-68e8-4b6c-8ca5-f71941ea0ca3 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:42.585767 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:42.634746 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21cd342-a9a0-4201-aacf-6f51d39adc2f None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:42.669806 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9bf3e-e54f-4fc0-b254-400e7589dd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:42.670466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9bf3e-e54f-4fc0-b254-400e7589dd28 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:42.670742 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9bf3e-e54f-4fc0-b254-400e7589dd28 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:42.671009 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9bf3e-e54f-4fc0-b254-400e7589dd28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:42.680999 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:42.683376 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9bf3e-e54f-4fc0-b254-400e7589dd28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:42.685359 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9bf3e-e54f-4fc0-b254-400e7589dd28 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:42.698787 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f61071-68e8-4b6c-8ca5-f71941ea0ca3 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:42.702437 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-07e9bf3e-e54f-4fc0-b254-400e7589dd28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:42.702437 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:42.702437 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:42.702437 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:42.702437 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:42.702437 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:42.702437 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:42.702437 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:42.702437 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:42.702437 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:42.702437 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:42.702437 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:42.702437 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:42.702437 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:42.702437 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:42.702437 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:42.703362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:42.703362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:42.703362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:42.703362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:42.703362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:42.703362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:42.703362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:42.703362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:42.703362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:42.703362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:42.703362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:42.703362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:42.703362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:42.703362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:42.703362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:42.703362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:42.703362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:42.704241 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:42.704241 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:42.704241 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:42.704241 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 327/642] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:42:42.705050 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9bf3e-e54f-4fc0-b254-400e7589dd28 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:42.737565 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb936aac-ab3d-436b-a10d-0f4b81632bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:42.738180 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb936aac-ab3d-436b-a10d-0f4b81632bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:42.738474 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb936aac-ab3d-436b-a10d-0f4b81632bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:42.738741 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb936aac-ab3d-436b-a10d-0f4b81632bb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:42.806417 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb936aac-ab3d-436b-a10d-0f4b81632bb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:42.807906 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb936aac-ab3d-436b-a10d-0f4b81632bb1 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:42.819748 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:42.826532 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9bf3e-e54f-4fc0-b254-400e7589dd28 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:42.863431 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4010f5-3914-4607-9cdd-9007039e804b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:42.864054 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4010f5-3914-4607-9cdd-9007039e804b None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:42.864331 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4010f5-3914-4607-9cdd-9007039e804b None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:42.864606 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4010f5-3914-4607-9cdd-9007039e804b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:42.875717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4010f5-3914-4607-9cdd-9007039e804b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:42:42.881448 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-1e4010f5-3914-4607-9cdd-9007039e804b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:42:42.881448 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:42.881448 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:42.881448 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:42.881448 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:42.881448 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:42.881448 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:42.881448 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:42.881448 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:42.881448 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:42.881448 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:42.881448 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:42.881448 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:42:42.881448 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:42:42.881448 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:42:42.881448 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:42:42.882458 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:42:42.882458 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:42:42.882458 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:42:42.882458 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:42:42.882458 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:42.882458 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:42.882458 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:42.882458 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:42.882458 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:42.882458 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:42.882458 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:42.882458 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:42.882458 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:42.882458 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:42.882458 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:42.882458 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:42.883321 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:42.883321 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:42.883321 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:42.883321 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:42.883321 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:42:42.883321 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:42:42.883321 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:42:42.883321 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:42:42.883321 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:42:42.883321 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:42:42.883321 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:42:42.883321 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:42.883321 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 328/643] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Sep 26 17:42:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:42.883321 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4010f5-3914-4607-9cdd-9007039e804b None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:42.925302 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 316/644] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:42:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 17:42:42.926412 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb936aac-ab3d-436b-a10d-0f4b81632bb1 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:42.942959 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:42.995153 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4010f5-3914-4607-9cdd-9007039e804b None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:43.029266 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e2c7a-d98f-4016-a217-0b98486e6a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:43.029895 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e2c7a-d98f-4016-a217-0b98486e6a9f None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:43.030162 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e2c7a-d98f-4016-a217-0b98486e6a9f None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:43.030438 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e2c7a-d98f-4016-a217-0b98486e6a9f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:43.041647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e2c7a-d98f-4016-a217-0b98486e6a9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:42:43.042943 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb936aac-ab3d-436b-a10d-0f4b81632bb1 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:43.046923 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-f18e2c7a-d98f-4016-a217-0b98486e6a9f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:42:43.046923 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:43.046923 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:43.046923 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:43.046923 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:43.046923 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:43.046923 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:43.046923 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:43.046923 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:43.046923 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:43.046923 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:43.046923 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:43.046923 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:42:43.046923 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:42:43.046923 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:42:43.046923 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:42:43.047832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:42:43.047832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:42:43.047832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:42:43.047832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:42:43.047832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:43.047832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:43.047832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:43.047832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:43.047832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:43.047832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:43.047832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:43.047832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:43.047832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:43.047832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:43.047832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:43.047832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:43.049028 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:43.049028 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:43.049028 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:43.049028 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:43.049028 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:42:43.049028 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:42:43.049028 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:42:43.049028 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:42:43.049028 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:42:43.049028 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:42:43.049028 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:42:43.049028 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:43.049028 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 329/645] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Sep 26 17:42:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:43.049767 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e2c7a-d98f-4016-a217-0b98486e6a9f None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:43.061538 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:43.091984 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95359a9f-8a72-432a-92cd-6db671556e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:43.092516 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95359a9f-8a72-432a-92cd-6db671556e43 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:43.092795 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95359a9f-8a72-432a-92cd-6db671556e43 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:43.093101 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95359a9f-8a72-432a-92cd-6db671556e43 None admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:43.093862 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95359a9f-8a72-432a-92cd-6db671556e43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:43.094166 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95359a9f-8a72-432a-92cd-6db671556e43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:43.095534 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95359a9f-8a72-432a-92cd-6db671556e43 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:43.110981 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 317/646] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:43.110981 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95359a9f-8a72-432a-92cd-6db671556e43 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:43.162467 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e2c7a-d98f-4016-a217-0b98486e6a9f None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:43.175600 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:43.200953 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c4955-7133-441f-acaf-0b6896a19d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:43.201905 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c4955-7133-441f-acaf-0b6896a19d56 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:43.202303 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c4955-7133-441f-acaf-0b6896a19d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:43.202457 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c4955-7133-441f-acaf-0b6896a19d56 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:43.203115 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c4955-7133-441f-acaf-0b6896a19d56 None admin] RBAC: Adding query filter params (name=service) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:43.203420 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c4955-7133-441f-acaf-0b6896a19d56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:43.204798 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c4955-7133-441f-acaf-0b6896a19d56 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:43.212866 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 330/647] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Sep 26 17:42:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:43.218236 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c4955-7133-441f-acaf-0b6896a19d56 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:43.225677 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95359a9f-8a72-432a-92cd-6db671556e43 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:43.263106 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c2d62-5b16-4c08-a01d-0d769bf0fcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:43.263736 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c2d62-5b16-4c08-a01d-0d769bf0fcbb None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:43.264009 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c2d62-5b16-4c08-a01d-0d769bf0fcbb None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:43.264275 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c2d62-5b16-4c08-a01d-0d769bf0fcbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:43.276205 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c2d62-5b16-4c08-a01d-0d769bf0fcbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:43.277904 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c2d62-5b16-4c08-a01d-0d769bf0fcbb None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:43.292012 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-fa1c2d62-5b16-4c08-a01d-0d769bf0fcbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:43.292012 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:43.292012 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:43.292012 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:43.292012 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:43.292012 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:43.292012 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:43.292012 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:43.292012 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:43.292012 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:43.292012 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:43.292012 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:43.292012 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:43.292012 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:43.292012 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:43.292012 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:43.293040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:43.293040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:43.293040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:43.293040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:43.293040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:43.293040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:43.293040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:43.293040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:43.293040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:43.293040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:43.293040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:43.293040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:43.293040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:43.293040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:43.293040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:43.293040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:43.293040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:43.293992 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:43.293992 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:43.293992 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:43.293992 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 318/648] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:43.293992 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c2d62-5b16-4c08-a01d-0d769bf0fcbb None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:43.320001 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:43.332577 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c4955-7133-441f-acaf-0b6896a19d56 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:43.371084 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b8f35-7971-491f-8857-eed916b96b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:43.371617 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b8f35-7971-491f-8857-eed916b96b6a None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:43.371899 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b8f35-7971-491f-8857-eed916b96b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:43.372172 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b8f35-7971-491f-8857-eed916b96b6a None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:43.372940 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b8f35-7971-491f-8857-eed916b96b6a None admin] RBAC: Adding query filter params (name=service) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:43.373271 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b8f35-7971-491f-8857-eed916b96b6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:43.374754 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b8f35-7971-491f-8857-eed916b96b6a None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:43.399399 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 331/649] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Sep 26 17:42:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:43.399588 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c2d62-5b16-4c08-a01d-0d769bf0fcbb None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:43.399683 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b8f35-7971-491f-8857-eed916b96b6a None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:43.433053 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22066e-7f9c-4dfa-b1d9-a986f4fbeb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:43.433433 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22066e-7f9c-4dfa-b1d9-a986f4fbeb42 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:43.433844 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22066e-7f9c-4dfa-b1d9-a986f4fbeb42 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:43.434121 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22066e-7f9c-4dfa-b1d9-a986f4fbeb42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:43.435233 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:43.442187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c22066e-7f9c-4dfa-b1d9-a986f4fbeb42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:43.443897 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c22066e-7f9c-4dfa-b1d9-a986f4fbeb42 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:43.455420 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-9c22066e-7f9c-4dfa-b1d9-a986f4fbeb42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:42:43.455420 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:43.455420 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:43.455420 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:43.455420 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:43.455420 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:43.455420 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:43.455420 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:43.455420 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:43.455420 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:43.455420 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:43.455420 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:43.455420 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 17:42:43.455420 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 17:42:43.455420 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 17:42:43.456424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 17:42:43.456424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:43.456424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:43.456424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:43.456424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:43.456424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:43.456424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:43.456424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:43.456424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:43.456424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:43.456424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:43.456424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:43.456424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:43.456424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:43.456424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:43.456424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:43.456424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:43.457388 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 17:42:43.457388 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 17:42:43.457388 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 17:42:43.457388 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 17:42:43.457388 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 17:42:43.457388 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 17:42:43.457388 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:42:43.457388 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:43.457388 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 319/650] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:42:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:43.457863 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22066e-7f9c-4dfa-b1d9-a986f4fbeb42 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:43.508601 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b8f35-7971-491f-8857-eed916b96b6a None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:43.544138 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d5770-ed3e-42db-9b89-23cfa3986a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:43.544791 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:43.545150 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d5770-ed3e-42db-9b89-23cfa3986a84 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:43.545793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d5770-ed3e-42db-9b89-23cfa3986a84 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:43.546381 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d5770-ed3e-42db-9b89-23cfa3986a84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:43.557479 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d5770-ed3e-42db-9b89-23cfa3986a84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:43.559014 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d5770-ed3e-42db-9b89-23cfa3986a84 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:43.564959 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22066e-7f9c-4dfa-b1d9-a986f4fbeb42 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:43.576658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-a50d5770-ed3e-42db-9b89-23cfa3986a84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:43.576658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:43.576658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:43.576658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:43.576658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:43.576658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:43.576658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:43.576658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:43.576658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:43.576658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:43.576658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:43.576658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:43.576658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:43.576658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:43.576658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:43.576658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:43.577954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:43.577954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:43.577954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:43.577954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:43.577954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:43.577954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:43.577954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:43.577954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:43.577954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:43.577954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:43.577954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:43.577954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:43.577954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:43.577954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:43.577954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:43.577954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:43.577954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:43.578946 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:43.578946 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:43.578946 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:43.581441 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 332/651] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:43.582598 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d5770-ed3e-42db-9b89-23cfa3986a84 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:43.605114 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4439f03-b410-43d9-afab-297fb6a1cf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:43.605811 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4439f03-b410-43d9-afab-297fb6a1cf29 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:43.606152 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4439f03-b410-43d9-afab-297fb6a1cf29 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:43.606506 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4439f03-b410-43d9-afab-297fb6a1cf29 None admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:43.607207 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4439f03-b410-43d9-afab-297fb6a1cf29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:43.607578 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4439f03-b410-43d9-afab-297fb6a1cf29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:43.609031 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4439f03-b410-43d9-afab-297fb6a1cf29 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:43.623571 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 320/652] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:43.623960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4439f03-b410-43d9-afab-297fb6a1cf29 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:43.684269 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:43.698277 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d5770-ed3e-42db-9b89-23cfa3986a84 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:43.732685 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4439f03-b410-43d9-afab-297fb6a1cf29 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:43.736158 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b502d8-c8ae-4d0d-87d0-554f9786dfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:43.736920 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b502d8-c8ae-4d0d-87d0-554f9786dfe2 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:43.737332 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b502d8-c8ae-4d0d-87d0-554f9786dfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:43.738106 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b502d8-c8ae-4d0d-87d0-554f9786dfe2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:43.749501 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b502d8-c8ae-4d0d-87d0-554f9786dfe2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:43.751061 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b502d8-c8ae-4d0d-87d0-554f9786dfe2 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:43.766652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-64b502d8-c8ae-4d0d-87d0-554f9786dfe2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:43.766652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:43.766652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:43.766652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:43.766652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:43.766652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:43.766652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:43.766652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:43.766652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:43.766652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:43.766652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:43.766652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:43.766652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:43.766652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:43.766652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:43.766652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:43.767781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:43.767781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:43.767781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:43.767781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:43.767781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:43.767781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:43.767781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:43.767781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:43.767781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:43.767781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:43.767781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:43.767781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:43.767781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:43.767781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:43.767781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:43.767781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:43.767781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:43.768862 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:43.768862 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:43.768862 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:43.774130 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 333/653] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:43.774130 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b502d8-c8ae-4d0d-87d0-554f9786dfe2 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:43.776086 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5833ca-bf6d-4f0b-b3d8-22e50e4d6710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:43.776705 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5833ca-bf6d-4f0b-b3d8-22e50e4d6710 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:43.776982 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5833ca-bf6d-4f0b-b3d8-22e50e4d6710 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:43.777282 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5833ca-bf6d-4f0b-b3d8-22e50e4d6710 None admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:43.777972 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5833ca-bf6d-4f0b-b3d8-22e50e4d6710 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:43.778275 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5833ca-bf6d-4f0b-b3d8-22e50e4d6710 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:43.779717 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5833ca-bf6d-4f0b-b3d8-22e50e4d6710 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:43.797962 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 321/654] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Sep 26 17:42:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:43.797962 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5833ca-bf6d-4f0b-b3d8-22e50e4d6710 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:43.797962 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:43.898234 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b502d8-c8ae-4d0d-87d0-554f9786dfe2 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:43.918098 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5833ca-bf6d-4f0b-b3d8-22e50e4d6710 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:43.935797 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261a8fc-f8e6-4703-b888-337b436ee0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:43.936900 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261a8fc-f8e6-4703-b888-337b436ee0d0 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:43.937398 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261a8fc-f8e6-4703-b888-337b436ee0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:43.937878 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261a8fc-f8e6-4703-b888-337b436ee0d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:43.938710 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2261a8fc-f8e6-4703-b888-337b436ee0d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:43.939220 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2261a8fc-f8e6-4703-b888-337b436ee0d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:43.941110 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2261a8fc-f8e6-4703-b888-337b436ee0d0 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:43.953046 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:43.954975 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91300d-8f94-46ca-b8a4-231a0c9c21f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:43.955601 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91300d-8f94-46ca-b8a4-231a0c9c21f0 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:43.955877 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91300d-8f94-46ca-b8a4-231a0c9c21f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:43.956151 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91300d-8f94-46ca-b8a4-231a0c9c21f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:43.957572 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 334/655] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:43.958594 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261a8fc-f8e6-4703-b888-337b436ee0d0 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:43.968637 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e91300d-8f94-46ca-b8a4-231a0c9c21f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:43.970505 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e91300d-8f94-46ca-b8a4-231a0c9c21f0 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:43.982229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-5e91300d-8f94-46ca-b8a4-231a0c9c21f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:42:43.982229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:43.982229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:43.982229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:43.982229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:43.982229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:43.982229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:43.982229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:43.982229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:43.982229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:43.982229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:43.982229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:43.982229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 17:42:43.982229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 17:42:43.982229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 17:42:43.983269 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 17:42:43.983269 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:43.983269 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:43.983269 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:43.983269 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:43.983269 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:43.983269 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:43.983269 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:43.983269 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:43.983269 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:43.983269 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:43.983269 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:43.983269 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:43.983269 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:43.983269 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:43.983269 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:43.983269 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:43.984339 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 17:42:43.984339 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 17:42:43.984339 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 17:42:43.984339 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 17:42:43.984339 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 17:42:43.984339 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 17:42:43.984339 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:42:43.984339 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:43.988006 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 322/656] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:42:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:43.988842 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91300d-8f94-46ca-b8a4-231a0c9c21f0 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:44.051047 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:44.078471 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261a8fc-f8e6-4703-b888-337b436ee0d0 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:44.101003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91300d-8f94-46ca-b8a4-231a0c9c21f0 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:44.119389 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65274f46-6568-4770-90bd-a420fafbbd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:44.120000 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65274f46-6568-4770-90bd-a420fafbbd70 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:44.120297 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65274f46-6568-4770-90bd-a420fafbbd70 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:44.120549 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65274f46-6568-4770-90bd-a420fafbbd70 None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:44.121245 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65274f46-6568-4770-90bd-a420fafbbd70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:44.121540 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65274f46-6568-4770-90bd-a420fafbbd70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:44.122902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65274f46-6568-4770-90bd-a420fafbbd70 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:44.139336 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 335/657] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:44.139336 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65274f46-6568-4770-90bd-a420fafbbd70 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:44.143852 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd65bc-2602-44a8-add3-ec3cb9d2c635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:44.144795 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd65bc-2602-44a8-add3-ec3cb9d2c635 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:44.145109 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd65bc-2602-44a8-add3-ec3cb9d2c635 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:44.145387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd65bc-2602-44a8-add3-ec3cb9d2c635 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:44.146122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd65bc-2602-44a8-add3-ec3cb9d2c635 None admin] RBAC: Adding query filter params (role.id=4685fd1f2f284d4498281231160a5f27, scope.project.id=125361b23eb14b53aca5e0139919881e, user.id=1792e79b9c9a47e1923f19bfd2cd495b) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:44.146434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd65bc-2602-44a8-add3-ec3cb9d2c635 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:44.147930 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd65bc-2602-44a8-add3-ec3cb9d2c635 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:44.165124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 323/658] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:42:43 2022] GET /identity/v3/role_assignments?user.id=1792e79b9c9a47e1923f19bfd2cd495b&scope.project.id=125361b23eb14b53aca5e0139919881e&role.id=4685fd1f2f284d4498281231160a5f27 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:44.165124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd65bc-2602-44a8-add3-ec3cb9d2c635 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:44.234957 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:44.283596 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65274f46-6568-4770-90bd-a420fafbbd70 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:44.291542 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd65bc-2602-44a8-add3-ec3cb9d2c635 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:44.320460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:44.329262 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a69981-1056-416b-a065-fdbbb52dbe6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:44.329906 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a69981-1056-416b-a065-fdbbb52dbe6e None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:44.330187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a69981-1056-416b-a065-fdbbb52dbe6e None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:44.330300 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a48c3-4402-485e-b629-98c227360edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:44.330511 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a69981-1056-416b-a065-fdbbb52dbe6e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:44.330880 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a48c3-4402-485e-b629-98c227360edc None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:44.331166 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a48c3-4402-485e-b629-98c227360edc None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:44.331433 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a48c3-4402-485e-b629-98c227360edc None admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:44.332130 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a48c3-4402-485e-b629-98c227360edc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:44.332437 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a48c3-4402-485e-b629-98c227360edc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:44.333902 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a48c3-4402-485e-b629-98c227360edc None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:44.339946 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a69981-1056-416b-a065-fdbbb52dbe6e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:44.341928 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a69981-1056-416b-a065-fdbbb52dbe6e None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:44.347325 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 324/659] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Sep 26 17:42:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:44.348424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a48c3-4402-485e-b629-98c227360edc None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:44.355408 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-c4a69981-1056-416b-a065-fdbbb52dbe6e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 17:42:44.355408 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:44.355408 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:44.355408 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:44.355408 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:44.355408 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:44.355408 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:44.355408 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:44.355408 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:44.355408 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:44.355408 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:44.355408 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:44.355408 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 17:42:44.355408 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 17:42:44.355408 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 17:42:44.355408 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 17:42:44.356349 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:44.356349 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:44.356349 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 17:42:44.356349 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:42:44.356349 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 17:42:44.356349 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:42:44.356349 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:44.356349 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:44.356349 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:44.356349 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:44.356349 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:44.356349 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:44.356349 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:44.356349 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:44.356349 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:44.356349 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:44.356349 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:44.356349 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:44.357295 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:44.357295 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:44.357295 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 17:42:44.357295 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 17:42:44.357295 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 17:42:44.357295 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 17:42:44.357295 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 17:42:44.357295 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 17:42:44.357295 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 17:42:44.357295 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:44.357295 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 336/660] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:42:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:44.357884 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391948b-47a7-488e-9212-bd1b4ae4bff4 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:44.359646 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391948b-47a7-488e-9212-bd1b4ae4bff4 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:44.359646 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391948b-47a7-488e-9212-bd1b4ae4bff4 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:44.363783 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 337/661] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:44.364616 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391948b-47a7-488e-9212-bd1b4ae4bff4 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:44.467886 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a48c3-4402-485e-b629-98c227360edc None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:44.486699 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391948b-47a7-488e-9212-bd1b4ae4bff4 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:44.504632 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2f7d6-3998-4b2a-9282-dcf48abcdf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:44.505312 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2f7d6-3998-4b2a-9282-dcf48abcdf99 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:44.505595 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2f7d6-3998-4b2a-9282-dcf48abcdf99 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:44.505873 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2f7d6-3998-4b2a-9282-dcf48abcdf99 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:44.509202 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:44.513898 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2f7d6-3998-4b2a-9282-dcf48abcdf99 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:44.515356 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2f7d6-3998-4b2a-9282-dcf48abcdf99 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:44.524972 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ccbe54-6221-407a-8a15-3d2444fb3741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:44.525605 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccbe54-6221-407a-8a15-3d2444fb3741 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:44.525884 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccbe54-6221-407a-8a15-3d2444fb3741 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:44.526151 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccbe54-6221-407a-8a15-3d2444fb3741 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:44.526870 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ccbe54-6221-407a-8a15-3d2444fb3741 None admin] RBAC: Adding query filter params (role.id=4685fd1f2f284d4498281231160a5f27, scope.project.id=125361b23eb14b53aca5e0139919881e, user.id=ab3b7ac09599477bb0c6c1d32e2d5dbe) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:44.527125 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-3fd2f7d6-3998-4b2a-9282-dcf48abcdf99 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 26 17:42:44.527125 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:44.527125 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:44.527125 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:44.527125 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:44.527125 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:44.527125 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:44.527125 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:44.527125 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:44.527125 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:44.527125 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:44.527125 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:44.527125 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 17:42:44.527125 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 17:42:44.527125 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 17:42:44.527125 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 17:42:44.528096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:44.528096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:44.528096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 17:42:44.528096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:42:44.528096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 17:42:44.528096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:42:44.528096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:44.528096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:44.528096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:44.528096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:44.528096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:44.528096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:44.528096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:44.528096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:44.528096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:44.528096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:44.528096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:44.528096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:44.529089 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:44.529089 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:44.529089 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 17:42:44.529089 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 17:42:44.529089 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 17:42:44.529089 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 17:42:44.529089 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 17:42:44.529089 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 17:42:44.529089 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 26 17:42:44.529089 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:44.529661 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ccbe54-6221-407a-8a15-3d2444fb3741 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:44.529744 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 325/662] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Sep 26 17:42:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:44.529814 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ccbe54-6221-407a-8a15-3d2444fb3741 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:44.529890 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2f7d6-3998-4b2a-9282-dcf48abcdf99 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:44.541684 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 338/663] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:42:44 2022] GET /identity/v3/role_assignments?user.id=ab3b7ac09599477bb0c6c1d32e2d5dbe&scope.project.id=125361b23eb14b53aca5e0139919881e&role.id=4685fd1f2f284d4498281231160a5f27 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:44.541684 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80930376-17a9-4c8a-96d4-d40ae08ca5d7 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:44.541684 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80930376-17a9-4c8a-96d4-d40ae08ca5d7 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:44.541684 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80930376-17a9-4c8a-96d4-d40ae08ca5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:44.559497 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-80930376-17a9-4c8a-96d4-d40ae08ca5d7 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:44.560849 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-80930376-17a9-4c8a-96d4-d40ae08ca5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:44.585691 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:44.662812 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 339/664] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:42:44.664486 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80930376-17a9-4c8a-96d4-d40ae08ca5d7 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:44.667252 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2f7d6-3998-4b2a-9282-dcf48abcdf99 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:44.715275 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581756bc-ce71-4df0-a204-43f41ceb897c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:44.716150 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581756bc-ce71-4df0-a204-43f41ceb897c None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:44.716601 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581756bc-ce71-4df0-a204-43f41ceb897c None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:44.717044 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581756bc-ce71-4df0-a204-43f41ceb897c None admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:44.719946 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581756bc-ce71-4df0-a204-43f41ceb897c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:44.720443 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581756bc-ce71-4df0-a204-43f41ceb897c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:44.722508 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581756bc-ce71-4df0-a204-43f41ceb897c None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:44.749575 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 326/665] 10.222.0.62 () {56 vars in 1137 bytes} [Mon Sep 26 17:42:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:44.755266 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581756bc-ce71-4df0-a204-43f41ceb897c None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:44.816011 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80930376-17a9-4c8a-96d4-d40ae08ca5d7 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:44.833574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:44.868001 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3321ace-f708-4a93-b0d4-14e92242a0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:44.868243 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3321ace-f708-4a93-b0d4-14e92242a0f8 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:44.868440 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3321ace-f708-4a93-b0d4-14e92242a0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:44.868707 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3321ace-f708-4a93-b0d4-14e92242a0f8 None admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:44.870210 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3321ace-f708-4a93-b0d4-14e92242a0f8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:44.870210 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3321ace-f708-4a93-b0d4-14e92242a0f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:44.872331 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3321ace-f708-4a93-b0d4-14e92242a0f8 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:44.893467 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 340/666] 10.222.0.62 () {56 vars in 1139 bytes} [Mon Sep 26 17:42:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:44.900228 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3321ace-f708-4a93-b0d4-14e92242a0f8 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:44.902604 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581756bc-ce71-4df0-a204-43f41ceb897c None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:44.913851 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:44.951016 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05163b0b-53c2-4698-ac1f-db1aca35a835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:44.952184 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05163b0b-53c2-4698-ac1f-db1aca35a835 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:44.953138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05163b0b-53c2-4698-ac1f-db1aca35a835 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:44.953559 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05163b0b-53c2-4698-ac1f-db1aca35a835 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:45.030052 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3321ace-f708-4a93-b0d4-14e92242a0f8 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:45.039259 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05163b0b-53c2-4698-ac1f-db1aca35a835 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:45.040833 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05163b0b-53c2-4698-ac1f-db1aca35a835 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:45.066289 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6f6b8-24a7-4212-bf02-66b0837bcea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:45.066896 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6f6b8-24a7-4212-bf02-66b0837bcea9 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:45.067176 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6f6b8-24a7-4212-bf02-66b0837bcea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:45.067447 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6f6b8-24a7-4212-bf02-66b0837bcea9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:45.110434 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:45.137690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6f6b8-24a7-4212-bf02-66b0837bcea9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:45.139163 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6f6b8-24a7-4212-bf02-66b0837bcea9 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:45.161843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 327/667] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:42:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 17:42:45.163178 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05163b0b-53c2-4698-ac1f-db1aca35a835 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:45.193524 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:45.243353 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 341/668] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:42:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 26 17:42:45.244457 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6f6b8-24a7-4212-bf02-66b0837bcea9 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:45.284441 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05163b0b-53c2-4698-ac1f-db1aca35a835 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:45.322012 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:45.325983 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd509e4-5549-4e54-bd37-de69e2df5ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:45.328398 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd509e4-5549-4e54-bd37-de69e2df5ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:45.328398 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd509e4-5549-4e54-bd37-de69e2df5ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:45.328398 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd509e4-5549-4e54-bd37-de69e2df5ed4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:45.340757 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd509e4-5549-4e54-bd37-de69e2df5ed4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:42:45.346379 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-efd509e4-5549-4e54-bd37-de69e2df5ed4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:42:45.346379 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:45.346379 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:45.346379 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:45.346379 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:45.346379 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:45.346379 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:45.346379 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:45.346379 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:45.346379 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:45.346379 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:45.346379 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:45.346379 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:42:45.346379 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:42:45.346379 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:42:45.346379 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:42:45.347558 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:42:45.347558 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:42:45.347558 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:42:45.347558 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:42:45.347558 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:45.347558 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:45.347558 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:45.347558 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:45.347558 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:45.347558 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:45.347558 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:45.347558 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:45.347558 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:45.347558 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:45.347558 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:45.347558 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:45.348475 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:45.348475 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:45.348475 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:45.348475 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:45.348475 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:42:45.348475 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:42:45.348475 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:42:45.348475 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:42:45.348475 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:42:45.348475 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:42:45.348475 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:42:45.348475 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:45.351012 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 328/669] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Sep 26 17:42:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:45.352062 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd509e4-5549-4e54-bd37-de69e2df5ed4 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:45.353276 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6f6b8-24a7-4212-bf02-66b0837bcea9 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:45.389763 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89361d-3e4f-48db-81a2-1ca85e77f9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:45.390400 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89361d-3e4f-48db-81a2-1ca85e77f9ec None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:45.392796 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89361d-3e4f-48db-81a2-1ca85e77f9ec None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:45.393103 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89361d-3e4f-48db-81a2-1ca85e77f9ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:45.403711 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89361d-3e4f-48db-81a2-1ca85e77f9ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:45.405200 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89361d-3e4f-48db-81a2-1ca85e77f9ec None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:45.420186 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-7f89361d-3e4f-48db-81a2-1ca85e77f9ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:45.420186 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:45.420186 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:45.420186 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:45.420186 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:45.420186 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:45.420186 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:45.420186 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:45.420186 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:45.420186 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:45.420186 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:45.420186 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:45.420186 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:45.420186 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:45.420186 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:45.420186 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:45.421430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:45.421430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:45.421430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:45.421430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:45.421430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:45.421430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:45.421430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:45.421430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:45.421430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:45.421430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:45.421430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:45.421430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:45.421430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:45.421430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:45.421430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:45.421430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:45.421430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:45.422585 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:45.422585 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:45.422585 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:45.422585 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 342/670] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:45.422585 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89361d-3e4f-48db-81a2-1ca85e77f9ec None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:45.428101 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:45.473177 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd509e4-5549-4e54-bd37-de69e2df5ed4 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:45.512092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9352f-e981-4c74-86ac-87cc36755bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:45.513152 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9352f-e981-4c74-86ac-87cc36755bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:45.513578 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9352f-e981-4c74-86ac-87cc36755bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:45.514019 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9352f-e981-4c74-86ac-87cc36755bb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:45.525805 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89361d-3e4f-48db-81a2-1ca85e77f9ec None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:45.526069 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9352f-e981-4c74-86ac-87cc36755bb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:45.527788 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9352f-e981-4c74-86ac-87cc36755bb1 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:45.544885 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-00e9352f-e981-4c74-86ac-87cc36755bb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:45.544885 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:45.544885 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:45.544885 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:45.544885 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:45.544885 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:45.544885 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:45.544885 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:45.544885 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:45.544885 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:45.544885 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:45.544885 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:45.544885 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:45.544885 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:45.544885 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:45.544885 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:45.546093 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:45.546093 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:45.546093 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:45.546093 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:45.546093 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:45.546093 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:45.546093 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:45.546093 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:45.546093 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:45.546093 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:45.546093 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:45.546093 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:45.546093 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:45.546093 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:45.546093 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:45.546093 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:45.546093 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:45.547107 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:45.547107 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:45.547107 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:45.550035 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:45.554613 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 329/671] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:45.555826 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9352f-e981-4c74-86ac-87cc36755bb1 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:45.562114 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0558c-51f8-4934-b17b-cb16e5900206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:45.562724 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0558c-51f8-4934-b17b-cb16e5900206 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:45.563005 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0558c-51f8-4934-b17b-cb16e5900206 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:45.563278 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0558c-51f8-4934-b17b-cb16e5900206 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:45.563939 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0558c-51f8-4934-b17b-cb16e5900206 None admin] RBAC: Adding query filter params (name=service) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:45.564244 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0558c-51f8-4934-b17b-cb16e5900206 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:45.565803 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0558c-51f8-4934-b17b-cb16e5900206 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:45.575957 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 343/672] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Sep 26 17:42:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:45.577340 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0558c-51f8-4934-b17b-cb16e5900206 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:45.683807 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9352f-e981-4c74-86ac-87cc36755bb1 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:45.692775 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0558c-51f8-4934-b17b-cb16e5900206 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:45.701610 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:45.722509 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865923d-a3a0-48ed-94a6-a805d10d5a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:45.723427 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865923d-a3a0-48ed-94a6-a805d10d5a56 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:45.723550 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865923d-a3a0-48ed-94a6-a805d10d5a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:45.723795 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865923d-a3a0-48ed-94a6-a805d10d5a56 None admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:45.724497 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865923d-a3a0-48ed-94a6-a805d10d5a56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:45.724782 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865923d-a3a0-48ed-94a6-a805d10d5a56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:45.726984 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865923d-a3a0-48ed-94a6-a805d10d5a56 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:45.733453 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d119cfa-c45a-4bd4-8fb4-37335c41e70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:45.734409 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d119cfa-c45a-4bd4-8fb4-37335c41e70e None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:45.734944 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d119cfa-c45a-4bd4-8fb4-37335c41e70e None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:45.735361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d119cfa-c45a-4bd4-8fb4-37335c41e70e None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:45.736158 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d119cfa-c45a-4bd4-8fb4-37335c41e70e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:45.736604 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d119cfa-c45a-4bd4-8fb4-37335c41e70e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:45.738304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d119cfa-c45a-4bd4-8fb4-37335c41e70e None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:45.741483 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 330/673] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:45.741985 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865923d-a3a0-48ed-94a6-a805d10d5a56 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:45.753324 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 344/674] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:45.754434 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d119cfa-c45a-4bd4-8fb4-37335c41e70e None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:45.805087 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:45.874041 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d119cfa-c45a-4bd4-8fb4-37335c41e70e None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:45.878656 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865923d-a3a0-48ed-94a6-a805d10d5a56 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:45.926360 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5967dd23-200c-4f5f-b291-f131b655c2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:45.927348 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967dd23-200c-4f5f-b291-f131b655c2bb None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:45.927738 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967dd23-200c-4f5f-b291-f131b655c2bb None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:45.928116 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967dd23-200c-4f5f-b291-f131b655c2bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:45.934206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac65ee-c56c-4ae1-ba3f-c93c9207897b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:45.934206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac65ee-c56c-4ae1-ba3f-c93c9207897b None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:45.934206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac65ee-c56c-4ae1-ba3f-c93c9207897b None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:45.934206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac65ee-c56c-4ae1-ba3f-c93c9207897b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:45.936921 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5967dd23-200c-4f5f-b291-f131b655c2bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:45.938501 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5967dd23-200c-4f5f-b291-f131b655c2bb None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:45.952105 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-5967dd23-200c-4f5f-b291-f131b655c2bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:42:45.952105 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:45.952105 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:45.952105 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:45.952105 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:45.952105 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:45.952105 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:45.952105 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:45.952105 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:45.952105 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:45.952105 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:45.952105 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:45.952105 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 17:42:45.952105 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 17:42:45.952105 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 17:42:45.953082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 17:42:45.953082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:45.953082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:45.953082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:45.953082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:45.953082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:45.953082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:45.953082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:45.953082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:45.953082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:45.953082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:45.953082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:45.953082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:45.953082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:45.953082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:45.953082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:45.953082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:45.954663 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 17:42:45.954663 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 17:42:45.954663 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 17:42:45.954663 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 17:42:45.954663 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 17:42:45.954663 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 17:42:45.954663 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:42:45.954663 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:45.954663 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 345/675] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:42:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:45.954663 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5967dd23-200c-4f5f-b291-f131b655c2bb None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:45.957282 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac65ee-c56c-4ae1-ba3f-c93c9207897b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:45.959418 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac65ee-c56c-4ae1-ba3f-c93c9207897b None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:45.979065 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-54ac65ee-c56c-4ae1-ba3f-c93c9207897b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:45.979065 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:45.979065 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:45.979065 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:45.979065 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:45.979065 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:45.979065 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:45.979065 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:45.979065 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:45.979065 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:45.979065 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:45.979065 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:45.979065 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:45.979065 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:45.979065 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:45.979065 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:45.980055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:45.980055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:45.980055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:45.980055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:45.980055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:45.980055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:45.980055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:45.980055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:45.980055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:45.980055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:45.980055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:45.980055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:45.980055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:45.980055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:45.980055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:45.980055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:45.980055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:45.980960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:45.980960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:45.980960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:45.983583 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 331/676] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:45.984699 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac65ee-c56c-4ae1-ba3f-c93c9207897b None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:46.016483 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:46.067218 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5967dd23-200c-4f5f-b291-f131b655c2bb None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:46.076876 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:46.112923 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba3010-83f0-40b2-9fbd-0dc8ee493b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:46.113716 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba3010-83f0-40b2-9fbd-0dc8ee493b8e None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:46.113913 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba3010-83f0-40b2-9fbd-0dc8ee493b8e None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:46.114149 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba3010-83f0-40b2-9fbd-0dc8ee493b8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:46.126010 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ba3010-83f0-40b2-9fbd-0dc8ee493b8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:46.127530 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ba3010-83f0-40b2-9fbd-0dc8ee493b8e None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:46.144783 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac65ee-c56c-4ae1-ba3f-c93c9207897b None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:46.150647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-34ba3010-83f0-40b2-9fbd-0dc8ee493b8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:42:46.150647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:46.150647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:46.150647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:46.150647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:46.150647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:46.150647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:46.150647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:46.150647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:46.150647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:46.150647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:46.150647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:46.150647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 17:42:46.150647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 17:42:46.150647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 17:42:46.151559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 17:42:46.151559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:46.151559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:46.151559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:46.151559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:46.151559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:46.151559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:46.151559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:46.151559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:46.151559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:46.151559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:46.151559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:46.151559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:46.151559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:46.151559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:46.151559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:46.151559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:46.152479 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 17:42:46.152479 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 17:42:46.152479 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 17:42:46.152479 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 17:42:46.152479 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 17:42:46.152479 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 17:42:46.152479 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:42:46.152479 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:46.156569 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 346/677] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:42:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:46.157439 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba3010-83f0-40b2-9fbd-0dc8ee493b8e None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:46.207394 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc66da26-8f15-46cb-ad5e-dec9947cf4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:46.209885 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66da26-8f15-46cb-ad5e-dec9947cf4da None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:46.211505 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66da26-8f15-46cb-ad5e-dec9947cf4da None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:46.212062 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66da26-8f15-46cb-ad5e-dec9947cf4da None admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:46.213389 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc66da26-8f15-46cb-ad5e-dec9947cf4da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:46.215445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc66da26-8f15-46cb-ad5e-dec9947cf4da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:46.219143 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc66da26-8f15-46cb-ad5e-dec9947cf4da None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:46.256437 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 332/678] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Sep 26 17:42:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:46.259097 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc66da26-8f15-46cb-ad5e-dec9947cf4da None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:46.266363 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba3010-83f0-40b2-9fbd-0dc8ee493b8e None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:46.313772 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73600e56-06d9-49bb-9060-99e2731447b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:46.314396 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73600e56-06d9-49bb-9060-99e2731447b1 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:46.314675 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73600e56-06d9-49bb-9060-99e2731447b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:46.314945 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73600e56-06d9-49bb-9060-99e2731447b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:46.317128 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73600e56-06d9-49bb-9060-99e2731447b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:46.317493 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73600e56-06d9-49bb-9060-99e2731447b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:46.318822 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73600e56-06d9-49bb-9060-99e2731447b1 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:46.344517 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 347/679] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:46.345436 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73600e56-06d9-49bb-9060-99e2731447b1 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:46.386005 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:46.430066 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:46.449289 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc66da26-8f15-46cb-ad5e-dec9947cf4da None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:46.497786 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9eb3ff-a3c4-400b-be10-f051a4b1d865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:46.499024 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9eb3ff-a3c4-400b-be10-f051a4b1d865 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:46.499535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9eb3ff-a3c4-400b-be10-f051a4b1d865 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:46.500033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9eb3ff-a3c4-400b-be10-f051a4b1d865 None admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:46.501125 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9eb3ff-a3c4-400b-be10-f051a4b1d865 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:46.501658 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9eb3ff-a3c4-400b-be10-f051a4b1d865 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:46.504031 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9eb3ff-a3c4-400b-be10-f051a4b1d865 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:46.528014 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 333/680] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Sep 26 17:42:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:46.529470 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73600e56-06d9-49bb-9060-99e2731447b1 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:46.531880 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9eb3ff-a3c4-400b-be10-f051a4b1d865 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:46.572613 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4f2f9-6312-445a-8fa6-f3ba6036cca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:46.573177 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4f2f9-6312-445a-8fa6-f3ba6036cca2 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:46.573455 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4f2f9-6312-445a-8fa6-f3ba6036cca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:46.573724 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4f2f9-6312-445a-8fa6-f3ba6036cca2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:46.574564 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4f2f9-6312-445a-8fa6-f3ba6036cca2 None admin] RBAC: Adding query filter params (role.id=4685fd1f2f284d4498281231160a5f27, scope.project.id=125361b23eb14b53aca5e0139919881e, user.id=14b32df88c21499d9ca81e439b129431) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:46.574937 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4f2f9-6312-445a-8fa6-f3ba6036cca2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:46.576990 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4f2f9-6312-445a-8fa6-f3ba6036cca2 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:46.583230 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 348/681] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:42:46 2022] GET /identity/v3/role_assignments?user.id=14b32df88c21499d9ca81e439b129431&scope.project.id=125361b23eb14b53aca5e0139919881e&role.id=4685fd1f2f284d4498281231160a5f27 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:46.584064 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4f2f9-6312-445a-8fa6-f3ba6036cca2 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:46.695164 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:46.701972 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9eb3ff-a3c4-400b-be10-f051a4b1d865 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:46.706271 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4f2f9-6312-445a-8fa6-f3ba6036cca2 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:46.743411 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bea4c-26cd-46b3-9ed4-467226e378ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:46.744478 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bea4c-26cd-46b3-9ed4-467226e378ff None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:46.744973 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bea4c-26cd-46b3-9ed4-467226e378ff None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:46.745502 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bea4c-26cd-46b3-9ed4-467226e378ff None admin] PATH_INFO: `/v3/users/swift` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:46.745989 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c23cc47-e046-4de1-9cbf-e0a293fc4a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:46.746791 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23cc47-e046-4de1-9cbf-e0a293fc4a54 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:46.747083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23cc47-e046-4de1-9cbf-e0a293fc4a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:46.747354 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23cc47-e046-4de1-9cbf-e0a293fc4a54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:46.748089 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c23cc47-e046-4de1-9cbf-e0a293fc4a54 None admin] RBAC: Adding query filter params (role.id=4685fd1f2f284d4498281231160a5f27, scope.project.id=125361b23eb14b53aca5e0139919881e, user.id=a0ed50f4edcf468192a053b1e0fd6910) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:46.748396 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c23cc47-e046-4de1-9cbf-e0a293fc4a54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:46.750030 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c23cc47-e046-4de1-9cbf-e0a293fc4a54 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:46.756464 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30bea4c-26cd-46b3-9ed4-467226e378ff None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:46.758510 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30bea4c-26cd-46b3-9ed4-467226e378ff None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:46.761204 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 349/682] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:42:46 2022] GET /identity/v3/role_assignments?user.id=a0ed50f4edcf468192a053b1e0fd6910&scope.project.id=125361b23eb14b53aca5e0139919881e&role.id=4685fd1f2f284d4498281231160a5f27 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:46.763014 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f086b-21c8-48c3-8f35-6b660ca4950a None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:46.763572 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f086b-21c8-48c3-8f35-6b660ca4950a None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:46.764073 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f086b-21c8-48c3-8f35-6b660ca4950a None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:46.771153 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 350/683] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:46.772984 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048923d-59b6-433b-9cc4-8202f2434180 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:46.776495 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048923d-59b6-433b-9cc4-8202f2434180 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:46.777159 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048923d-59b6-433b-9cc4-8202f2434180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:46.786124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-f30bea4c-26cd-46b3-9ed4-467226e378ff None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 26 17:42:46.786124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:46.786124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:46.786124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:46.786124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:46.786124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:46.786124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:46.786124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:46.786124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:46.786124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:46.786124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:46.786124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:46.786124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 17:42:46.786124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 17:42:46.786124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 17:42:46.786124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 17:42:46.787131 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:46.787131 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:46.787131 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 17:42:46.787131 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:42:46.787131 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 17:42:46.787131 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:42:46.787131 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:46.787131 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:46.787131 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:46.787131 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:46.787131 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:46.787131 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:46.787131 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:46.787131 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:46.787131 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:46.787131 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:46.787131 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:46.787131 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:46.788615 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:46.788615 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:46.788615 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 17:42:46.788615 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 17:42:46.788615 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 17:42:46.788615 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 17:42:46.788615 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 17:42:46.788615 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 17:42:46.788615 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 26 17:42:46.788615 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:46.792563 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 334/684] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Sep 26 17:42:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:46.798758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bea4c-26cd-46b3-9ed4-467226e378ff None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:46.812236 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-6048923d-59b6-433b-9cc4-8202f2434180 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:46.814401 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-6048923d-59b6-433b-9cc4-8202f2434180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:46.820094 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:46.917800 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 351/685] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:42:46.946913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bea4c-26cd-46b3-9ed4-467226e378ff None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:46.995774 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd78a62-0b09-4bb9-9284-339835ed2c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:46.996391 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd78a62-0b09-4bb9-9284-339835ed2c66 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:46.996672 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd78a62-0b09-4bb9-9284-339835ed2c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:46.996942 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd78a62-0b09-4bb9-9284-339835ed2c66 None admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:46.997706 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd78a62-0b09-4bb9-9284-339835ed2c66 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:46.998014 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd78a62-0b09-4bb9-9284-339835ed2c66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:46.999450 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd78a62-0b09-4bb9-9284-339835ed2c66 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:47.024907 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 335/686] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Sep 26 17:42:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:42:47.030181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048923d-59b6-433b-9cc4-8202f2434180 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:47.074623 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c4244-0fc8-4ffc-8b68-1c6dca00d3eb None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:47.074938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c4244-0fc8-4ffc-8b68-1c6dca00d3eb None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:47.075175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c4244-0fc8-4ffc-8b68-1c6dca00d3eb None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:47.077103 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 336/687] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 17:42:47.082834 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777306a1-8713-47d9-a94e-24cc6e82daaa None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:47.083109 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777306a1-8713-47d9-a94e-24cc6e82daaa None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:47.083382 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777306a1-8713-47d9-a94e-24cc6e82daaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:47.110703 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-777306a1-8713-47d9-a94e-24cc6e82daaa None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:47.111896 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-777306a1-8713-47d9-a94e-24cc6e82daaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:47.136864 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:47.156719 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048923d-59b6-433b-9cc4-8202f2434180 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:47.187586 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:47.196627 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 337/688] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:42:47.221143 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf141158-9dc3-486b-82ea-2825eddf4c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:47.221774 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf141158-9dc3-486b-82ea-2825eddf4c0b None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:47.222068 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf141158-9dc3-486b-82ea-2825eddf4c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:47.222348 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf141158-9dc3-486b-82ea-2825eddf4c0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:47.222905 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777306a1-8713-47d9-a94e-24cc6e82daaa None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:47.360097 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf141158-9dc3-486b-82ea-2825eddf4c0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:47.360097 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf141158-9dc3-486b-82ea-2825eddf4c0b None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:47.401160 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777306a1-8713-47d9-a94e-24cc6e82daaa None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:47.452685 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb7596-9570-4320-8d17-7def9d2eee4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:47.453330 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb7596-9570-4320-8d17-7def9d2eee4f None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:47.453613 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb7596-9570-4320-8d17-7def9d2eee4f None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:47.453889 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb7596-9570-4320-8d17-7def9d2eee4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:47.465475 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb7596-9570-4320-8d17-7def9d2eee4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:42:47.470611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-0deb7596-9570-4320-8d17-7def9d2eee4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:42:47.470611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:47.470611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:47.470611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:47.470611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:47.470611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:47.470611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:47.470611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:47.470611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:47.470611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:47.470611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:47.470611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:47.470611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:42:47.470611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:42:47.470611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:42:47.470611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:42:47.471535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:42:47.471535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:42:47.471535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:42:47.471535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:42:47.471535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:47.471535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:47.471535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:47.471535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:47.471535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:47.471535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:47.471535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:47.471535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:47.471535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:47.471535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:47.471535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:47.471535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:47.472364 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:47.472364 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:47.472364 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:47.472364 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:47.472364 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:42:47.472364 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:42:47.472364 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:42:47.472364 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:42:47.472364 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:42:47.472364 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:42:47.472364 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:42:47.472364 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:47.472364 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 338/689] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Sep 26 17:42:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:42:47.478133 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb7596-9570-4320-8d17-7def9d2eee4f None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:47.534088 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:47.555637 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 352/690] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:42:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 17:42:47.556643 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf141158-9dc3-486b-82ea-2825eddf4c0b None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:47.564729 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:47.627354 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb7596-9570-4320-8d17-7def9d2eee4f None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:47.668960 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf141158-9dc3-486b-82ea-2825eddf4c0b None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:47.674495 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf3851-0884-46ba-81a0-298d35d911a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:47.675108 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf3851-0884-46ba-81a0-298d35d911a6 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:47.675432 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf3851-0884-46ba-81a0-298d35d911a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:47.675706 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf3851-0884-46ba-81a0-298d35d911a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:47.676583 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf3851-0884-46ba-81a0-298d35d911a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:47.677989 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf3851-0884-46ba-81a0-298d35d911a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:47.679890 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf3851-0884-46ba-81a0-298d35d911a6 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:47.691734 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 339/691] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:42:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:47.692577 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf3851-0884-46ba-81a0-298d35d911a6 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:47.723141 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65d078-738a-4717-936b-0f3d2489cbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:47.723816 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65d078-738a-4717-936b-0f3d2489cbf1 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:47.724374 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65d078-738a-4717-936b-0f3d2489cbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:47.724649 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65d078-738a-4717-936b-0f3d2489cbf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:47.739770 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65d078-738a-4717-936b-0f3d2489cbf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:47.742069 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65d078-738a-4717-936b-0f3d2489cbf1 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:47.760002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-1f65d078-738a-4717-936b-0f3d2489cbf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:47.760002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:47.760002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:47.760002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:47.760002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:47.760002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:47.760002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:47.760002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:47.760002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:47.760002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:47.760002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:47.760002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:47.760002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:47.760002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:47.760002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:47.760002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:47.761122 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:47.761122 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:47.761122 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:47.761122 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:47.761122 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:47.761122 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:47.761122 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:47.761122 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:47.761122 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:47.761122 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:47.761122 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:47.761122 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:47.761122 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:47.761122 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:47.761122 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:47.761122 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:47.761122 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:47.762224 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:47.762224 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:47.762224 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:47.762224 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 353/692] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:47.762460 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65d078-738a-4717-936b-0f3d2489cbf1 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:47.802954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:47.829369 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf3851-0884-46ba-81a0-298d35d911a6 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:47.852990 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:47.878150 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65d078-738a-4717-936b-0f3d2489cbf1 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:47.878399 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ad321-11b8-4be7-b9bb-3662e51b9f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:47.879229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ad321-11b8-4be7-b9bb-3662e51b9f6e None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:47.879647 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ad321-11b8-4be7-b9bb-3662e51b9f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:47.880305 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ad321-11b8-4be7-b9bb-3662e51b9f6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:47.895226 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34ad321-11b8-4be7-b9bb-3662e51b9f6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:47.897990 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34ad321-11b8-4be7-b9bb-3662e51b9f6e None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:47.916918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-b34ad321-11b8-4be7-b9bb-3662e51b9f6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:47.916918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:47.916918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:47.916918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:47.916918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:47.916918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:47.916918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:47.916918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:47.916918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:47.916918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:47.916918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:47.916918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:47.916918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:47.916918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:47.916918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:47.916918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:47.918011 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:47.918011 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:47.918011 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:47.918011 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:47.918011 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:47.918011 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:47.918011 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:47.918011 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:47.918011 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:47.918011 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:47.918011 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:47.918011 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:47.918011 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:47.918011 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:47.918011 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:47.918011 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:47.918011 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:47.918927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:47.918927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:47.918927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:47.920734 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ffb3d-2dbf-41f8-a587-9144044eeb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:47.921686 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ffb3d-2dbf-41f8-a587-9144044eeb91 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:47.922182 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ffb3d-2dbf-41f8-a587-9144044eeb91 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:47.922613 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ffb3d-2dbf-41f8-a587-9144044eeb91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:47.923539 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 340/693] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:47.924637 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ad321-11b8-4be7-b9bb-3662e51b9f6e None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:47.938431 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ffb3d-2dbf-41f8-a587-9144044eeb91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:47.941172 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ffb3d-2dbf-41f8-a587-9144044eeb91 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:47.962377 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-835ffb3d-2dbf-41f8-a587-9144044eeb91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:47.962377 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:47.962377 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:47.962377 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:47.962377 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:47.962377 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:47.962377 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:47.962377 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:47.962377 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:47.962377 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:47.962377 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:47.962377 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:47.962377 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:47.962377 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:47.962377 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:47.962377 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:47.963350 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:47.963350 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:47.963350 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:47.963350 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:47.963350 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:47.963350 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:47.963350 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:47.963350 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:47.963350 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:47.963350 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:47.963350 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:47.963350 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:47.963350 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:47.963350 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:47.963350 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:47.963350 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:47.963350 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:47.964219 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:47.964219 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:47.964219 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:47.967055 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 354/694] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:47.967994 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ffb3d-2dbf-41f8-a587-9144044eeb91 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:48.044000 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ad321-11b8-4be7-b9bb-3662e51b9f6e None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:48.077383 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:48.092201 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ffb3d-2dbf-41f8-a587-9144044eeb91 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:48.092921 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da609ee-4a21-4a9c-96f3-fac76df9d1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:48.094007 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da609ee-4a21-4a9c-96f3-fac76df9d1da None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:48.094432 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da609ee-4a21-4a9c-96f3-fac76df9d1da None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:48.095705 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da609ee-4a21-4a9c-96f3-fac76df9d1da None admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:48.096497 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da609ee-4a21-4a9c-96f3-fac76df9d1da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:48.097029 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da609ee-4a21-4a9c-96f3-fac76df9d1da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:48.098536 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da609ee-4a21-4a9c-96f3-fac76df9d1da None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:48.115071 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 341/695] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:48.116615 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da609ee-4a21-4a9c-96f3-fac76df9d1da None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:48.128452 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb9e06-c201-492d-87d2-47c5a5347d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:48.129227 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb9e06-c201-492d-87d2-47c5a5347d3b None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:48.129351 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb9e06-c201-492d-87d2-47c5a5347d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:48.129633 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb9e06-c201-492d-87d2-47c5a5347d3b None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:48.130278 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb9e06-c201-492d-87d2-47c5a5347d3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:48.130584 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb9e06-c201-492d-87d2-47c5a5347d3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:48.132500 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb9e06-c201-492d-87d2-47c5a5347d3b None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:48.144904 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 355/696] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:48.145839 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb9e06-c201-492d-87d2-47c5a5347d3b None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:48.157846 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:48.259566 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da609ee-4a21-4a9c-96f3-fac76df9d1da None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:48.269206 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb9e06-c201-492d-87d2-47c5a5347d3b None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:48.305988 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853dfb5c-ed38-4539-afe4-7869da22f12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:48.306678 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853dfb5c-ed38-4539-afe4-7869da22f12a None admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:48.307016 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853dfb5c-ed38-4539-afe4-7869da22f12a None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:48.307346 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853dfb5c-ed38-4539-afe4-7869da22f12a None admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:48.308042 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853dfb5c-ed38-4539-afe4-7869da22f12a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:48.308263 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76a0ad-5ae4-40f1-ac3a-7990523dca61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:48.309057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76a0ad-5ae4-40f1-ac3a-7990523dca61 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:48.309482 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76a0ad-5ae4-40f1-ac3a-7990523dca61 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:48.309809 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853dfb5c-ed38-4539-afe4-7869da22f12a None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:48.310071 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76a0ad-5ae4-40f1-ac3a-7990523dca61 None admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:48.310859 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76a0ad-5ae4-40f1-ac3a-7990523dca61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:48.311305 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76a0ad-5ae4-40f1-ac3a-7990523dca61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:48.312802 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76a0ad-5ae4-40f1-ac3a-7990523dca61 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:48.332033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 342/697] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:48.333220 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76a0ad-5ae4-40f1-ac3a-7990523dca61 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:48.337459 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 356/698] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Sep 26 17:42:48 2022] POST /identity/v3/users => generated 254 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:42:48.338638 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853dfb5c-ed38-4539-afe4-7869da22f12a None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:48.347653 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:48.526642 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:48.543330 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76a0ad-5ae4-40f1-ac3a-7990523dca61 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:48.564872 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853dfb5c-ed38-4539-afe4-7869da22f12a None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:48.600263 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2170b9-f558-494a-82fe-5a060b2fed05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:48.602138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2170b9-f558-494a-82fe-5a060b2fed05 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:48.603091 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2170b9-f558-494a-82fe-5a060b2fed05 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:48.603835 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2170b9-f558-494a-82fe-5a060b2fed05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:48.613745 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f5750c-7e38-4845-8bcf-02ac217670d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:48.614968 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5750c-7e38-4845-8bcf-02ac217670d0 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:48.614968 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5750c-7e38-4845-8bcf-02ac217670d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:48.615141 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5750c-7e38-4845-8bcf-02ac217670d0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:48.617206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2170b9-f558-494a-82fe-5a060b2fed05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:48.619094 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2170b9-f558-494a-82fe-5a060b2fed05 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:48.624321 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f5750c-7e38-4845-8bcf-02ac217670d0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:48.625808 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f5750c-7e38-4845-8bcf-02ac217670d0 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:48.634470 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-6d2170b9-f558-494a-82fe-5a060b2fed05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:42:48.634470 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:48.634470 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:48.634470 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:48.634470 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:48.634470 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:48.634470 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:48.634470 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:48.634470 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:48.634470 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:48.634470 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:48.634470 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:48.634470 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 17:42:48.634470 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 17:42:48.634470 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 17:42:48.635654 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 17:42:48.635654 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:48.635654 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:48.635654 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:48.635654 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:48.635654 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:48.635654 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:48.635654 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:48.635654 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:48.635654 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:48.635654 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:48.635654 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:48.635654 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:48.635654 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:48.635654 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:48.635654 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:48.635654 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:48.637055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 17:42:48.637055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 17:42:48.637055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 17:42:48.637055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 17:42:48.637055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 17:42:48.637055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 17:42:48.637055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:42:48.637055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:48.637480 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-36f5750c-7e38-4845-8bcf-02ac217670d0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 17:42:48.637480 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:48.637480 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:48.637480 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:48.637480 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:48.637480 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:48.637480 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:48.637480 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:48.637480 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:48.637480 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:48.637480 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:48.637480 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:48.637480 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 17:42:48.637480 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 17:42:48.637480 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 17:42:48.637480 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 17:42:48.638319 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:48.638319 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:48.638319 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 17:42:48.638319 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:42:48.638319 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 17:42:48.638319 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:42:48.638319 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:48.638319 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:48.638319 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:48.638319 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:48.638319 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:48.638319 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:48.638319 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:48.638319 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:48.638319 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:48.638319 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:48.638319 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:48.638319 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:48.640993 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:48.640993 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:48.640993 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 17:42:48.640993 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 17:42:48.640993 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 17:42:48.640993 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 17:42:48.640993 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 17:42:48.640993 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 17:42:48.640993 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 17:42:48.640993 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:48.640993 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 357/699] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Sep 26 17:42:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:48.649188 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f5750c-7e38-4845-8bcf-02ac217670d0 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:48.649432 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 343/700] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:42:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:48.651612 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2170b9-f558-494a-82fe-5a060b2fed05 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:48.742257 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:48.794403 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2170b9-f558-494a-82fe-5a060b2fed05 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:48.804217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f5750c-7e38-4845-8bcf-02ac217670d0 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:48.829712 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5b5cb-5753-435f-965a-6b532f128fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:48.830249 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5b5cb-5753-435f-965a-6b532f128fd8 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:48.830526 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5b5cb-5753-435f-965a-6b532f128fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:48.830796 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5b5cb-5753-435f-965a-6b532f128fd8 None admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:48.831627 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5b5cb-5753-435f-965a-6b532f128fd8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:48.831882 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5b5cb-5753-435f-965a-6b532f128fd8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:48.833417 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5b5cb-5753-435f-965a-6b532f128fd8 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:48.843341 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e1ee7-e20c-4cad-b7ba-de90beb8e8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:48.844442 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e1ee7-e20c-4cad-b7ba-de90beb8e8b9 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:48.844925 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e1ee7-e20c-4cad-b7ba-de90beb8e8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:48.845431 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e1ee7-e20c-4cad-b7ba-de90beb8e8b9 None admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:48.846364 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e1ee7-e20c-4cad-b7ba-de90beb8e8b9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:48.846872 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e1ee7-e20c-4cad-b7ba-de90beb8e8b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:48.852337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 344/701] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Sep 26 17:42:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:48.852478 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e1ee7-e20c-4cad-b7ba-de90beb8e8b9 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:48.855310 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5b5cb-5753-435f-965a-6b532f128fd8 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:48.877293 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:48.878730 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 358/702] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Sep 26 17:42:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:42:48.887227 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e1ee7-e20c-4cad-b7ba-de90beb8e8b9 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:49.008409 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e1ee7-e20c-4cad-b7ba-de90beb8e8b9 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:49.037455 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5b5cb-5753-435f-965a-6b532f128fd8 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:49.061134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:49.088495 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fc50a-96a5-437e-8e5c-0fda2beba93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:49.089505 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fc50a-96a5-437e-8e5c-0fda2beba93f None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:49.090143 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fc50a-96a5-437e-8e5c-0fda2beba93f None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:49.090813 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fc50a-96a5-437e-8e5c-0fda2beba93f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:49.123279 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd5dbf-cfe3-478e-a0f1-1b4d083d16c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:49.124581 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd5dbf-cfe3-478e-a0f1-1b4d083d16c2 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:49.126522 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd5dbf-cfe3-478e-a0f1-1b4d083d16c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:49.127009 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd5dbf-cfe3-478e-a0f1-1b4d083d16c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:49.129623 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd5dbf-cfe3-478e-a0f1-1b4d083d16c2 None admin] RBAC: Adding query filter params (role.id=4685fd1f2f284d4498281231160a5f27, scope.project.id=125361b23eb14b53aca5e0139919881e, user.id=ea49cd9839474232a0cbe66ccffbf082) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:49.130214 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd5dbf-cfe3-478e-a0f1-1b4d083d16c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:49.135272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd5dbf-cfe3-478e-a0f1-1b4d083d16c2 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:49.153404 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 345/703] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:42:48 2022] GET /identity/v3/role_assignments?user.id=ea49cd9839474232a0cbe66ccffbf082&scope.project.id=125361b23eb14b53aca5e0139919881e&role.id=4685fd1f2f284d4498281231160a5f27 => generated 608 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:49.198132 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933314b-f1bb-4dbf-a8c1-a5481d0812d1 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:49.198456 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933314b-f1bb-4dbf-a8c1-a5481d0812d1 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:49.198683 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933314b-f1bb-4dbf-a8c1-a5481d0812d1 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:49.200489 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 346/704] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:49.210989 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dec6fe-d254-4a9b-afeb-d1827fc51e41 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:49.211287 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dec6fe-d254-4a9b-afeb-d1827fc51e41 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:49.211540 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dec6fe-d254-4a9b-afeb-d1827fc51e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:49.241745 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-e6dec6fe-d254-4a9b-afeb-d1827fc51e41 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:49.242979 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-e6dec6fe-d254-4a9b-afeb-d1827fc51e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:49.244662 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2fc50a-96a5-437e-8e5c-0fda2beba93f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:49.246294 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2fc50a-96a5-437e-8e5c-0fda2beba93f None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:49.332214 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 347/705] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 26 17:42:49.334087 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115bb63-1faa-48fc-8ea9-fd712aa183de None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:49.334575 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115bb63-1faa-48fc-8ea9-fd712aa183de None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:49.335610 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115bb63-1faa-48fc-8ea9-fd712aa183de None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:49.337374 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 348/706] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:49.346535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8569836-d084-495f-8fab-a69d461df639 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:49.346940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8569836-d084-495f-8fab-a69d461df639 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:49.347213 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8569836-d084-495f-8fab-a69d461df639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:49.362155 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:49.386511 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-b8569836-d084-495f-8fab-a69d461df639 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:49.390968 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-b8569836-d084-495f-8fab-a69d461df639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:49.432735 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 359/707] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:42:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 26 17:42:49.438534 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fc50a-96a5-437e-8e5c-0fda2beba93f None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:49.468580 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:49.487439 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 349/708] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:42:49.563204 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fc50a-96a5-437e-8e5c-0fda2beba93f None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:49.601120 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d29ab4-9cd5-4dbc-8f1a-e0f6f5e8dde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:49.602005 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d29ab4-9cd5-4dbc-8f1a-e0f6f5e8dde4 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:49.602434 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d29ab4-9cd5-4dbc-8f1a-e0f6f5e8dde4 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:49.602868 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d29ab4-9cd5-4dbc-8f1a-e0f6f5e8dde4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:49.613771 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d29ab4-9cd5-4dbc-8f1a-e0f6f5e8dde4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:49.615630 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d29ab4-9cd5-4dbc-8f1a-e0f6f5e8dde4 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:49.622949 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8569836-d084-495f-8fab-a69d461df639 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:49.636527 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-23d29ab4-9cd5-4dbc-8f1a-e0f6f5e8dde4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:49.636527 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:49.636527 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:49.636527 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:49.636527 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:49.636527 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:49.636527 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:49.636527 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:49.636527 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:49.636527 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:49.636527 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:49.636527 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:49.636527 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:49.636527 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:49.636527 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:49.636527 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:49.637602 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:49.637602 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:49.637602 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:49.637602 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:49.637602 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:49.637602 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:49.637602 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:49.637602 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:49.637602 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:49.637602 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:49.637602 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:49.637602 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:49.637602 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:49.637602 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:49.637602 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:49.637602 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:49.637602 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:49.638499 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:49.638499 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:49.638499 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:49.640281 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 360/709] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:42:49.646803 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d29ab4-9cd5-4dbc-8f1a-e0f6f5e8dde4 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:49.745928 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:49.761294 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8569836-d084-495f-8fab-a69d461df639 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:49.773993 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d29ab4-9cd5-4dbc-8f1a-e0f6f5e8dde4 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:49.804268 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bec4c2-aa11-47a9-b0e4-2477c453e1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:49.805637 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bec4c2-aa11-47a9-b0e4-2477c453e1a4 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:49.806366 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bec4c2-aa11-47a9-b0e4-2477c453e1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:49.806844 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bec4c2-aa11-47a9-b0e4-2477c453e1a4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:49.807869 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bec4c2-aa11-47a9-b0e4-2477c453e1a4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:49.810257 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bec4c2-aa11-47a9-b0e4-2477c453e1a4 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:49.812565 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:49.813884 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff46eaf-adf5-4d69-9c5d-ca569dc7e4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:49.814560 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff46eaf-adf5-4d69-9c5d-ca569dc7e4e6 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:49.818308 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff46eaf-adf5-4d69-9c5d-ca569dc7e4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:49.818601 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff46eaf-adf5-4d69-9c5d-ca569dc7e4e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:49.819849 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff46eaf-adf5-4d69-9c5d-ca569dc7e4e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:49.820160 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff46eaf-adf5-4d69-9c5d-ca569dc7e4e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:49.821686 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff46eaf-adf5-4d69-9c5d-ca569dc7e4e6 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:49.826734 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-b7bec4c2-aa11-47a9-b0e4-2477c453e1a4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 17:42:49.826734 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:49.826734 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 17:42:49.826734 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 17:42:49.826734 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 17:42:49.826734 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 17:42:49.826734 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 17:42:49.826734 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:42:49.826734 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 17:42:49.826734 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:49.826734 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 17:42:49.826734 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:49.826734 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:49.826734 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:49.826734 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:49.826734 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:49.826734 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:49.827780 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:49.827780 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:49.827780 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:49.827780 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:49.827780 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:49.827780 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:49.827780 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 17:42:49.827780 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 17:42:49.827780 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 17:42:49.827780 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 17:42:49.827780 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:49.827780 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:49.827780 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:49.827780 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:49.827780 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:49.827780 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:49.828625 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:49.828625 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:49.828625 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:49.828625 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:49.828625 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:49.828625 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:49.828625 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:49.828625 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:49.828625 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:49.828625 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:49.828625 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 17:42:49.828625 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:42:49.828625 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 17:42:49.828625 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:49.831955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 350/710] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Sep 26 17:42:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:42:49.833730 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bec4c2-aa11-47a9-b0e4-2477c453e1a4 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:49.841181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 361/711] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:49.842034 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff46eaf-adf5-4d69-9c5d-ca569dc7e4e6 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:49.955427 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bec4c2-aa11-47a9-b0e4-2477c453e1a4 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:49.968395 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff46eaf-adf5-4d69-9c5d-ca569dc7e4e6 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:49.998313 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e355d23-21dd-4985-ab75-09bd07e8a83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:49.998952 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e355d23-21dd-4985-ab75-09bd07e8a83c None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:49.999233 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e355d23-21dd-4985-ab75-09bd07e8a83c None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:49.999507 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e355d23-21dd-4985-ab75-09bd07e8a83c None admin] PATH_INFO: `/v3/services/network` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:50.000097 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e355d23-21dd-4985-ab75-09bd07e8a83c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:50.001538 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e355d23-21dd-4985-ab75-09bd07e8a83c None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:50.013329 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-0e355d23-21dd-4985-ab75-09bd07e8a83c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 17:42:50.013329 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:50.013329 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 17:42:50.013329 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 17:42:50.013329 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 17:42:50.013329 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 17:42:50.013329 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 17:42:50.013329 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:42:50.013329 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 17:42:50.013329 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:50.013329 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 17:42:50.013329 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:50.013329 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:50.013329 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:50.013329 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:50.013329 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:50.013329 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:50.015197 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:50.015197 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:50.015197 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:50.015197 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:50.015197 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:50.015197 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:50.015197 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 17:42:50.015197 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 17:42:50.015197 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 17:42:50.015197 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 17:42:50.015197 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:50.015197 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:50.015197 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:50.015197 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:50.015197 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:50.015197 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:50.016882 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:50.016882 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:50.016882 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:50.016882 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:50.016882 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:50.016882 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:50.016882 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:50.016882 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:50.016882 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:50.016882 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:50.016882 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 17:42:50.016882 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:42:50.016882 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 17:42:50.016882 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:50.016882 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 351/712] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:42:49 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:50.018463 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e355d23-21dd-4985-ab75-09bd07e8a83c None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:50.034296 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8054c-e724-4ad6-b4ae-5e209c0c4b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:50.035702 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8054c-e724-4ad6-b4ae-5e209c0c4b2d None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:50.036184 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8054c-e724-4ad6-b4ae-5e209c0c4b2d None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:50.036617 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8054c-e724-4ad6-b4ae-5e209c0c4b2d None admin] PATH_INFO: `/v3/services` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:50.037661 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8054c-e724-4ad6-b4ae-5e209c0c4b2d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:50.039138 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8054c-e724-4ad6-b4ae-5e209c0c4b2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:50.040962 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8054c-e724-4ad6-b4ae-5e209c0c4b2d None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:50.042885 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:50.050201 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 362/713] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Sep 26 17:42:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:50.051389 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8054c-e724-4ad6-b4ae-5e209c0c4b2d None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:50.104180 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:50.159045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e355d23-21dd-4985-ab75-09bd07e8a83c None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:50.161888 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8054c-e724-4ad6-b4ae-5e209c0c4b2d None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:50.200150 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feffdc0-4980-4ddd-8b24-a9a3ab756c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:50.200997 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feffdc0-4980-4ddd-8b24-a9a3ab756c42 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:50.201891 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feffdc0-4980-4ddd-8b24-a9a3ab756c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:50.202436 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feffdc0-4980-4ddd-8b24-a9a3ab756c42 None admin] PATH_INFO: `/v3/services` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:50.203237 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feffdc0-4980-4ddd-8b24-a9a3ab756c42 None admin] RBAC: Adding query filter params (name=network) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:50.203644 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feffdc0-4980-4ddd-8b24-a9a3ab756c42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:50.205145 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feffdc0-4980-4ddd-8b24-a9a3ab756c42 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:50.205987 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1c831-14ce-4975-a035-30810011e2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:50.207408 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1c831-14ce-4975-a035-30810011e2e8 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:50.207839 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1c831-14ce-4975-a035-30810011e2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:50.208532 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1c831-14ce-4975-a035-30810011e2e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:50.210497 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 363/714] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Sep 26 17:42:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:50.211465 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feffdc0-4980-4ddd-8b24-a9a3ab756c42 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:50.217552 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1c831-14ce-4975-a035-30810011e2e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:50.219172 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1c831-14ce-4975-a035-30810011e2e8 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:50.235338 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-ebb1c831-14ce-4975-a035-30810011e2e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:42:50.235338 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:50.235338 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:50.235338 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:50.235338 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:50.235338 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:50.235338 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:50.235338 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:50.235338 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:50.235338 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:50.235338 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:50.235338 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:50.235338 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 17:42:50.235338 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 17:42:50.235338 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 17:42:50.236462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 17:42:50.236462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:50.236462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:50.236462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:50.236462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:50.236462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:50.236462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:50.236462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:50.236462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:50.236462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:50.236462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:50.236462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:50.236462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:50.236462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:50.236462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:50.236462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:50.236462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:50.237604 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 17:42:50.237604 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 17:42:50.237604 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 17:42:50.237604 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 17:42:50.237604 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 17:42:50.237604 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 17:42:50.237604 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:42:50.237604 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:50.240049 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 352/715] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:42:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:50.242038 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1c831-14ce-4975-a035-30810011e2e8 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:50.280004 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:50.328090 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feffdc0-4980-4ddd-8b24-a9a3ab756c42 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:50.375818 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f199e65-a7ff-42a9-9fd8-9dc42437b10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:50.376675 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f199e65-a7ff-42a9-9fd8-9dc42437b10f None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:50.377119 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f199e65-a7ff-42a9-9fd8-9dc42437b10f None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:50.377521 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f199e65-a7ff-42a9-9fd8-9dc42437b10f None admin] PATH_INFO: `/v3/services` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:50.378318 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f199e65-a7ff-42a9-9fd8-9dc42437b10f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:50.378751 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f199e65-a7ff-42a9-9fd8-9dc42437b10f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:50.380252 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f199e65-a7ff-42a9-9fd8-9dc42437b10f None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:50.388692 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 364/716] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Sep 26 17:42:50 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:50.389755 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f199e65-a7ff-42a9-9fd8-9dc42437b10f None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:50.398663 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1c831-14ce-4975-a035-30810011e2e8 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:50.445125 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:50.477546 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd5b64-3d95-44bb-bee3-d00f87df8cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:50.478253 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd5b64-3d95-44bb-bee3-d00f87df8cd0 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:50.478635 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd5b64-3d95-44bb-bee3-d00f87df8cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:50.479007 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd5b64-3d95-44bb-bee3-d00f87df8cd0 None admin] PATH_INFO: `/v3/services` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:50.480132 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd5b64-3d95-44bb-bee3-d00f87df8cd0 None admin] RBAC: Adding query filter params (type=network) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:50.480132 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd5b64-3d95-44bb-bee3-d00f87df8cd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:50.481721 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd5b64-3d95-44bb-bee3-d00f87df8cd0 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:50.495995 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 353/717] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Sep 26 17:42:50 2022] GET /identity/v3/services?type=network => generated 124 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:50.516317 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f199e65-a7ff-42a9-9fd8-9dc42437b10f None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:50.549960 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:50.560665 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79187122-36e7-4f37-afdc-45273c717f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:50.561633 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79187122-36e7-4f37-afdc-45273c717f88 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:50.562062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79187122-36e7-4f37-afdc-45273c717f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:50.562510 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79187122-36e7-4f37-afdc-45273c717f88 None admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:50.563377 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79187122-36e7-4f37-afdc-45273c717f88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:50.563832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79187122-36e7-4f37-afdc-45273c717f88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:50.565478 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79187122-36e7-4f37-afdc-45273c717f88 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:50.580501 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 365/718] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Sep 26 17:42:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:50.586410 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd5b64-3d95-44bb-bee3-d00f87df8cd0 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:50.737962 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd5b64-3d95-44bb-bee3-d00f87df8cd0 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:50.779017 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff6d96-17e2-4ad3-8090-dd9178ab9e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:50.779630 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff6d96-17e2-4ad3-8090-dd9178ab9e5e None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:50.779935 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff6d96-17e2-4ad3-8090-dd9178ab9e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:50.780211 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff6d96-17e2-4ad3-8090-dd9178ab9e5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:50.780963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff6d96-17e2-4ad3-8090-dd9178ab9e5e None admin] RBAC: Adding query filter params (role.id=be6ee971abf54b26be509c14823ece55, scope.project.id=125361b23eb14b53aca5e0139919881e, user.id=1792e79b9c9a47e1923f19bfd2cd495b) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:50.781276 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff6d96-17e2-4ad3-8090-dd9178ab9e5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:50.782738 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff6d96-17e2-4ad3-8090-dd9178ab9e5e None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:50.788550 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 354/719] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:42:50 2022] GET /identity/v3/role_assignments?user.id=1792e79b9c9a47e1923f19bfd2cd495b&scope.project.id=125361b23eb14b53aca5e0139919881e&role.id=be6ee971abf54b26be509c14823ece55 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:51.077523 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa89ae-f372-4169-8df8-1f7fefb6b8ed None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:51.077886 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa89ae-f372-4169-8df8-1f7fefb6b8ed None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:51.077990 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa89ae-f372-4169-8df8-1f7fefb6b8ed None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:51.079582 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 366/720] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:51.085077 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8b1da-f9c1-462e-8bc0-e05de0212c42 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:51.085366 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8b1da-f9c1-462e-8bc0-e05de0212c42 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:51.085644 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8b1da-f9c1-462e-8bc0-e05de0212c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:51.114457 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-57f8b1da-f9c1-462e-8bc0-e05de0212c42 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:51.115659 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-57f8b1da-f9c1-462e-8bc0-e05de0212c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:51.177687 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:51.210546 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 355/721] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:42:51.615335 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa89ae-f372-4169-8df8-1f7fefb6b8ed None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:51.727896 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa89ae-f372-4169-8df8-1f7fefb6b8ed None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:51.764384 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378a343-6209-490c-ba3a-30b472d43ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:51.765073 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378a343-6209-490c-ba3a-30b472d43ab0 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:51.765355 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378a343-6209-490c-ba3a-30b472d43ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:51.765627 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378a343-6209-490c-ba3a-30b472d43ab0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:51.778167 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378a343-6209-490c-ba3a-30b472d43ab0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:42:51.783031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-d378a343-6209-490c-ba3a-30b472d43ab0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:42:51.783031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:51.783031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:51.783031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:51.783031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:51.783031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:51.783031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:51.783031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:51.783031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:51.783031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:51.783031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:51.783031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:51.783031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:42:51.783031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:42:51.783031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:42:51.783031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:42:51.783989 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:42:51.783989 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:42:51.783989 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:42:51.783989 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:42:51.783989 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:51.783989 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:51.783989 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:51.783989 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:51.783989 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:51.783989 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:51.783989 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:51.783989 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:51.783989 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:51.783989 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:51.783989 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:51.783989 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:51.784832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:51.784832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:51.784832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:51.784832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:51.784832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:42:51.784832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:42:51.784832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:42:51.784832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:42:51.784832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:42:51.784832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:42:51.784832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:42:51.784832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:51.784832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 367/722] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Sep 26 17:42:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:51.790777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8b1da-f9c1-462e-8bc0-e05de0212c42 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:51.929158 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8b1da-f9c1-462e-8bc0-e05de0212c42 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:51.979158 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a6fdb-f0c2-41d3-a6ce-fa2cd08c9813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:51.979690 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a6fdb-f0c2-41d3-a6ce-fa2cd08c9813 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:51.979969 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a6fdb-f0c2-41d3-a6ce-fa2cd08c9813 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:51.980239 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a6fdb-f0c2-41d3-a6ce-fa2cd08c9813 None admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:51.980903 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a6fdb-f0c2-41d3-a6ce-fa2cd08c9813 None admin] RBAC: Adding query filter params (name=service) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:51.981229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a6fdb-f0c2-41d3-a6ce-fa2cd08c9813 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:51.982596 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a6fdb-f0c2-41d3-a6ce-fa2cd08c9813 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:51.998087 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 356/723] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Sep 26 17:42:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:52.003573 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378a343-6209-490c-ba3a-30b472d43ab0 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:52.057155 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:52.086035 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6d428-096b-41a4-be78-c814925cd47e None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:52.086405 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6d428-096b-41a4-be78-c814925cd47e None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:52.086597 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6d428-096b-41a4-be78-c814925cd47e None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:52.087909 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 357/724] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 17:42:52.092864 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e26271-da1e-48b4-b50d-2fcfc4913757 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:52.093170 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e26271-da1e-48b4-b50d-2fcfc4913757 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:52.093442 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e26271-da1e-48b4-b50d-2fcfc4913757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:52.125086 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378a343-6209-490c-ba3a-30b472d43ab0 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:52.127077 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-c6e26271-da1e-48b4-b50d-2fcfc4913757 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:52.128495 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-c6e26271-da1e-48b4-b50d-2fcfc4913757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:52.157104 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc13a31-8c2f-4d8c-9115-322e6b41a00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:52.157743 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc13a31-8c2f-4d8c-9115-322e6b41a00b None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:52.158068 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc13a31-8c2f-4d8c-9115-322e6b41a00b None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:52.158347 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc13a31-8c2f-4d8c-9115-322e6b41a00b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:52.169962 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc13a31-8c2f-4d8c-9115-322e6b41a00b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:52.171735 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc13a31-8c2f-4d8c-9115-322e6b41a00b None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:52.187915 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-9fc13a31-8c2f-4d8c-9115-322e6b41a00b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:52.187915 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:52.187915 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:52.187915 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:52.187915 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:52.187915 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:52.187915 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:52.187915 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:52.187915 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:52.187915 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:52.187915 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:52.187915 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:52.187915 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:52.187915 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:52.187915 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:52.187915 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:52.188902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:52.188902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:52.188902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:52.188902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:52.188902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:52.188902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:52.188902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:52.188902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:52.188902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:52.188902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:52.188902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:52.188902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:52.188902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:52.188902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:52.188902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:52.188902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:52.188902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:52.189827 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:52.189827 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:52.189827 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:52.189827 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 368/725] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:52.196059 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc13a31-8c2f-4d8c-9115-322e6b41a00b None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:52.205666 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:52.239160 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 358/726] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 17:42:52.367211 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:52.370773 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc13a31-8c2f-4d8c-9115-322e6b41a00b None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:52.432667 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63c77e-75d6-4e38-88dc-c3629f77fe09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:52.433304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63c77e-75d6-4e38-88dc-c3629f77fe09 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:52.433587 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63c77e-75d6-4e38-88dc-c3629f77fe09 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:52.433862 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63c77e-75d6-4e38-88dc-c3629f77fe09 None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:52.434503 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63c77e-75d6-4e38-88dc-c3629f77fe09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:52.434809 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63c77e-75d6-4e38-88dc-c3629f77fe09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:52.436177 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63c77e-75d6-4e38-88dc-c3629f77fe09 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:52.453082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 369/727] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:52.457611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e26271-da1e-48b4-b50d-2fcfc4913757 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:52.591710 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e26271-da1e-48b4-b50d-2fcfc4913757 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:52.644514 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67932eb9-c8ee-4755-961f-669c75bacba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:52.645181 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67932eb9-c8ee-4755-961f-669c75bacba6 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:52.645460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67932eb9-c8ee-4755-961f-669c75bacba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:52.645732 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67932eb9-c8ee-4755-961f-669c75bacba6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:52.651887 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63c77e-75d6-4e38-88dc-c3629f77fe09 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:52.656324 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67932eb9-c8ee-4755-961f-669c75bacba6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:52.658100 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67932eb9-c8ee-4755-961f-669c75bacba6 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:52.672848 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-67932eb9-c8ee-4755-961f-669c75bacba6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 17:42:52.672848 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:52.672848 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:52.672848 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:52.672848 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:52.672848 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:52.672848 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:52.672848 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:52.672848 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:52.672848 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:52.672848 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:52.672848 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:52.672848 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 17:42:52.672848 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 17:42:52.672848 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 17:42:52.672848 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 17:42:52.673963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:52.673963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:52.673963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 17:42:52.673963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:42:52.673963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 17:42:52.673963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:42:52.673963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:52.673963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:52.673963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:52.673963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:52.673963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:52.673963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:52.673963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:52.673963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:52.673963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:52.673963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:52.673963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:52.673963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:52.674887 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:52.674887 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:52.674887 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 17:42:52.674887 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 17:42:52.674887 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 17:42:52.674887 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 17:42:52.674887 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 17:42:52.674887 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 17:42:52.674887 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 17:42:52.674887 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:52.674887 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 359/728] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Sep 26 17:42:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:52.679506 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67932eb9-c8ee-4755-961f-669c75bacba6 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:52.739508 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:52.824051 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63c77e-75d6-4e38-88dc-c3629f77fe09 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:52.866333 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67932eb9-c8ee-4755-961f-669c75bacba6 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:52.872768 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa398b-236b-478d-bae0-977d69a2fb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:52.873784 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa398b-236b-478d-bae0-977d69a2fb72 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:52.874257 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa398b-236b-478d-bae0-977d69a2fb72 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:52.874737 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa398b-236b-478d-bae0-977d69a2fb72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:52.887588 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa398b-236b-478d-bae0-977d69a2fb72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:42:52.893144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-30fa398b-236b-478d-bae0-977d69a2fb72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:42:52.893144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:52.893144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:52.893144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:52.893144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:52.893144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:52.893144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:52.893144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:52.893144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:52.893144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:52.893144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:52.893144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:52.893144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:42:52.893144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:42:52.893144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:42:52.893144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:42:52.894059 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:42:52.894059 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:42:52.894059 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:42:52.894059 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:42:52.894059 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:52.894059 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:52.894059 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:52.894059 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:52.894059 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:52.894059 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:52.894059 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:52.894059 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:52.894059 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:52.894059 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:52.894059 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:52.894059 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:52.894877 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:52.894877 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:52.894877 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:52.894877 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:52.894877 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:42:52.894877 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:42:52.894877 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:42:52.894877 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:42:52.894877 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:42:52.894877 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:42:52.894877 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:42:52.894877 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:52.897737 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 370/729] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Sep 26 17:42:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:42:52.903794 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa398b-236b-478d-bae0-977d69a2fb72 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:52.908074 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044b853-54d2-48bf-9ad9-01bd4f4fc4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:52.908976 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044b853-54d2-48bf-9ad9-01bd4f4fc4a1 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:52.909482 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044b853-54d2-48bf-9ad9-01bd4f4fc4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:52.909981 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044b853-54d2-48bf-9ad9-01bd4f4fc4a1 None admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:52.910934 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044b853-54d2-48bf-9ad9-01bd4f4fc4a1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:52.911438 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044b853-54d2-48bf-9ad9-01bd4f4fc4a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:52.913158 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044b853-54d2-48bf-9ad9-01bd4f4fc4a1 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:52.942470 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 360/730] 10.222.0.62 () {56 vars in 1149 bytes} [Mon Sep 26 17:42:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:42:52.946343 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:52.949682 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044b853-54d2-48bf-9ad9-01bd4f4fc4a1 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:53.102911 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:53.104412 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa398b-236b-478d-bae0-977d69a2fb72 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:53.121097 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044b853-54d2-48bf-9ad9-01bd4f4fc4a1 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:53.160159 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48808664-b4ed-486e-9b27-b3192dbd9ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:53.160788 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48808664-b4ed-486e-9b27-b3192dbd9ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:53.161091 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48808664-b4ed-486e-9b27-b3192dbd9ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:53.161360 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48808664-b4ed-486e-9b27-b3192dbd9ff0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:53.184394 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c02df-14c4-49fe-9f7c-193a7ca86d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:53.185417 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c02df-14c4-49fe-9f7c-193a7ca86d93 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:53.185923 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c02df-14c4-49fe-9f7c-193a7ca86d93 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:53.186465 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c02df-14c4-49fe-9f7c-193a7ca86d93 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:53.187336 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c02df-14c4-49fe-9f7c-193a7ca86d93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:53.188117 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c02df-14c4-49fe-9f7c-193a7ca86d93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:53.189719 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c02df-14c4-49fe-9f7c-193a7ca86d93 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:53.203880 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 371/731] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:42:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:53.210545 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c02df-14c4-49fe-9f7c-193a7ca86d93 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:53.298803 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48808664-b4ed-486e-9b27-b3192dbd9ff0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:53.300290 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48808664-b4ed-486e-9b27-b3192dbd9ff0 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:53.333298 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:53.364625 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c02df-14c4-49fe-9f7c-193a7ca86d93 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:53.400156 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:53.411153 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04f97a-c591-4311-aaf5-b38d2d846586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:53.411791 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04f97a-c591-4311-aaf5-b38d2d846586 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:53.412072 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04f97a-c591-4311-aaf5-b38d2d846586 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:53.412345 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04f97a-c591-4311-aaf5-b38d2d846586 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:53.415944 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 361/732] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:42:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 17:42:53.417143 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42f37f-a23b-4abb-ab46-f9f4f0fc23aa None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:53.417424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42f37f-a23b-4abb-ab46-f9f4f0fc23aa None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:53.417691 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42f37f-a23b-4abb-ab46-f9f4f0fc23aa None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:53.421506 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 362/733] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:53.421506 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5c9aa-1d00-4934-b427-1ede9fe422df None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:53.421506 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5c9aa-1d00-4934-b427-1ede9fe422df None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:53.421506 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5c9aa-1d00-4934-b427-1ede9fe422df None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:53.422015 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 363/734] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:53.422623 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5c9aa-1d00-4934-b427-1ede9fe422df None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:53.426675 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04f97a-c591-4311-aaf5-b38d2d846586 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:53.428139 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04f97a-c591-4311-aaf5-b38d2d846586 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:53.443271 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-0d04f97a-c591-4311-aaf5-b38d2d846586 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:53.443271 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:53.443271 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:53.443271 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:53.443271 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:53.443271 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:53.443271 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:53.443271 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:53.443271 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:53.443271 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:53.443271 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:53.443271 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:53.443271 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:53.443271 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:53.443271 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:53.443271 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:53.444817 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:53.444817 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:53.444817 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:53.444817 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:53.444817 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:53.444817 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:53.444817 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:53.444817 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:53.444817 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:53.444817 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:53.444817 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:53.444817 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:53.444817 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:53.444817 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:53.444817 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:53.444817 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:53.444817 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:53.445809 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:53.445809 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:53.445809 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:53.445809 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 372/735] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:42:53.446855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c3421-d303-4100-aa32-d3512cd0f032 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:53.446855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c3421-d303-4100-aa32-d3512cd0f032 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:53.447018 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c3421-d303-4100-aa32-d3512cd0f032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:53.466523 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-3e5c3421-d303-4100-aa32-d3512cd0f032 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:53.467692 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-3e5c3421-d303-4100-aa32-d3512cd0f032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:53.533425 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5c9aa-1d00-4934-b427-1ede9fe422df None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:53.537181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 373/736] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:42:53.538679 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611cd5f0-19a1-4a0d-b2d9-dccdc6a24b59 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:53.538961 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611cd5f0-19a1-4a0d-b2d9-dccdc6a24b59 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:53.539234 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611cd5f0-19a1-4a0d-b2d9-dccdc6a24b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:53.561109 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-611cd5f0-19a1-4a0d-b2d9-dccdc6a24b59 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:53.562310 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-611cd5f0-19a1-4a0d-b2d9-dccdc6a24b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:53.567511 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe1508-9c8a-4d19-9d26-be6f93c5c278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:53.568135 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe1508-9c8a-4d19-9d26-be6f93c5c278 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:53.568407 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe1508-9c8a-4d19-9d26-be6f93c5c278 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:53.568670 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe1508-9c8a-4d19-9d26-be6f93c5c278 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:53.579249 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe1508-9c8a-4d19-9d26-be6f93c5c278 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:53.580665 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe1508-9c8a-4d19-9d26-be6f93c5c278 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:53.596092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-0dfe1508-9c8a-4d19-9d26-be6f93c5c278 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:53.596092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:53.596092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:53.596092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:53.596092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:53.596092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:53.596092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:53.596092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:53.596092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:53.596092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:53.596092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:53.596092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:53.596092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:53.596092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:53.596092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:53.596092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:53.597091 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:53.597091 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:53.597091 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:53.597091 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:53.597091 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:53.597091 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:53.597091 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:53.597091 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:53.597091 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:53.597091 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:53.597091 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:53.597091 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:53.597091 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:53.597091 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:53.597091 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:53.597091 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:53.597091 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:53.598004 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:53.598004 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:53.598004 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:53.598004 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 364/737] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:53.598004 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe1508-9c8a-4d19-9d26-be6f93c5c278 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:53.630208 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:53.643044 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 374/738] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:42:53.645184 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60f3c3-3ec3-4714-ba30-0af868708100 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:53.645639 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60f3c3-3ec3-4714-ba30-0af868708100 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:53.646226 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60f3c3-3ec3-4714-ba30-0af868708100 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:53.649037 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 375/739] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:53.649911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60f3c3-3ec3-4714-ba30-0af868708100 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:53.651044 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:53.706251 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe1508-9c8a-4d19-9d26-be6f93c5c278 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:53.744711 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f1476-1362-4b7d-92ae-58a9759c9c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:53.745370 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f1476-1362-4b7d-92ae-58a9759c9c02 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:53.745653 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f1476-1362-4b7d-92ae-58a9759c9c02 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:53.745932 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f1476-1362-4b7d-92ae-58a9759c9c02 None admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:53.746580 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f1476-1362-4b7d-92ae-58a9759c9c02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:53.746885 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f1476-1362-4b7d-92ae-58a9759c9c02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:53.748682 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f1476-1362-4b7d-92ae-58a9759c9c02 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:53.764151 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 365/740] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:53.765924 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e573f84-b954-4574-b0a0-917422ed2b7e None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:53.766215 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e573f84-b954-4574-b0a0-917422ed2b7e None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:53.766489 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e573f84-b954-4574-b0a0-917422ed2b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:53.782063 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60f3c3-3ec3-4714-ba30-0af868708100 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:53.791733 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-6e573f84-b954-4574-b0a0-917422ed2b7e None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:53.792955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-6e573f84-b954-4574-b0a0-917422ed2b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:53.824388 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c2b91-1a94-4033-b287-9532b92d1a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:53.825200 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c2b91-1a94-4033-b287-9532b92d1a6c None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:53.825483 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c2b91-1a94-4033-b287-9532b92d1a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:53.825757 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c2b91-1a94-4033-b287-9532b92d1a6c None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:53.826654 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c2b91-1a94-4033-b287-9532b92d1a6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:53.826960 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c2b91-1a94-4033-b287-9532b92d1a6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:53.828324 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c2b91-1a94-4033-b287-9532b92d1a6c None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:53.840626 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 376/741] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:53.841470 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c2b91-1a94-4033-b287-9532b92d1a6c None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:53.869801 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 366/742] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 17:42:53.870958 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e573f84-b954-4574-b0a0-917422ed2b7e None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:53.915239 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:53.916303 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:53.968941 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c2b91-1a94-4033-b287-9532b92d1a6c None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:53.997565 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e573f84-b954-4574-b0a0-917422ed2b7e None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:54.008004 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7111c2-d3fe-4929-b8ab-47357e6f301c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:54.008653 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7111c2-d3fe-4929-b8ab-47357e6f301c None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:54.009253 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7111c2-d3fe-4929-b8ab-47357e6f301c None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:54.009619 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7111c2-d3fe-4929-b8ab-47357e6f301c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:54.017473 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7111c2-d3fe-4929-b8ab-47357e6f301c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:54.018917 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7111c2-d3fe-4929-b8ab-47357e6f301c None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:54.030550 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-8a7111c2-d3fe-4929-b8ab-47357e6f301c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 26 17:42:54.030550 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:54.030550 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:54.030550 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:54.030550 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:54.030550 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:54.030550 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:54.030550 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:54.030550 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:54.030550 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:54.030550 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:54.030550 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:54.030550 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 17:42:54.030550 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 17:42:54.030550 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 17:42:54.030550 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 17:42:54.031484 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:54.031484 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:54.031484 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 17:42:54.031484 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:42:54.031484 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 17:42:54.031484 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:42:54.031484 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:54.031484 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:54.031484 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:54.031484 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:54.031484 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:54.031484 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:54.031484 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:54.031484 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:54.031484 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:54.031484 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:54.031484 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:54.031484 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:54.032435 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:54.032435 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:54.032435 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 17:42:54.032435 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 17:42:54.032435 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 17:42:54.032435 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 17:42:54.032435 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 17:42:54.032435 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 17:42:54.032435 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 26 17:42:54.032435 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:54.032435 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 377/743] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Sep 26 17:42:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:54.032435 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7111c2-d3fe-4929-b8ab-47357e6f301c None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:54.038791 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc5bae-7e45-452e-8033-1448ff527f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:54.039408 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc5bae-7e45-452e-8033-1448ff527f32 None admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:54.039686 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc5bae-7e45-452e-8033-1448ff527f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:54.039956 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc5bae-7e45-452e-8033-1448ff527f32 None admin] PATH_INFO: `/v3/services` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:54.040608 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efc5bae-7e45-452e-8033-1448ff527f32 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:54.042013 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efc5bae-7e45-452e-8033-1448ff527f32 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:54.062083 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 367/744] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Sep 26 17:42:53 2022] POST /identity/v3/services => generated 240 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:42:54.063197 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc5bae-7e45-452e-8033-1448ff527f32 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:54.165973 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7111c2-d3fe-4929-b8ab-47357e6f301c None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:54.180235 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:54.189182 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:54.210686 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc5bae-7e45-452e-8033-1448ff527f32 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:54.220012 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29247d-afca-4439-a678-334fa2e55139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:54.220656 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29247d-afca-4439-a678-334fa2e55139 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:54.221210 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29247d-afca-4439-a678-334fa2e55139 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:54.221210 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29247d-afca-4439-a678-334fa2e55139 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:54.228966 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29247d-afca-4439-a678-334fa2e55139 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:54.230487 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29247d-afca-4439-a678-334fa2e55139 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:54.242216 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-bc29247d-afca-4439-a678-334fa2e55139 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:42:54.242216 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:54.242216 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:54.242216 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:54.242216 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:54.242216 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:54.242216 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:54.242216 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:54.242216 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:54.242216 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:54.242216 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:54.242216 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:54.242216 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 17:42:54.242216 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 17:42:54.242216 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 17:42:54.243356 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 17:42:54.243356 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:54.243356 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:54.243356 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:54.243356 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:54.243356 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:54.243356 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:54.243356 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:54.243356 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:54.243356 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:54.243356 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:54.243356 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:54.243356 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:54.243356 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:54.243356 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:54.243356 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:54.243356 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:54.244939 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 17:42:54.244939 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 17:42:54.244939 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 17:42:54.244939 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 17:42:54.244939 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 17:42:54.244939 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 17:42:54.244939 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:42:54.244939 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:54.244939 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 378/745] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:42:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:54.245465 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29247d-afca-4439-a678-334fa2e55139 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:54.255763 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c25a7a-fd36-4962-a9bb-d0a333178277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:54.257518 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c25a7a-fd36-4962-a9bb-d0a333178277 None admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:54.257801 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c25a7a-fd36-4962-a9bb-d0a333178277 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:54.258397 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c25a7a-fd36-4962-a9bb-d0a333178277 None admin] PATH_INFO: `/v3/services` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:54.259351 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c25a7a-fd36-4962-a9bb-d0a333178277 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:54.260911 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c25a7a-fd36-4962-a9bb-d0a333178277 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:54.282466 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 368/746] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Sep 26 17:42:54 2022] POST /identity/v3/services => generated 251 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:42:54.282927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c25a7a-fd36-4962-a9bb-d0a333178277 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:54.386993 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29247d-afca-4439-a678-334fa2e55139 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:54.436464 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7c62b-0361-4947-97ff-3273afd6dd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:54.437532 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7c62b-0361-4947-97ff-3273afd6dd4a None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:54.438070 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7c62b-0361-4947-97ff-3273afd6dd4a None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:54.438490 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7c62b-0361-4947-97ff-3273afd6dd4a None admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:54.439488 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c7c62b-0361-4947-97ff-3273afd6dd4a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:54.439950 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c7c62b-0361-4947-97ff-3273afd6dd4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:54.441784 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c7c62b-0361-4947-97ff-3273afd6dd4a None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:54.444471 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c25a7a-fd36-4962-a9bb-d0a333178277 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:54.464463 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 379/747] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Sep 26 17:42:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:54.465652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7c62b-0361-4947-97ff-3273afd6dd4a None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:54.492181 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5ce67-99ec-4bee-b3a0-b824d821adf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:54.494541 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5ce67-99ec-4bee-b3a0-b824d821adf4 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:54.494541 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5ce67-99ec-4bee-b3a0-b824d821adf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:54.494541 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5ce67-99ec-4bee-b3a0-b824d821adf4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:54.495181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:54.510583 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b5ce67-99ec-4bee-b3a0-b824d821adf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:42:54.515033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-e4b5ce67-99ec-4bee-b3a0-b824d821adf4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:42:54.515033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:54.515033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:54.515033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:54.515033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:54.515033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:54.515033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:54.515033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:54.515033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:54.515033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:54.515033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:54.515033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:54.515033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:42:54.515033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:42:54.515033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:42:54.515033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:42:54.515967 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:42:54.515967 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:42:54.515967 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:42:54.515967 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:42:54.515967 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:54.515967 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:54.515967 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:54.515967 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:54.515967 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:54.515967 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:54.515967 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:54.515967 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:54.515967 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:54.515967 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:54.515967 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:54.515967 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:54.517272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:54.517272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:54.517272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:54.517272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:54.517272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:42:54.517272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:42:54.517272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:42:54.517272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:42:54.517272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:42:54.517272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:42:54.517272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:42:54.517272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:54.517272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 369/748] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Sep 26 17:42:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:54.518286 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5ce67-99ec-4bee-b3a0-b824d821adf4 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:54.530801 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:54.603170 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7c62b-0361-4947-97ff-3273afd6dd4a None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:54.630330 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5ce67-99ec-4bee-b3a0-b824d821adf4 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:54.639577 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9b6ec-2b8b-48f4-961a-b10ecc23df2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:54.640335 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9b6ec-2b8b-48f4-961a-b10ecc23df2e None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:54.640745 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9b6ec-2b8b-48f4-961a-b10ecc23df2e None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:54.641117 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9b6ec-2b8b-48f4-961a-b10ecc23df2e None admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:54.641890 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9b6ec-2b8b-48f4-961a-b10ecc23df2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:54.642262 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9b6ec-2b8b-48f4-961a-b10ecc23df2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:54.643780 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9b6ec-2b8b-48f4-961a-b10ecc23df2e None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:54.656387 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 380/749] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Sep 26 17:42:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:54.657150 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9b6ec-2b8b-48f4-961a-b10ecc23df2e None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:54.681224 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070982f-b742-450d-8392-2107a67973fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:54.681934 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070982f-b742-450d-8392-2107a67973fe None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:54.682299 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070982f-b742-450d-8392-2107a67973fe None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:54.682646 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070982f-b742-450d-8392-2107a67973fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:54.753102 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:54.773322 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070982f-b742-450d-8392-2107a67973fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:54.774665 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9b6ec-2b8b-48f4-961a-b10ecc23df2e None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:54.774818 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070982f-b742-450d-8392-2107a67973fe None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:54.788458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:54.819654 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162b512-ecf0-42e6-a8c8-3457d003ca5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:54.820937 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162b512-ecf0-42e6-a8c8-3457d003ca5b None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:54.821497 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162b512-ecf0-42e6-a8c8-3457d003ca5b None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:54.821902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162b512-ecf0-42e6-a8c8-3457d003ca5b None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:54.822695 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162b512-ecf0-42e6-a8c8-3457d003ca5b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:54.823133 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162b512-ecf0-42e6-a8c8-3457d003ca5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:54.824632 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162b512-ecf0-42e6-a8c8-3457d003ca5b None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:54.834678 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 381/750] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:42:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:54.835830 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162b512-ecf0-42e6-a8c8-3457d003ca5b None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:54.901685 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 370/751] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:42:54 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 17:42:54.902619 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070982f-b742-450d-8392-2107a67973fe None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:54.945356 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162b512-ecf0-42e6-a8c8-3457d003ca5b None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:54.981870 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea14f3b-a884-4b70-9a73-964a140bd6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:54.982844 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea14f3b-a884-4b70-9a73-964a140bd6fd None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:54.983318 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea14f3b-a884-4b70-9a73-964a140bd6fd None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:54.983782 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea14f3b-a884-4b70-9a73-964a140bd6fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:54.984685 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea14f3b-a884-4b70-9a73-964a140bd6fd None admin] RBAC: Adding query filter params (role.id=4685fd1f2f284d4498281231160a5f27, scope.project.id=125361b23eb14b53aca5e0139919881e, user.id=8475122232ef4d8893f2a9b98768396e) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:54.985223 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea14f3b-a884-4b70-9a73-964a140bd6fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:54.986889 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea14f3b-a884-4b70-9a73-964a140bd6fd None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:54.994061 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 382/752] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:42:54 2022] GET /identity/v3/role_assignments?user.id=8475122232ef4d8893f2a9b98768396e&scope.project.id=125361b23eb14b53aca5e0139919881e&role.id=4685fd1f2f284d4498281231160a5f27 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:54.995269 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea14f3b-a884-4b70-9a73-964a140bd6fd None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:55.009732 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:55.041189 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070982f-b742-450d-8392-2107a67973fe None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:55.060266 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:55.111135 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09bca7-f4c9-4be3-85dd-156ecf9eac65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:55.112460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09bca7-f4c9-4be3-85dd-156ecf9eac65 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:55.112935 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09bca7-f4c9-4be3-85dd-156ecf9eac65 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:55.113243 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09bca7-f4c9-4be3-85dd-156ecf9eac65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:55.135060 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea14f3b-a884-4b70-9a73-964a140bd6fd None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:55.139608 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09bca7-f4c9-4be3-85dd-156ecf9eac65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:55.141195 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09bca7-f4c9-4be3-85dd-156ecf9eac65 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:55.172081 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-3d09bca7-f4c9-4be3-85dd-156ecf9eac65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:55.172081 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:55.172081 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:55.172081 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:55.172081 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:55.172081 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:55.172081 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:55.172081 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:55.172081 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:55.172081 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:55.172081 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:55.172081 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:55.172081 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:55.172081 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:55.172081 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:55.172081 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:55.173118 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:55.173118 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:55.173118 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:55.173118 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:55.173118 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:55.173118 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:55.173118 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:55.173118 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:55.173118 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:55.173118 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:55.173118 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:55.173118 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:55.173118 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:55.173118 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:55.173118 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:55.173118 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:55.173118 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:55.173995 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:55.173995 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:55.173995 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:55.174701 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 371/753] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:55.181483 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09bca7-f4c9-4be3-85dd-156ecf9eac65 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:55.201555 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a65f71-e1d5-4f63-b509-eea1f5c93830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:55.202195 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a65f71-e1d5-4f63-b509-eea1f5c93830 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:55.202471 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a65f71-e1d5-4f63-b509-eea1f5c93830 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:55.202739 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a65f71-e1d5-4f63-b509-eea1f5c93830 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:55.214750 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a65f71-e1d5-4f63-b509-eea1f5c93830 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:55.216444 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a65f71-e1d5-4f63-b509-eea1f5c93830 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:55.250793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-31a65f71-e1d5-4f63-b509-eea1f5c93830 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:55.250793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:55.250793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:55.250793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:55.250793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:55.250793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:55.250793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:55.250793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:55.250793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:55.250793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:55.250793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:55.250793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:55.250793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:55.250793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:55.250793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:55.250793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:55.251793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:55.251793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:55.251793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:55.251793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:55.251793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:55.251793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:55.251793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:55.251793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:55.251793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:55.251793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:55.251793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:55.251793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:55.251793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:55.251793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:55.251793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:55.251793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:55.251793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:55.252673 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:55.252673 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:55.252673 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:55.252673 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 383/754] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:55.258909 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a65f71-e1d5-4f63-b509-eea1f5c93830 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:55.365585 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09bca7-f4c9-4be3-85dd-156ecf9eac65 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:55.381940 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:55.437852 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34543532-0fc1-4786-9320-e78580bc74cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:55.438471 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34543532-0fc1-4786-9320-e78580bc74cd None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:55.438748 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34543532-0fc1-4786-9320-e78580bc74cd None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:55.439018 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34543532-0fc1-4786-9320-e78580bc74cd None admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:55.439669 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34543532-0fc1-4786-9320-e78580bc74cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:55.439976 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34543532-0fc1-4786-9320-e78580bc74cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:55.441376 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34543532-0fc1-4786-9320-e78580bc74cd None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:55.461117 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a65f71-e1d5-4f63-b509-eea1f5c93830 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:55.471381 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 372/755] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:55.476996 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34543532-0fc1-4786-9320-e78580bc74cd None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:55.512059 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:55.524656 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa4575-94c2-4405-85b2-4f94a60381b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:55.525299 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa4575-94c2-4405-85b2-4f94a60381b9 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:55.525580 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa4575-94c2-4405-85b2-4f94a60381b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:55.525849 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa4575-94c2-4405-85b2-4f94a60381b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:55.526495 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa4575-94c2-4405-85b2-4f94a60381b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:55.526797 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa4575-94c2-4405-85b2-4f94a60381b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:55.528158 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa4575-94c2-4405-85b2-4f94a60381b9 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:55.555152 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 384/756] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:55.561291 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa4575-94c2-4405-85b2-4f94a60381b9 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:55.653081 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34543532-0fc1-4786-9320-e78580bc74cd None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:55.718303 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acca1dc-77dc-4681-8ad4-7f91d454788a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:55.718937 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acca1dc-77dc-4681-8ad4-7f91d454788a None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:55.719212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acca1dc-77dc-4681-8ad4-7f91d454788a None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:55.719468 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acca1dc-77dc-4681-8ad4-7f91d454788a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:55.729791 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acca1dc-77dc-4681-8ad4-7f91d454788a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:55.731264 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acca1dc-77dc-4681-8ad4-7f91d454788a None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:55.743558 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa4575-94c2-4405-85b2-4f94a60381b9 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:55.762160 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-3acca1dc-77dc-4681-8ad4-7f91d454788a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 17:42:55.762160 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:55.762160 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:55.762160 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:55.762160 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:55.762160 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:55.762160 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:55.762160 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:55.762160 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:55.762160 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:55.762160 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:55.762160 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:55.762160 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 17:42:55.762160 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 17:42:55.762160 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 17:42:55.762160 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 17:42:55.764371 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:55.764371 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:55.764371 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 17:42:55.764371 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:42:55.764371 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 17:42:55.764371 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:42:55.764371 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:55.764371 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:55.764371 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:55.764371 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:55.764371 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:55.764371 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:55.764371 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:55.764371 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:55.764371 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:55.764371 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:55.764371 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:55.764371 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:55.766680 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:55.766680 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:55.766680 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 17:42:55.766680 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 17:42:55.766680 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 17:42:55.766680 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 17:42:55.766680 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 17:42:55.766680 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 17:42:55.766680 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 17:42:55.766680 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:55.766680 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 373/757] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Sep 26 17:42:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:55.778138 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:55.782427 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acca1dc-77dc-4681-8ad4-7f91d454788a None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:55.785879 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb82bdf-35eb-43c8-a6f4-fd2a295d846b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:55.786525 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb82bdf-35eb-43c8-a6f4-fd2a295d846b None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:55.786879 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb82bdf-35eb-43c8-a6f4-fd2a295d846b None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:55.787079 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb82bdf-35eb-43c8-a6f4-fd2a295d846b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:55.794823 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb82bdf-35eb-43c8-a6f4-fd2a295d846b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:55.796345 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb82bdf-35eb-43c8-a6f4-fd2a295d846b None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:55.808845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-8bb82bdf-35eb-43c8-a6f4-fd2a295d846b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:42:55.808845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:55.808845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:55.808845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:55.808845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:55.808845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:55.808845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:55.808845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:55.808845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:55.808845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:55.808845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:55.808845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:55.808845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 17:42:55.808845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 17:42:55.808845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 17:42:55.810973 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 17:42:55.810973 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:55.810973 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:55.810973 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:55.810973 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:55.810973 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:55.810973 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:55.810973 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:55.810973 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:55.810973 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:55.810973 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:55.810973 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:55.810973 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:55.810973 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:55.810973 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:55.810973 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:55.810973 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:55.813302 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 17:42:55.813302 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 17:42:55.813302 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 17:42:55.813302 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 17:42:55.813302 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 17:42:55.813302 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 17:42:55.813302 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:42:55.813302 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:55.813302 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 385/758] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:42:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:55.817982 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb82bdf-35eb-43c8-a6f4-fd2a295d846b None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:55.937868 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:55.981651 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acca1dc-77dc-4681-8ad4-7f91d454788a None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:56.000999 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb82bdf-35eb-43c8-a6f4-fd2a295d846b None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:56.060506 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08bfc65-4029-4f80-8e67-b1707a717a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:56.061146 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bfc65-4029-4f80-8e67-b1707a717a10 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:56.061435 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bfc65-4029-4f80-8e67-b1707a717a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:56.061711 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bfc65-4029-4f80-8e67-b1707a717a10 None admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:56.062475 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08bfc65-4029-4f80-8e67-b1707a717a10 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:56.062804 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08bfc65-4029-4f80-8e67-b1707a717a10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:56.068184 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08bfc65-4029-4f80-8e67-b1707a717a10 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:56.077728 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64d68a-6e97-4d89-aad2-1c66ff0ba048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:56.078415 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64d68a-6e97-4d89-aad2-1c66ff0ba048 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:56.078696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64d68a-6e97-4d89-aad2-1c66ff0ba048 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:56.079023 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64d68a-6e97-4d89-aad2-1c66ff0ba048 None admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:56.079731 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db64d68a-6e97-4d89-aad2-1c66ff0ba048 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:56.080037 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db64d68a-6e97-4d89-aad2-1c66ff0ba048 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:56.081527 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db64d68a-6e97-4d89-aad2-1c66ff0ba048 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:56.090242 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 374/759] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Sep 26 17:42:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:56.096457 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08bfc65-4029-4f80-8e67-b1707a717a10 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:56.116316 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 386/760] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Sep 26 17:42:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:56.122245 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64d68a-6e97-4d89-aad2-1c66ff0ba048 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:56.208858 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08bfc65-4029-4f80-8e67-b1707a717a10 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:56.251655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd43115-b4d4-4080-83d7-7eb02db60570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:56.252295 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd43115-b4d4-4080-83d7-7eb02db60570 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:56.253022 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd43115-b4d4-4080-83d7-7eb02db60570 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:56.253310 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd43115-b4d4-4080-83d7-7eb02db60570 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:56.269417 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:56.273405 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:56.277577 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd43115-b4d4-4080-83d7-7eb02db60570 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:56.279143 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd43115-b4d4-4080-83d7-7eb02db60570 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:56.316764 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-6bd43115-b4d4-4080-83d7-7eb02db60570 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:56.316764 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:56.316764 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:56.316764 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:56.316764 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:56.316764 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:56.316764 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:56.316764 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:56.316764 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:56.316764 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:56.316764 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:56.316764 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:56.316764 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:56.316764 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:56.316764 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:56.316764 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:56.317800 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:56.317800 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:56.317800 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:56.317800 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:56.317800 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:56.317800 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:56.317800 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:56.317800 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:56.317800 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:56.317800 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:56.317800 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:56.317800 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:56.317800 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:56.317800 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:56.317800 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:56.317800 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:56.317800 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:56.319588 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:56.319588 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:56.319588 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:56.319588 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 375/761] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:56.330052 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd43115-b4d4-4080-83d7-7eb02db60570 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:56.370403 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64d68a-6e97-4d89-aad2-1c66ff0ba048 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:56.421685 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fe60e-46f6-44f3-a1b5-1daf314c64ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:56.422293 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fe60e-46f6-44f3-a1b5-1daf314c64ec None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:56.422573 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fe60e-46f6-44f3-a1b5-1daf314c64ec None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:56.422844 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fe60e-46f6-44f3-a1b5-1daf314c64ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:56.423631 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0fe60e-46f6-44f3-a1b5-1daf314c64ec None admin] RBAC: Adding query filter params (role.id=be6ee971abf54b26be509c14823ece55, scope.project.id=125361b23eb14b53aca5e0139919881e, user.id=ea49cd9839474232a0cbe66ccffbf082) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:56.423944 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0fe60e-46f6-44f3-a1b5-1daf314c64ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:56.425551 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0fe60e-46f6-44f3-a1b5-1daf314c64ec None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:56.433891 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 387/762] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:42:56 2022] GET /identity/v3/role_assignments?user.id=ea49cd9839474232a0cbe66ccffbf082&scope.project.id=125361b23eb14b53aca5e0139919881e&role.id=be6ee971abf54b26be509c14823ece55 => generated 259 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:42:56.435145 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314afbca-1bdf-4936-ab50-387180e7dd64 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:56.435431 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314afbca-1bdf-4936-ab50-387180e7dd64 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:56.435705 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314afbca-1bdf-4936-ab50-387180e7dd64 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:56.441628 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 388/763] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:56.443115 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da226707-17a3-4f2d-b76a-4c288973e8b2 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:56.443404 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da226707-17a3-4f2d-b76a-4c288973e8b2 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:56.443682 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da226707-17a3-4f2d-b76a-4c288973e8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:56.483538 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-da226707-17a3-4f2d-b76a-4c288973e8b2 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:56.484683 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-da226707-17a3-4f2d-b76a-4c288973e8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:56.566643 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd43115-b4d4-4080-83d7-7eb02db60570 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:56.593032 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 389/764] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 17:42:56.639470 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba48a2-9d47-4578-ae25-b7be5c3cd6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:56.640112 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba48a2-9d47-4578-ae25-b7be5c3cd6f3 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:56.640391 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba48a2-9d47-4578-ae25-b7be5c3cd6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:56.640660 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba48a2-9d47-4578-ae25-b7be5c3cd6f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:56.641378 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ba48a2-9d47-4578-ae25-b7be5c3cd6f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:56.641738 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ba48a2-9d47-4578-ae25-b7be5c3cd6f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:56.643227 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ba48a2-9d47-4578-ae25-b7be5c3cd6f3 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:56.658993 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 376/765] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:56.664834 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da226707-17a3-4f2d-b76a-4c288973e8b2 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:56.718913 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:56.765236 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7176b0c-92e6-4667-955b-71bd63b10d0d None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:56.765450 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7176b0c-92e6-4667-955b-71bd63b10d0d None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:56.765733 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7176b0c-92e6-4667-955b-71bd63b10d0d None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:56.767290 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 377/766] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:56.786427 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d1ff8-3894-405e-96dc-44b22c919047 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:56.786754 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d1ff8-3894-405e-96dc-44b22c919047 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:56.786991 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d1ff8-3894-405e-96dc-44b22c919047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:56.813991 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da226707-17a3-4f2d-b76a-4c288973e8b2 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:56.834034 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-377d1ff8-3894-405e-96dc-44b22c919047 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:56.835794 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-377d1ff8-3894-405e-96dc-44b22c919047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:56.852229 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a04622-32c8-4957-9a18-f54f36534f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:56.852862 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a04622-32c8-4957-9a18-f54f36534f2e None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:56.853169 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a04622-32c8-4957-9a18-f54f36534f2e None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:56.853440 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a04622-32c8-4957-9a18-f54f36534f2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:56.860179 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a04622-32c8-4957-9a18-f54f36534f2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:56.861691 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a04622-32c8-4957-9a18-f54f36534f2e None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:56.873290 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-75a04622-32c8-4957-9a18-f54f36534f2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:42:56.873290 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:56.873290 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:56.873290 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:56.873290 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:56.873290 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:56.873290 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:56.873290 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:56.873290 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:56.873290 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:56.873290 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:56.873290 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:56.873290 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 17:42:56.873290 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 17:42:56.873290 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 17:42:56.874194 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 17:42:56.874194 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:56.874194 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:56.874194 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:56.874194 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:56.874194 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:56.874194 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:56.874194 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:56.874194 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:56.874194 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:56.874194 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:56.874194 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:56.874194 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:56.874194 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:56.874194 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:56.874194 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:56.874194 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:56.875157 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 17:42:56.875157 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 17:42:56.875157 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 17:42:56.875157 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 17:42:56.875157 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 17:42:56.875157 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 17:42:56.875157 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:42:56.875157 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:56.875157 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 390/767] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:42:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:56.882048 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a04622-32c8-4957-9a18-f54f36534f2e None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:56.935072 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:56.969132 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 378/768] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:42:56.970015 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d1ff8-3894-405e-96dc-44b22c919047 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:57.001899 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:57.015462 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a04622-32c8-4957-9a18-f54f36534f2e None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:57.093731 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177a048-65c9-465b-8f6b-294091958571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:57.094361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177a048-65c9-465b-8f6b-294091958571 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:57.094647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177a048-65c9-465b-8f6b-294091958571 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:57.094923 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177a048-65c9-465b-8f6b-294091958571 None admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:57.095627 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1177a048-65c9-465b-8f6b-294091958571 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:57.095937 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1177a048-65c9-465b-8f6b-294091958571 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:57.097416 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1177a048-65c9-465b-8f6b-294091958571 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:57.117856 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d1ff8-3894-405e-96dc-44b22c919047 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:57.127506 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 391/769] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Sep 26 17:42:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:57.133406 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177a048-65c9-465b-8f6b-294091958571 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:57.157455 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe715b-e890-4333-a41c-cd0af407cf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:57.158085 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe715b-e890-4333-a41c-cd0af407cf16 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:57.158357 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe715b-e890-4333-a41c-cd0af407cf16 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:57.158625 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe715b-e890-4333-a41c-cd0af407cf16 None admin] PATH_INFO: `/v3/services/network` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:57.159727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe715b-e890-4333-a41c-cd0af407cf16 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:57.161541 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe715b-e890-4333-a41c-cd0af407cf16 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:57.171293 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-73fe715b-e890-4333-a41c-cd0af407cf16 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 17:42:57.171293 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:57.171293 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 17:42:57.171293 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 17:42:57.171293 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 17:42:57.171293 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 17:42:57.171293 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 17:42:57.171293 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:42:57.171293 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 17:42:57.171293 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:57.171293 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 17:42:57.171293 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:57.171293 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:57.171293 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:57.171293 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:57.171293 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:57.171293 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:57.172337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:57.172337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:57.172337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:57.172337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:57.172337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:57.172337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:57.172337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 17:42:57.172337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 17:42:57.172337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 17:42:57.172337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 17:42:57.172337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:57.172337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:57.172337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:57.172337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:57.172337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:57.172337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:57.173212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:57.173212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:57.173212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:57.173212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:57.173212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:57.173212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:57.173212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:57.173212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:57.173212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:57.173212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:57.173212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 17:42:57.173212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:42:57.173212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 17:42:57.173212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:57.173212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 379/770] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:42:56 2022] GET /identity/v3/services/network => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:57.180635 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe715b-e890-4333-a41c-cd0af407cf16 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:57.278600 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:57.290419 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177a048-65c9-465b-8f6b-294091958571 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:57.332868 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570b469-d70c-4445-85db-cce3655d37ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:57.333579 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570b469-d70c-4445-85db-cce3655d37ab None admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:57.333856 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570b469-d70c-4445-85db-cce3655d37ab None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:57.334128 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570b469-d70c-4445-85db-cce3655d37ab None admin] PATH_INFO: `/v3/projects/125361b23eb14b53aca5e0139919881e/users/1792e79b9c9a47e1923f19bfd2cd495b/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:57.337555 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570b469-d70c-4445-85db-cce3655d37ab None admin] RBAC: Authorizing `identity:create_grant(project_id=125361b23eb14b53aca5e0139919881e, user_id=1792e79b9c9a47e1923f19bfd2cd495b, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:57.339210 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570b469-d70c-4445-85db-cce3655d37ab None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:57.349445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe715b-e890-4333-a41c-cd0af407cf16 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:57.356592 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 392/771] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Sep 26 17:42:57 2022] PUT /identity/v3/projects/125361b23eb14b53aca5e0139919881e/users/1792e79b9c9a47e1923f19bfd2cd495b/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:42:57.358125 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570b469-d70c-4445-85db-cce3655d37ab None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:57.378476 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:57.414658 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff080783-4a72-44da-a1fd-1ad666ad1df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:57.415546 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff080783-4a72-44da-a1fd-1ad666ad1df4 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:57.416975 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff080783-4a72-44da-a1fd-1ad666ad1df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:57.418697 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff080783-4a72-44da-a1fd-1ad666ad1df4 None admin] PATH_INFO: `/v3/services` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:57.419565 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff080783-4a72-44da-a1fd-1ad666ad1df4 None admin] RBAC: Adding query filter params (name=network) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:57.420995 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff080783-4a72-44da-a1fd-1ad666ad1df4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:57.424341 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff080783-4a72-44da-a1fd-1ad666ad1df4 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:57.439813 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 380/772] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Sep 26 17:42:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:42:57.446397 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff080783-4a72-44da-a1fd-1ad666ad1df4 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:57.561405 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570b469-d70c-4445-85db-cce3655d37ab None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:57.607398 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06584427-be7c-4965-bc4a-d244ab489581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:57.608027 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06584427-be7c-4965-bc4a-d244ab489581 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:57.608300 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06584427-be7c-4965-bc4a-d244ab489581 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:57.608563 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06584427-be7c-4965-bc4a-d244ab489581 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:57.609184 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06584427-be7c-4965-bc4a-d244ab489581 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:57.610557 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06584427-be7c-4965-bc4a-d244ab489581 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:57.621942 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-06584427-be7c-4965-bc4a-d244ab489581 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 17:42:57.621942 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:57.621942 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 17:42:57.621942 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 17:42:57.621942 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 17:42:57.621942 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 17:42:57.621942 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 17:42:57.621942 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:42:57.621942 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 17:42:57.621942 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:57.621942 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 17:42:57.621942 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:57.621942 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:57.621942 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:57.621942 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:57.621942 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:57.621942 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:57.622977 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:57.622977 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:57.622977 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:57.622977 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:57.622977 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:57.622977 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:57.622977 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 17:42:57.622977 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 17:42:57.622977 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 17:42:57.622977 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 17:42:57.622977 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:57.622977 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:57.622977 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:57.622977 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:57.622977 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:57.622977 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:57.623811 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:57.623811 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:57.623811 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:57.623811 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:57.623811 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:57.623811 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:57.623811 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:57.623811 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:57.623811 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:57.623811 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:57.623811 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 17:42:57.623811 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:42:57.623811 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 17:42:57.623811 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:57.624554 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 393/773] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Sep 26 17:42:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:57.631025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff080783-4a72-44da-a1fd-1ad666ad1df4 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:57.632216 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06584427-be7c-4965-bc4a-d244ab489581 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:57.642629 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:57.675399 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded80d08-eb4a-43ab-9d2f-816d506c86fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:57.676042 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded80d08-eb4a-43ab-9d2f-816d506c86fb None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:57.676317 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded80d08-eb4a-43ab-9d2f-816d506c86fb None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:57.676584 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded80d08-eb4a-43ab-9d2f-816d506c86fb None admin] PATH_INFO: `/v3/services` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:57.677241 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded80d08-eb4a-43ab-9d2f-816d506c86fb None admin] RBAC: Adding query filter params (type=network) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:57.677540 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded80d08-eb4a-43ab-9d2f-816d506c86fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:57.679432 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded80d08-eb4a-43ab-9d2f-816d506c86fb None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:57.686251 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 381/774] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Sep 26 17:42:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:42:57.687626 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bca5d-56fe-4252-b3ab-e80bab6047bd None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:57.687928 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bca5d-56fe-4252-b3ab-e80bab6047bd None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:57.688202 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bca5d-56fe-4252-b3ab-e80bab6047bd None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:57.694214 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 382/775] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:57.695410 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac5368-0da0-4536-a1bf-334d6b381e2a None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:57.695691 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac5368-0da0-4536-a1bf-334d6b381e2a None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:57.695961 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac5368-0da0-4536-a1bf-334d6b381e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:57.717170 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-a7ac5368-0da0-4536-a1bf-334d6b381e2a None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:57.718518 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-a7ac5368-0da0-4536-a1bf-334d6b381e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:57.732221 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:57.760109 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06584427-be7c-4965-bc4a-d244ab489581 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:57.797119 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 383/776] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:42:57.798027 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac5368-0da0-4536-a1bf-334d6b381e2a None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:57.810192 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6b829-c92e-42ec-b010-f564c6c5ef4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:57.810954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6b829-c92e-42ec-b010-f564c6c5ef4e None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:57.811240 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6b829-c92e-42ec-b010-f564c6c5ef4e None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:57.811564 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6b829-c92e-42ec-b010-f564c6c5ef4e None admin] PATH_INFO: `/v3/services` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:57.812164 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6b829-c92e-42ec-b010-f564c6c5ef4e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:57.812466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6b829-c92e-42ec-b010-f564c6c5ef4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:57.813880 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6b829-c92e-42ec-b010-f564c6c5ef4e None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:57.824435 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 394/777] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Sep 26 17:42:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:57.829121 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6b829-c92e-42ec-b010-f564c6c5ef4e None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:57.940716 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac5368-0da0-4536-a1bf-334d6b381e2a None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:57.942662 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:57.985717 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ce229-f71b-4b6a-9bc1-fa1f8acc96cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:57.986339 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ce229-f71b-4b6a-9bc1-fa1f8acc96cc None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:57.986624 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ce229-f71b-4b6a-9bc1-fa1f8acc96cc None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:57.986897 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ce229-f71b-4b6a-9bc1-fa1f8acc96cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:57.987877 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ce229-f71b-4b6a-9bc1-fa1f8acc96cc None admin] RBAC: Adding query filter params (interface=public, service_id=033e68b907d946c3ae92bff2901dbd53, region_id=RegionOne) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:57.988190 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ce229-f71b-4b6a-9bc1-fa1f8acc96cc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:57.989745 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ce229-f71b-4b6a-9bc1-fa1f8acc96cc None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:58.004275 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 384/778] 10.222.0.62 () {56 vars in 1251 bytes} [Mon Sep 26 17:42:57 2022] GET /identity/v3/endpoints?service_id=033e68b907d946c3ae92bff2901dbd53&interface=public®ion_id=RegionOne => generated 194 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:58.012846 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ce229-f71b-4b6a-9bc1-fa1f8acc96cc None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:58.016380 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6b829-c92e-42ec-b010-f564c6c5ef4e None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:58.082571 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59745b10-3a2c-4a85-a579-9a6a09e4e441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:58.083416 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59745b10-3a2c-4a85-a579-9a6a09e4e441 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:58.083845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59745b10-3a2c-4a85-a579-9a6a09e4e441 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:58.084314 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59745b10-3a2c-4a85-a579-9a6a09e4e441 None admin] PATH_INFO: `/v3/services` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:58.085214 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59745b10-3a2c-4a85-a579-9a6a09e4e441 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:58.085680 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59745b10-3a2c-4a85-a579-9a6a09e4e441 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:58.087183 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59745b10-3a2c-4a85-a579-9a6a09e4e441 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:58.095643 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 395/779] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Sep 26 17:42:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:58.096795 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59745b10-3a2c-4a85-a579-9a6a09e4e441 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:58.118333 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:58.170117 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ce229-f71b-4b6a-9bc1-fa1f8acc96cc None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:58.206760 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59745b10-3a2c-4a85-a579-9a6a09e4e441 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:58.206954 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0349c4-a55a-4208-8d43-722dcba39ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:58.207513 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0349c4-a55a-4208-8d43-722dcba39ac2 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:58.207795 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0349c4-a55a-4208-8d43-722dcba39ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:58.208070 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0349c4-a55a-4208-8d43-722dcba39ac2 None admin] PATH_INFO: `/v3/services` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:58.208677 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0349c4-a55a-4208-8d43-722dcba39ac2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:58.210305 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0349c4-a55a-4208-8d43-722dcba39ac2 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:58.221227 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 385/780] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Sep 26 17:42:58 2022] GET /identity/v3/services => generated 772 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:58.222977 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0349c4-a55a-4208-8d43-722dcba39ac2 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:58.244240 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab30ea8-6571-4352-9e76-22e8ab934c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:58.245290 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab30ea8-6571-4352-9e76-22e8ab934c5a None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:58.245750 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab30ea8-6571-4352-9e76-22e8ab934c5a None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:58.246245 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab30ea8-6571-4352-9e76-22e8ab934c5a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:58.258775 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab30ea8-6571-4352-9e76-22e8ab934c5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:42:58.264652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-5ab30ea8-6571-4352-9e76-22e8ab934c5a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:42:58.264652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:58.264652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:58.264652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:58.264652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:58.264652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:58.264652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:58.264652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:58.264652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:58.264652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:58.264652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:58.264652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:58.264652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:42:58.264652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:42:58.264652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:42:58.264652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:42:58.265596 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:42:58.265596 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:42:58.265596 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:42:58.265596 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:42:58.265596 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:58.265596 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:58.265596 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:58.265596 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:58.265596 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:58.265596 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:58.265596 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:58.265596 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:58.265596 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:58.265596 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:58.265596 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:58.265596 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:58.266466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:58.266466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:58.266466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:58.266466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:58.266466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:42:58.266466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:42:58.266466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:42:58.266466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:42:58.266466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:42:58.266466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:42:58.266466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:42:58.266466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:58.268774 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 396/781] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Sep 26 17:42:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:58.274926 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab30ea8-6571-4352-9e76-22e8ab934c5a None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:58.280605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:58.349035 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:58.390749 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab30ea8-6571-4352-9e76-22e8ab934c5a None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:58.433089 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a2560-d2bf-4c98-b4e1-69df50018bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:58.434070 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a2560-d2bf-4c98-b4e1-69df50018bf4 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:58.434498 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a2560-d2bf-4c98-b4e1-69df50018bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:58.434948 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a2560-d2bf-4c98-b4e1-69df50018bf4 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:58.435772 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a2560-d2bf-4c98-b4e1-69df50018bf4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:58.436227 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a2560-d2bf-4c98-b4e1-69df50018bf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:58.438118 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a2560-d2bf-4c98-b4e1-69df50018bf4 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:58.448262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0349c4-a55a-4208-8d43-722dcba39ac2 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:58.448551 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 397/782] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Sep 26 17:42:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:42:58.454877 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a2560-d2bf-4c98-b4e1-69df50018bf4 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:58.514364 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a809a-5e17-40fd-a3e8-b693502704a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:58.515742 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a809a-5e17-40fd-a3e8-b693502704a3 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:58.515742 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a809a-5e17-40fd-a3e8-b693502704a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:58.515742 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a809a-5e17-40fd-a3e8-b693502704a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:58.516498 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a809a-5e17-40fd-a3e8-b693502704a3 None admin] RBAC: Adding query filter params (interface=public, service_id=c2a89a1ed2d14bdb9bf27117208e5d35, region_id=RegionOne) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:58.516863 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a809a-5e17-40fd-a3e8-b693502704a3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:58.519066 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a809a-5e17-40fd-a3e8-b693502704a3 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:58.526416 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 386/783] 10.222.0.62 () {56 vars in 1251 bytes} [Mon Sep 26 17:42:58 2022] GET /identity/v3/endpoints?service_id=c2a89a1ed2d14bdb9bf27117208e5d35&interface=public®ion_id=RegionOne => generated 194 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:58.532677 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a809a-5e17-40fd-a3e8-b693502704a3 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:58.584172 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a2560-d2bf-4c98-b4e1-69df50018bf4 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:58.614941 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:58.624108 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbe017-eb76-4bd4-805a-1b695dcb72d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:58.624953 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbe017-eb76-4bd4-805a-1b695dcb72d7 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:58.625472 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbe017-eb76-4bd4-805a-1b695dcb72d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:58.625899 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbe017-eb76-4bd4-805a-1b695dcb72d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:58.676496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:58.693392 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a809a-5e17-40fd-a3e8-b693502704a3 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:58.756694 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cbe017-eb76-4bd4-805a-1b695dcb72d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:58.758569 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cbe017-eb76-4bd4-805a-1b695dcb72d7 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:58.774432 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-26cbe017-eb76-4bd4-805a-1b695dcb72d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:58.774432 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:58.774432 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:58.774432 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:58.774432 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:58.774432 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:58.774432 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:58.774432 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:58.774432 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:58.774432 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:58.774432 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:58.774432 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:58.774432 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:58.774432 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:58.774432 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:58.774432 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:58.775394 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:58.775394 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:58.775394 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:58.775394 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:58.775394 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:58.775394 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:58.775394 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:58.775394 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:58.775394 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:58.775394 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:58.775394 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:58.775394 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:58.775394 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:58.775394 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:58.775394 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:58.775394 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:58.775394 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:58.776281 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:58.776281 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:58.776281 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:58.778732 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 398/784] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:42:58.784461 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbe017-eb76-4bd4-805a-1b695dcb72d7 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:58.793716 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b291235-6008-4890-84c5-64dd4d781f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:58.794360 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b291235-6008-4890-84c5-64dd4d781f47 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:58.794645 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b291235-6008-4890-84c5-64dd4d781f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:58.794919 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b291235-6008-4890-84c5-64dd4d781f47 None admin] PATH_INFO: `/v3/services` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:58.795532 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b291235-6008-4890-84c5-64dd4d781f47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:58.796927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b291235-6008-4890-84c5-64dd4d781f47 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:58.811912 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 387/785] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Sep 26 17:42:58 2022] GET /identity/v3/services => generated 772 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:58.956385 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbe017-eb76-4bd4-805a-1b695dcb72d7 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:58.998658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d16a6-8f25-4b24-ab3b-852c66c89db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:58.999677 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d16a6-8f25-4b24-ab3b-852c66c89db8 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:59.000156 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d16a6-8f25-4b24-ab3b-852c66c89db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:59.000624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d16a6-8f25-4b24-ab3b-852c66c89db8 None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:59.001555 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d16a6-8f25-4b24-ab3b-852c66c89db8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:59.002062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d16a6-8f25-4b24-ab3b-852c66c89db8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:59.003687 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d16a6-8f25-4b24-ab3b-852c66c89db8 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:59.020439 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 399/786] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:42:59.026795 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b291235-6008-4890-84c5-64dd4d781f47 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:59.038634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa45a0-ee3e-4cc3-b802-c2fedc03ea14 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:59.039251 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa45a0-ee3e-4cc3-b802-c2fedc03ea14 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:59.039741 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa45a0-ee3e-4cc3-b802-c2fedc03ea14 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:59.041620 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 400/787] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:42:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:42:59.057238 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971e80c-a26a-40ba-b71d-d1624f95626e None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:59.057857 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971e80c-a26a-40ba-b71d-d1624f95626e None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:59.058357 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971e80c-a26a-40ba-b71d-d1624f95626e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:59.090123 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-1971e80c-a26a-40ba-b71d-d1624f95626e None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:42:59.091891 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-1971e80c-a26a-40ba-b71d-d1624f95626e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:42:59.163526 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b291235-6008-4890-84c5-64dd4d781f47 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:59.168097 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:59.206800 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 401/788] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:42:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 17:42:59.218334 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8139fd-bb52-45ce-aee1-a2fda9598972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:59.218993 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8139fd-bb52-45ce-aee1-a2fda9598972 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:59.219273 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8139fd-bb52-45ce-aee1-a2fda9598972 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:59.219543 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8139fd-bb52-45ce-aee1-a2fda9598972 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:59.237599 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8139fd-bb52-45ce-aee1-a2fda9598972 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:59.239090 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8139fd-bb52-45ce-aee1-a2fda9598972 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:59.259156 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-de8139fd-bb52-45ce-aee1-a2fda9598972 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 17:42:59.259156 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:59.259156 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:59.259156 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:59.259156 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:59.259156 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:59.259156 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:59.259156 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:59.259156 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:59.259156 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:59.259156 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:59.259156 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:59.259156 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 17:42:59.259156 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 17:42:59.259156 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 17:42:59.259156 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 17:42:59.260180 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:59.260180 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:59.260180 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 17:42:59.260180 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:42:59.260180 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 17:42:59.260180 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:42:59.260180 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:59.260180 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:59.260180 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:59.260180 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:59.260180 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:59.260180 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:59.260180 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:59.260180 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:59.260180 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:59.260180 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:59.260180 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:59.260180 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:59.261179 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:59.261179 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:59.261179 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 17:42:59.261179 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 17:42:59.261179 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 17:42:59.261179 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 17:42:59.261179 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 17:42:59.261179 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 17:42:59.261179 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 17:42:59.261179 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:59.261179 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 388/789] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Sep 26 17:42:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:59.266004 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971e80c-a26a-40ba-b71d-d1624f95626e None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:59.385348 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971e80c-a26a-40ba-b71d-d1624f95626e None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:59.426862 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d379e89-72e9-43f5-bbb1-0d7b25debeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:59.427793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d379e89-72e9-43f5-bbb1-0d7b25debeae None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:59.428321 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d379e89-72e9-43f5-bbb1-0d7b25debeae None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:59.428780 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d379e89-72e9-43f5-bbb1-0d7b25debeae None admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:59.429823 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d379e89-72e9-43f5-bbb1-0d7b25debeae None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:42:59.430330 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d379e89-72e9-43f5-bbb1-0d7b25debeae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:59.431931 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d379e89-72e9-43f5-bbb1-0d7b25debeae None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:59.451349 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 402/790] 10.222.0.62 () {56 vars in 1149 bytes} [Mon Sep 26 17:42:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:42:59.456660 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8139fd-bb52-45ce-aee1-a2fda9598972 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:59.517739 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:59.555236 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d379e89-72e9-43f5-bbb1-0d7b25debeae None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:59.588260 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:59.673039 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d379e89-72e9-43f5-bbb1-0d7b25debeae None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:59.713547 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977190ab-35e9-48d6-a73f-293716d3bc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:59.714179 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977190ab-35e9-48d6-a73f-293716d3bc23 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:59.714452 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977190ab-35e9-48d6-a73f-293716d3bc23 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:59.714716 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977190ab-35e9-48d6-a73f-293716d3bc23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:59.717307 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8139fd-bb52-45ce-aee1-a2fda9598972 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:59.727917 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977190ab-35e9-48d6-a73f-293716d3bc23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:42:59.732825 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-977190ab-35e9-48d6-a73f-293716d3bc23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:42:59.732825 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:59.732825 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:59.732825 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:59.732825 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:59.732825 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:59.732825 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:59.732825 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:59.732825 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:59.732825 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:59.732825 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:59.732825 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:59.732825 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:42:59.732825 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:42:59.732825 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:42:59.732825 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:42:59.733781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:42:59.733781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:42:59.733781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:42:59.733781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:42:59.733781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:59.733781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:59.733781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:59.733781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:59.733781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:59.733781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:59.733781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:59.733781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:59.733781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:59.733781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:59.733781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:59.733781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:59.734646 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:59.734646 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:59.734646 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:59.734646 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:59.734646 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:42:59.734646 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:42:59.734646 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:42:59.734646 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:42:59.734646 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:42:59.734646 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:42:59.734646 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:42:59.734646 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:42:59.739403 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 403/791] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Sep 26 17:42:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:42:59.741650 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977190ab-35e9-48d6-a73f-293716d3bc23 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:59.793437 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2a648-cfa6-43c4-be8f-4b60f75d4b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:42:59.793997 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2a648-cfa6-43c4-be8f-4b60f75d4b7c None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:42:59.794268 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2a648-cfa6-43c4-be8f-4b60f75d4b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:42:59.794717 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2a648-cfa6-43c4-be8f-4b60f75d4b7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:42:59.824091 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2a648-cfa6-43c4-be8f-4b60f75d4b7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:42:59.826524 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2a648-cfa6-43c4-be8f-4b60f75d4b7c None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:42:59.853043 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-cfb2a648-cfa6-43c4-be8f-4b60f75d4b7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:59.853043 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:42:59.853043 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:42:59.853043 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:42:59.853043 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:42:59.853043 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:42:59.853043 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:42:59.853043 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:42:59.853043 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:42:59.853043 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:42:59.853043 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:42:59.853043 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:42:59.853043 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:42:59.853043 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:42:59.853043 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:42:59.853043 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:42:59.854055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:42:59.854055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:42:59.854055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:42:59.854055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:42:59.854055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:42:59.854055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:42:59.854055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:42:59.854055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:42:59.854055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:42:59.854055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:42:59.854055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:42:59.854055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:42:59.854055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:42:59.854055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:42:59.854055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:42:59.854055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:42:59.854055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:42:59.854943 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:42:59.854943 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:42:59.854943 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:42:59.854943 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 389/792] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:42:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:42:59.855600 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2a648-cfa6-43c4-be8f-4b60f75d4b7c None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:42:59.927070 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:42:59.959204 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977190ab-35e9-48d6-a73f-293716d3bc23 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:42:59.967361 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:00.003256 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2a648-cfa6-43c4-be8f-4b60f75d4b7c None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:00.012336 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c81688-fba5-4d05-be87-8ff906fbcbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:00.012962 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c81688-fba5-4d05-be87-8ff906fbcbb3 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:00.013263 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c81688-fba5-4d05-be87-8ff906fbcbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:00.013532 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c81688-fba5-4d05-be87-8ff906fbcbb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:00.014209 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c81688-fba5-4d05-be87-8ff906fbcbb3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:00.014508 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c81688-fba5-4d05-be87-8ff906fbcbb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:00.016599 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c81688-fba5-4d05-be87-8ff906fbcbb3 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:00.029195 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 404/793] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:42:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:00.031458 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b573b64-b002-401e-876f-b77f4a92533c None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:00.031953 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b573b64-b002-401e-876f-b77f4a92533c None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:00.032426 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b573b64-b002-401e-876f-b77f4a92533c None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:00.035186 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 405/794] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:43:00.039148 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b573b64-b002-401e-876f-b77f4a92533c None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:00.055954 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2bcd95-87c3-4266-a729-b13246cab193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:00.056927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bcd95-87c3-4266-a729-b13246cab193 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:00.057429 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bcd95-87c3-4266-a729-b13246cab193 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:00.057849 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bcd95-87c3-4266-a729-b13246cab193 None admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:00.058644 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2bcd95-87c3-4266-a729-b13246cab193 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:00.059130 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2bcd95-87c3-4266-a729-b13246cab193 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:00.060655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2bcd95-87c3-4266-a729-b13246cab193 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:00.077079 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 390/795] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:00.078267 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a74c8-bcfa-4137-807f-fe407861e3fd None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:00.078550 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a74c8-bcfa-4137-807f-fe407861e3fd None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:00.078821 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a74c8-bcfa-4137-807f-fe407861e3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:00.097263 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-c29a74c8-bcfa-4137-807f-fe407861e3fd None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:00.098479 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-c29a74c8-bcfa-4137-807f-fe407861e3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:00.174255 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 391/796] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:43:00.174255 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a74c8-bcfa-4137-807f-fe407861e3fd None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:00.176236 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b573b64-b002-401e-876f-b77f4a92533c None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:00.223061 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf037f32-2f61-4b58-9376-4ed3c9a85080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:00.224045 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf037f32-2f61-4b58-9376-4ed3c9a85080 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:00.224578 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf037f32-2f61-4b58-9376-4ed3c9a85080 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:00.225969 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf037f32-2f61-4b58-9376-4ed3c9a85080 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:00.250875 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf037f32-2f61-4b58-9376-4ed3c9a85080 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:00.254501 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf037f32-2f61-4b58-9376-4ed3c9a85080 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:00.283855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-cf037f32-2f61-4b58-9376-4ed3c9a85080 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:00.283855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:00.283855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:00.283855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:00.283855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:00.283855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:00.283855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:00.283855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:00.283855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:00.283855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:00.283855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:00.283855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:00.283855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:43:00.283855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:43:00.283855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:43:00.283855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:43:00.284855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:00.284855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:00.284855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:00.284855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:00.284855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:00.284855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:00.284855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:00.284855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:00.284855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:00.284855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:00.284855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:00.284855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:00.284855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:00.284855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:00.284855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:00.284855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:00.284855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:43:00.285795 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:43:00.285795 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:00.285795 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:00.290539 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 406/797] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:43:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:00.296204 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:00.297086 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf037f32-2f61-4b58-9376-4ed3c9a85080 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:00.301059 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:00.395017 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a74c8-bcfa-4137-807f-fe407861e3fd None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:00.410345 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf037f32-2f61-4b58-9376-4ed3c9a85080 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:00.446162 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd78e5-dcc6-46d3-99a3-36043672d042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:00.446761 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd78e5-dcc6-46d3-99a3-36043672d042 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:00.447044 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd78e5-dcc6-46d3-99a3-36043672d042 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:00.447320 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd78e5-dcc6-46d3-99a3-36043672d042 None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:00.448036 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd78e5-dcc6-46d3-99a3-36043672d042 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:00.448401 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd78e5-dcc6-46d3-99a3-36043672d042 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:00.449811 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd78e5-dcc6-46d3-99a3-36043672d042 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:00.464439 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 407/798] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:00.469755 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd78e5-dcc6-46d3-99a3-36043672d042 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:00.480368 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c246d9c-108b-4044-ba0c-4ee3f12f6979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:00.481072 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c246d9c-108b-4044-ba0c-4ee3f12f6979 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:00.481356 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c246d9c-108b-4044-ba0c-4ee3f12f6979 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:00.481628 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c246d9c-108b-4044-ba0c-4ee3f12f6979 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:00.496793 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c246d9c-108b-4044-ba0c-4ee3f12f6979 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:00.498312 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c246d9c-108b-4044-ba0c-4ee3f12f6979 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:00.514963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-9c246d9c-108b-4044-ba0c-4ee3f12f6979 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:43:00.514963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:00.514963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:00.514963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:00.514963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:00.514963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:00.514963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:00.514963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:00.514963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:00.514963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:00.514963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:00.514963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:00.514963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 17:43:00.514963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 17:43:00.514963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 17:43:00.515872 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 17:43:00.515872 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:00.515872 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:00.515872 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:00.515872 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:00.515872 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:00.515872 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:00.515872 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:00.515872 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:00.515872 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:00.515872 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:00.515872 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:00.515872 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:00.515872 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:00.515872 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:00.515872 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:00.515872 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:00.516760 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 17:43:00.516760 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 17:43:00.516760 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 17:43:00.516760 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 17:43:00.516760 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 17:43:00.516760 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 17:43:00.516760 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:43:00.516760 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:00.523289 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 392/799] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:43:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:00.523289 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c246d9c-108b-4044-ba0c-4ee3f12f6979 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:00.557462 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:00.602855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd78e5-dcc6-46d3-99a3-36043672d042 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:00.643020 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708644f-4cad-414d-bb2f-a14cbbe7b037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:00.643627 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708644f-4cad-414d-bb2f-a14cbbe7b037 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:00.643912 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708644f-4cad-414d-bb2f-a14cbbe7b037 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:00.644230 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708644f-4cad-414d-bb2f-a14cbbe7b037 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:00.653210 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1708644f-4cad-414d-bb2f-a14cbbe7b037 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:00.655218 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1708644f-4cad-414d-bb2f-a14cbbe7b037 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:00.663610 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c246d9c-108b-4044-ba0c-4ee3f12f6979 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:00.669187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-1708644f-4cad-414d-bb2f-a14cbbe7b037 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 26 17:43:00.669187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:00.669187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:00.669187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:00.669187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:00.669187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:00.669187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:00.669187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:00.669187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:00.669187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:00.669187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:00.669187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:00.669187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 17:43:00.669187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 17:43:00.669187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 17:43:00.669187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 17:43:00.670134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:00.670134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:00.670134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 17:43:00.670134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:43:00.670134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 17:43:00.670134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:43:00.670134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:00.670134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:00.670134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:00.670134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:00.670134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:00.670134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:00.670134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:00.670134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:00.670134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:00.670134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:00.670134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:00.670134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:00.671083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:00.671083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:00.671083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 17:43:00.671083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 17:43:00.671083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 17:43:00.671083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 17:43:00.671083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 17:43:00.671083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 17:43:00.671083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 26 17:43:00.671083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:00.675493 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 408/800] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Sep 26 17:43:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:00.676366 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708644f-4cad-414d-bb2f-a14cbbe7b037 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:00.691909 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:00.713123 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f8bff-a52a-4177-a08c-c5bd27cc5fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:00.714102 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f8bff-a52a-4177-a08c-c5bd27cc5fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:00.714535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f8bff-a52a-4177-a08c-c5bd27cc5fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:00.714956 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f8bff-a52a-4177-a08c-c5bd27cc5fc7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:00.733999 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f8bff-a52a-4177-a08c-c5bd27cc5fc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:43:00.741758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-9a8f8bff-a52a-4177-a08c-c5bd27cc5fc7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:43:00.741758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:00.741758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:00.741758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:00.741758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:00.741758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:00.741758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:00.741758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:00.741758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:00.741758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:00.741758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:00.741758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:00.741758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:43:00.741758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:43:00.741758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:43:00.741758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:43:00.742727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:43:00.742727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:43:00.742727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:43:00.742727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:43:00.742727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:00.742727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:00.742727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:00.742727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:00.742727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:00.742727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:00.742727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:00.742727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:00.742727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:00.742727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:00.742727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:00.742727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:00.743567 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:00.743567 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:00.743567 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:00.743567 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:00.743567 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:43:00.743567 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:43:00.743567 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:43:00.743567 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:43:00.743567 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:43:00.743567 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:43:00.743567 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:43:00.743567 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:00.751073 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 393/801] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Sep 26 17:43:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:00.751073 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f8bff-a52a-4177-a08c-c5bd27cc5fc7 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:00.807832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708644f-4cad-414d-bb2f-a14cbbe7b037 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:00.837147 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:00.852539 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16059087-a88d-4bee-b751-980109e5833f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:00.853592 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16059087-a88d-4bee-b751-980109e5833f None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:00.854082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16059087-a88d-4bee-b751-980109e5833f None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:00.854591 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16059087-a88d-4bee-b751-980109e5833f None admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:00.855491 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16059087-a88d-4bee-b751-980109e5833f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:00.856577 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16059087-a88d-4bee-b751-980109e5833f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:00.858562 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16059087-a88d-4bee-b751-980109e5833f None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:00.878787 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f8bff-a52a-4177-a08c-c5bd27cc5fc7 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:00.879010 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 409/802] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Sep 26 17:43:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:00.879010 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16059087-a88d-4bee-b751-980109e5833f None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:00.923069 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d0739-95d5-407e-8588-2753a609fecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:00.923816 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d0739-95d5-407e-8588-2753a609fecb None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:00.924119 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d0739-95d5-407e-8588-2753a609fecb None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:00.924473 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d0739-95d5-407e-8588-2753a609fecb None admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:00.925815 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d0739-95d5-407e-8588-2753a609fecb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:00.926135 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d0739-95d5-407e-8588-2753a609fecb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:00.927940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d0739-95d5-407e-8588-2753a609fecb None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:00.956149 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 394/803] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Sep 26 17:43:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:00.958223 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d0739-95d5-407e-8588-2753a609fecb None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:01.009197 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16059087-a88d-4bee-b751-980109e5833f None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:01.014324 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:01.043810 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d0f92-a18e-4775-b846-287dbff93d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:01.044476 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d0f92-a18e-4775-b846-287dbff93d10 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:01.044686 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d0f92-a18e-4775-b846-287dbff93d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:01.044952 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d0f92-a18e-4775-b846-287dbff93d10 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:01.045645 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98d0f92-a18e-4775-b846-287dbff93d10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:01.045941 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98d0f92-a18e-4775-b846-287dbff93d10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:01.047279 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98d0f92-a18e-4775-b846-287dbff93d10 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:01.061538 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 410/804] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:43:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:01.061538 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d0f92-a18e-4775-b846-287dbff93d10 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:01.090517 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d0739-95d5-407e-8588-2753a609fecb None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:01.107298 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:01.127415 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92080862-ff82-43c5-8845-36668a78de6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:01.128372 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92080862-ff82-43c5-8845-36668a78de6b None admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:01.128659 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92080862-ff82-43c5-8845-36668a78de6b None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:01.128938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92080862-ff82-43c5-8845-36668a78de6b None admin] PATH_INFO: `/v3/projects/125361b23eb14b53aca5e0139919881e/users/8475122232ef4d8893f2a9b98768396e/roles/4685fd1f2f284d4498281231160a5f27` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:01.144682 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92080862-ff82-43c5-8845-36668a78de6b None admin] RBAC: Authorizing `identity:create_grant(project_id=125361b23eb14b53aca5e0139919881e, user_id=8475122232ef4d8893f2a9b98768396e, role_id=4685fd1f2f284d4498281231160a5f27)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:01.146180 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92080862-ff82-43c5-8845-36668a78de6b None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:01.160889 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 395/805] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Sep 26 17:43:00 2022] PUT /identity/v3/projects/125361b23eb14b53aca5e0139919881e/users/8475122232ef4d8893f2a9b98768396e/roles/4685fd1f2f284d4498281231160a5f27 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:43:01.166715 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807b6e5-7d59-472e-9101-815430b71285 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:01.167366 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807b6e5-7d59-472e-9101-815430b71285 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:01.167873 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807b6e5-7d59-472e-9101-815430b71285 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:01.176008 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 396/806] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:01 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:43:01.177712 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807b6e5-7d59-472e-9101-815430b71285 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:01.182979 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d0f92-a18e-4775-b846-287dbff93d10 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:01.228627 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9699ff-77a6-439e-93e0-3c6999c9ff30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:01.229340 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9699ff-77a6-439e-93e0-3c6999c9ff30 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:01.229622 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9699ff-77a6-439e-93e0-3c6999c9ff30 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:01.229897 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9699ff-77a6-439e-93e0-3c6999c9ff30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:01.245634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9699ff-77a6-439e-93e0-3c6999c9ff30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:01.247280 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9699ff-77a6-439e-93e0-3c6999c9ff30 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:01.265178 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-2c9699ff-77a6-439e-93e0-3c6999c9ff30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:01.265178 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:01.265178 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:01.265178 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:01.265178 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:01.265178 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:01.265178 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:01.265178 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:01.265178 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:01.265178 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:01.265178 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:01.265178 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:01.265178 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:43:01.265178 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:43:01.265178 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:43:01.265178 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:43:01.266201 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:01.266201 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:01.266201 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:01.266201 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:01.266201 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:01.266201 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:01.266201 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:01.266201 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:01.266201 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:01.266201 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:01.266201 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:01.266201 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:01.266201 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:01.266201 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:01.266201 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:01.266201 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:01.266201 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:43:01.267079 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:43:01.267079 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:01.267079 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:01.271317 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 411/807] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:43:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:01.272816 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26289916-49fd-42c9-b3a6-13aea9fd4136 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:01.273132 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26289916-49fd-42c9-b3a6-13aea9fd4136 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:01.273411 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26289916-49fd-42c9-b3a6-13aea9fd4136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:01.292961 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-26289916-49fd-42c9-b3a6-13aea9fd4136 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:01.294275 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-26289916-49fd-42c9-b3a6-13aea9fd4136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:01.314849 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:01.336147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807b6e5-7d59-472e-9101-815430b71285 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:01.376452 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b954f1-4644-4339-b29e-a15fa95ff30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:01.377650 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b954f1-4644-4339-b29e-a15fa95ff30e None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:01.377650 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b954f1-4644-4339-b29e-a15fa95ff30e None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:01.377650 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b954f1-4644-4339-b29e-a15fa95ff30e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:01.379917 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 412/808] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:43:01.379917 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26289916-49fd-42c9-b3a6-13aea9fd4136 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:01.397491 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b954f1-4644-4339-b29e-a15fa95ff30e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:01.398958 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b954f1-4644-4339-b29e-a15fa95ff30e None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:01.415740 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-72b954f1-4644-4339-b29e-a15fa95ff30e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:01.415740 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:01.415740 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:01.415740 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:01.415740 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:01.415740 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:01.415740 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:01.415740 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:01.415740 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:01.415740 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:01.415740 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:01.415740 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:01.415740 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:43:01.415740 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:43:01.415740 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:43:01.415740 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:43:01.416837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:01.416837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:01.416837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:01.416837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:01.416837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:01.416837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:01.416837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:01.416837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:01.416837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:01.416837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:01.416837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:01.416837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:01.416837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:01.416837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:01.416837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:01.416837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:01.416837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:43:01.418368 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:43:01.418368 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:01.418368 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:01.418368 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 397/809] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:43:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:01.418605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef676787-31c7-4e47-8e98-43629534053d None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:01.418839 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef676787-31c7-4e47-8e98-43629534053d None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:01.419048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef676787-31c7-4e47-8e98-43629534053d None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:01.420565 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 398/810] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:43:01.423134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:01.426079 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef676787-31c7-4e47-8e98-43629534053d None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:01.511390 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26289916-49fd-42c9-b3a6-13aea9fd4136 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:01.555621 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27225b-23d5-4009-a9ec-11d9e93d3291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:01.557299 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27225b-23d5-4009-a9ec-11d9e93d3291 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:01.557794 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27225b-23d5-4009-a9ec-11d9e93d3291 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:01.558540 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27225b-23d5-4009-a9ec-11d9e93d3291 None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:01.559804 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd27225b-23d5-4009-a9ec-11d9e93d3291 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:01.560562 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd27225b-23d5-4009-a9ec-11d9e93d3291 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:01.562166 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd27225b-23d5-4009-a9ec-11d9e93d3291 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:01.563089 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef676787-31c7-4e47-8e98-43629534053d None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:01.583704 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 413/811] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:01.583704 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cab7e-ff37-46b2-8b8b-2ded15ffff94 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:01.583704 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cab7e-ff37-46b2-8b8b-2ded15ffff94 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:01.583704 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cab7e-ff37-46b2-8b8b-2ded15ffff94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:01.606584 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb3643-aa21-40d3-8204-7b1b5127ee93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:01.607331 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb3643-aa21-40d3-8204-7b1b5127ee93 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:01.607514 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb3643-aa21-40d3-8204-7b1b5127ee93 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:01.607833 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb3643-aa21-40d3-8204-7b1b5127ee93 None admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:01.608474 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb3643-aa21-40d3-8204-7b1b5127ee93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:01.608775 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb3643-aa21-40d3-8204-7b1b5127ee93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:01.610288 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb3643-aa21-40d3-8204-7b1b5127ee93 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:01.613430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-651cab7e-ff37-46b2-8b8b-2ded15ffff94 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:01.614864 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-651cab7e-ff37-46b2-8b8b-2ded15ffff94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:01.620195 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:01.633569 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 399/812] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:01.634069 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb3643-aa21-40d3-8204-7b1b5127ee93 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:01.695131 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 414/813] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:43:01.695894 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651cab7e-ff37-46b2-8b8b-2ded15ffff94 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:01.723839 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:01.761244 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb3643-aa21-40d3-8204-7b1b5127ee93 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:01.797587 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1296f6-e96b-487a-9e53-78efdfd5de24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:01.798619 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1296f6-e96b-487a-9e53-78efdfd5de24 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:01.799103 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1296f6-e96b-487a-9e53-78efdfd5de24 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:01.799588 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1296f6-e96b-487a-9e53-78efdfd5de24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:01.806945 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1296f6-e96b-487a-9e53-78efdfd5de24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:01.808655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1296f6-e96b-487a-9e53-78efdfd5de24 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:01.821337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-2b1296f6-e96b-487a-9e53-78efdfd5de24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:43:01.821337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:01.821337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:01.821337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:01.821337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:01.821337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:01.821337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:01.821337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:01.821337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:01.821337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:01.821337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:01.821337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:01.821337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 17:43:01.821337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 17:43:01.821337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 17:43:01.822285 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 17:43:01.822285 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:01.822285 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:01.822285 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:01.822285 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:01.822285 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:01.822285 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:01.822285 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:01.822285 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:01.822285 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:01.822285 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:01.822285 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:01.822285 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:01.822285 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:01.822285 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:01.822285 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:01.822285 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:01.823217 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 17:43:01.823217 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 17:43:01.823217 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 17:43:01.823217 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 17:43:01.823217 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 17:43:01.823217 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 17:43:01.823217 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:43:01.823217 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:01.824100 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651cab7e-ff37-46b2-8b8b-2ded15ffff94 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:01.829140 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 400/814] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:43:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:01.830266 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1296f6-e96b-487a-9e53-78efdfd5de24 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:01.872497 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71384b4b-e148-401d-92d2-65d0bfa353b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:01.873162 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71384b4b-e148-401d-92d2-65d0bfa353b9 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:01.873444 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71384b4b-e148-401d-92d2-65d0bfa353b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:01.873716 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71384b4b-e148-401d-92d2-65d0bfa353b9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:01.883236 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71384b4b-e148-401d-92d2-65d0bfa353b9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:01.885427 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71384b4b-e148-401d-92d2-65d0bfa353b9 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:01.898778 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:01.903713 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-71384b4b-e148-401d-92d2-65d0bfa353b9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 17:43:01.903713 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:01.903713 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:01.903713 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:01.903713 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:01.903713 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:01.903713 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:01.903713 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:01.903713 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:01.903713 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:01.903713 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:01.903713 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:01.903713 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 17:43:01.903713 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 17:43:01.903713 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 17:43:01.903713 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 17:43:01.904676 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:01.904676 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:01.904676 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 17:43:01.904676 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:43:01.904676 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 17:43:01.904676 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:43:01.904676 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:01.904676 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:01.904676 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:01.904676 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:01.904676 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:01.904676 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:01.904676 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:01.904676 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:01.904676 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:01.904676 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:01.904676 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:01.904676 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:01.910441 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:01.910441 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:01.910441 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 17:43:01.910441 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 17:43:01.910441 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 17:43:01.910441 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 17:43:01.910441 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 17:43:01.910441 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 17:43:01.910441 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 17:43:01.910441 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:01.910441 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 415/815] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Sep 26 17:43:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:01.910441 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71384b4b-e148-401d-92d2-65d0bfa353b9 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:01.957955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1296f6-e96b-487a-9e53-78efdfd5de24 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:02.001326 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d02062-fc53-4d53-b48b-a647efc741f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:02.002874 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d02062-fc53-4d53-b48b-a647efc741f3 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:02.003405 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d02062-fc53-4d53-b48b-a647efc741f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:02.004329 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:02.005126 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d02062-fc53-4d53-b48b-a647efc741f3 None admin] PATH_INFO: `/v3/services/network` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:02.007202 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d02062-fc53-4d53-b48b-a647efc741f3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:02.009248 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d02062-fc53-4d53-b48b-a647efc741f3 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:02.021430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-e9d02062-fc53-4d53-b48b-a647efc741f3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 17:43:02.021430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:02.021430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 17:43:02.021430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 17:43:02.021430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 17:43:02.021430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 17:43:02.021430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 17:43:02.021430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:43:02.021430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 17:43:02.021430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:02.021430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 17:43:02.021430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:02.021430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:02.021430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:02.021430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:02.021430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:02.021430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:02.022651 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:02.022651 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:02.022651 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:02.022651 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:02.022651 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:02.022651 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:02.022651 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 17:43:02.022651 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 17:43:02.022651 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 17:43:02.022651 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 17:43:02.022651 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:02.022651 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:02.022651 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:02.022651 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:02.022651 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:02.022651 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:02.023673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:02.023673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:02.023673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:02.023673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:02.023673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:02.023673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:02.023673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:02.023673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:02.023673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:02.023673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:02.023673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 17:43:02.023673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:43:02.023673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 17:43:02.023673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:02.025888 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 401/816] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:43:01 2022] GET /identity/v3/services/network => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:02.026976 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d02062-fc53-4d53-b48b-a647efc741f3 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:02.032272 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71384b4b-e148-401d-92d2-65d0bfa353b9 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:02.067990 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed95a6d-1c6c-4a18-808c-7023b30c1f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:02.069234 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed95a6d-1c6c-4a18-808c-7023b30c1f69 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:02.069544 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed95a6d-1c6c-4a18-808c-7023b30c1f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:02.069821 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed95a6d-1c6c-4a18-808c-7023b30c1f69 None admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:02.070538 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed95a6d-1c6c-4a18-808c-7023b30c1f69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:02.070848 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed95a6d-1c6c-4a18-808c-7023b30c1f69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:02.072340 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed95a6d-1c6c-4a18-808c-7023b30c1f69 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:02.085360 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 416/817] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Sep 26 17:43:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:02.086209 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed95a6d-1c6c-4a18-808c-7023b30c1f69 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:02.144214 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d02062-fc53-4d53-b48b-a647efc741f3 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:02.166659 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:02.178461 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d358866-06de-4554-bf30-1224690719de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:02.179481 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d358866-06de-4554-bf30-1224690719de None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:02.179769 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d358866-06de-4554-bf30-1224690719de None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:02.180044 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d358866-06de-4554-bf30-1224690719de None admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:02.180769 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d358866-06de-4554-bf30-1224690719de None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:02.181101 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d358866-06de-4554-bf30-1224690719de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:02.182548 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d358866-06de-4554-bf30-1224690719de None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:02.192253 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed95a6d-1c6c-4a18-808c-7023b30c1f69 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:02.201321 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 402/818] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Sep 26 17:43:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:02.202333 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d358866-06de-4554-bf30-1224690719de None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:02.234210 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a94c6-7cbd-465d-b50c-04b6058e4086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:02.235208 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a94c6-7cbd-465d-b50c-04b6058e4086 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:02.235671 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a94c6-7cbd-465d-b50c-04b6058e4086 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:02.236170 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a94c6-7cbd-465d-b50c-04b6058e4086 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:02.237189 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a94c6-7cbd-465d-b50c-04b6058e4086 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:02.238548 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a94c6-7cbd-465d-b50c-04b6058e4086 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:02.242035 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:02.249952 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-6e8a94c6-7cbd-465d-b50c-04b6058e4086 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 17:43:02.249952 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:02.249952 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 17:43:02.249952 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 17:43:02.249952 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 17:43:02.249952 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 17:43:02.249952 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 17:43:02.249952 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:43:02.249952 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 17:43:02.249952 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:02.249952 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 17:43:02.249952 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:02.249952 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:02.249952 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:02.249952 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:02.249952 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:02.249952 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:02.250955 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:02.250955 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:02.250955 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:02.250955 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:02.250955 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:02.250955 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:02.250955 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 17:43:02.250955 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 17:43:02.250955 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 17:43:02.250955 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 17:43:02.250955 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:02.250955 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:02.250955 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:02.250955 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:02.250955 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:02.250955 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:02.251821 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:02.251821 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:02.251821 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:02.251821 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:02.251821 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:02.251821 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:02.251821 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:02.251821 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:02.251821 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:02.251821 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:02.251821 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 17:43:02.251821 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:43:02.251821 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 17:43:02.251821 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:02.254453 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 417/819] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Sep 26 17:43:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:02.255446 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a94c6-7cbd-465d-b50c-04b6058e4086 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:02.308454 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d358866-06de-4554-bf30-1224690719de None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:02.343840 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5645b-f2ef-42ea-bd63-7dd9d2c114da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:02.344445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5645b-f2ef-42ea-bd63-7dd9d2c114da None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:02.344736 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5645b-f2ef-42ea-bd63-7dd9d2c114da None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:02.344990 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5645b-f2ef-42ea-bd63-7dd9d2c114da None admin] PATH_INFO: `/v3/services` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:02.345642 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5645b-f2ef-42ea-bd63-7dd9d2c114da None admin] RBAC: Adding query filter params (name=network) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:02.345942 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5645b-f2ef-42ea-bd63-7dd9d2c114da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:02.347321 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5645b-f2ef-42ea-bd63-7dd9d2c114da None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:02.356893 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 403/820] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Sep 26 17:43:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:02.356893 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5645b-f2ef-42ea-bd63-7dd9d2c114da None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:02.372204 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a94c6-7cbd-465d-b50c-04b6058e4086 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:02.410597 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98421d-9910-40bd-8c76-ecbf50fea28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:02.411259 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98421d-9910-40bd-8c76-ecbf50fea28e None admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:02.411546 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98421d-9910-40bd-8c76-ecbf50fea28e None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:02.411819 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98421d-9910-40bd-8c76-ecbf50fea28e None admin] PATH_INFO: `/v3/projects/125361b23eb14b53aca5e0139919881e/users/ea49cd9839474232a0cbe66ccffbf082/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:02.412844 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:02.413977 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98421d-9910-40bd-8c76-ecbf50fea28e None admin] RBAC: Authorizing `identity:create_grant(project_id=125361b23eb14b53aca5e0139919881e, user_id=ea49cd9839474232a0cbe66ccffbf082, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:02.415319 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98421d-9910-40bd-8c76-ecbf50fea28e None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:02.429882 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 418/821] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Sep 26 17:43:02 2022] PUT /identity/v3/projects/125361b23eb14b53aca5e0139919881e/users/ea49cd9839474232a0cbe66ccffbf082/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:43:02.441996 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98421d-9910-40bd-8c76-ecbf50fea28e None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:02.476080 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5645b-f2ef-42ea-bd63-7dd9d2c114da None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:02.516955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327f58b-f06f-4b36-b371-10ebd78cc513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:02.517655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327f58b-f06f-4b36-b371-10ebd78cc513 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:02.518010 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327f58b-f06f-4b36-b371-10ebd78cc513 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:02.518508 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327f58b-f06f-4b36-b371-10ebd78cc513 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:02.543271 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:02.604682 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98421d-9910-40bd-8c76-ecbf50fea28e None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:02.609853 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0327f58b-f06f-4b36-b371-10ebd78cc513 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:02.611468 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0327f58b-f06f-4b36-b371-10ebd78cc513 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:02.648939 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f824d9-7cc5-4ceb-846d-7afd63b35829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:02.650421 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f824d9-7cc5-4ceb-846d-7afd63b35829 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:02.650818 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f824d9-7cc5-4ceb-846d-7afd63b35829 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:02.651192 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f824d9-7cc5-4ceb-846d-7afd63b35829 None admin] PATH_INFO: `/v3/services` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:02.651919 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f824d9-7cc5-4ceb-846d-7afd63b35829 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:02.652345 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f824d9-7cc5-4ceb-846d-7afd63b35829 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:02.653937 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f824d9-7cc5-4ceb-846d-7afd63b35829 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:02.662188 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 419/822] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Sep 26 17:43:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:02.663449 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:02.664670 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f824d9-7cc5-4ceb-846d-7afd63b35829 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:02.723290 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 404/823] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:43:02 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 17:43:02.724548 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327f58b-f06f-4b36-b371-10ebd78cc513 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:02.803593 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f824d9-7cc5-4ceb-846d-7afd63b35829 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:02.839237 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327f58b-f06f-4b36-b371-10ebd78cc513 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:02.840534 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:02.854703 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065315c-aea6-41ae-b0a0-12ea090e680a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:02.855471 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065315c-aea6-41ae-b0a0-12ea090e680a None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:02.855758 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065315c-aea6-41ae-b0a0-12ea090e680a None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:02.856029 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065315c-aea6-41ae-b0a0-12ea090e680a None admin] PATH_INFO: `/v3/services` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:02.856667 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065315c-aea6-41ae-b0a0-12ea090e680a None admin] RBAC: Adding query filter params (type=network) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:02.856972 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065315c-aea6-41ae-b0a0-12ea090e680a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:02.859118 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065315c-aea6-41ae-b0a0-12ea090e680a None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:02.869088 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 420/824] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Sep 26 17:43:02 2022] GET /identity/v3/services?type=network => generated 350 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:02.870166 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065315c-aea6-41ae-b0a0-12ea090e680a None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:02.887073 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3729364-8035-449f-96ba-2ae9ab55a4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:02.888208 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3729364-8035-449f-96ba-2ae9ab55a4dc None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:02.888687 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3729364-8035-449f-96ba-2ae9ab55a4dc None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:02.889204 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3729364-8035-449f-96ba-2ae9ab55a4dc None admin] PATH_INFO: `/v3/services` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:02.890117 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3729364-8035-449f-96ba-2ae9ab55a4dc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:02.890689 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3729364-8035-449f-96ba-2ae9ab55a4dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:02.892333 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3729364-8035-449f-96ba-2ae9ab55a4dc None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:02.898754 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 405/825] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Sep 26 17:43:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:02.899803 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3729364-8035-449f-96ba-2ae9ab55a4dc None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:02.916030 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:03.014493 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065315c-aea6-41ae-b0a0-12ea090e680a None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:03.019394 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3729364-8035-449f-96ba-2ae9ab55a4dc None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:03.058356 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f29434-672b-4e81-8ca4-a18710bee85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:03.059290 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f29434-672b-4e81-8ca4-a18710bee85d None admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:03.059473 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24ae41-a1cb-4dea-b742-6133fd3cb799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:03.059983 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f29434-672b-4e81-8ca4-a18710bee85d None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:03.060092 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24ae41-a1cb-4dea-b742-6133fd3cb799 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:03.060347 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24ae41-a1cb-4dea-b742-6133fd3cb799 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:03.060621 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24ae41-a1cb-4dea-b742-6133fd3cb799 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:03.060969 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f29434-672b-4e81-8ca4-a18710bee85d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:03.061857 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f29434-672b-4e81-8ca4-a18710bee85d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:03.063725 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f29434-672b-4e81-8ca4-a18710bee85d None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:03.073196 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24ae41-a1cb-4dea-b742-6133fd3cb799 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:03.074916 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24ae41-a1cb-4dea-b742-6133fd3cb799 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:03.092140 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 406/826] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:43:02 2022] POST /identity/v3/endpoints => generated 337 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:43:03.093400 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f29434-672b-4e81-8ca4-a18710bee85d None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:03.099416 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-fa24ae41-a1cb-4dea-b742-6133fd3cb799 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:03.099416 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:03.099416 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:03.099416 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:03.099416 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:03.099416 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:03.099416 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:03.099416 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:03.099416 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:03.099416 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:03.099416 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:03.099416 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:03.099416 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:43:03.099416 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:43:03.099416 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:43:03.099416 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:43:03.100456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:03.100456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:03.100456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:03.100456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:03.100456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:03.100456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:03.100456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:03.100456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:03.100456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:03.100456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:03.100456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:03.100456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:03.100456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:03.100456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:03.100456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:03.100456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:03.100456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:43:03.101406 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:43:03.101406 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:03.101406 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:03.102011 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 421/827] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:43:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:03.106338 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24ae41-a1cb-4dea-b742-6133fd3cb799 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:03.199207 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:03.245458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:03.324508 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24ae41-a1cb-4dea-b742-6133fd3cb799 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:03.335866 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f29434-672b-4e81-8ca4-a18710bee85d None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:03.369471 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f53e08-4c43-47f6-90f8-cf4a81b88225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:03.370078 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f53e08-4c43-47f6-90f8-cf4a81b88225 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:03.370353 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f53e08-4c43-47f6-90f8-cf4a81b88225 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:03.370621 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f53e08-4c43-47f6-90f8-cf4a81b88225 None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:03.371259 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f53e08-4c43-47f6-90f8-cf4a81b88225 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:03.371555 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f53e08-4c43-47f6-90f8-cf4a81b88225 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:03.372908 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f53e08-4c43-47f6-90f8-cf4a81b88225 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:03.373364 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23f7a5-d6c2-47b6-872f-1b19f78c31c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:03.373972 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23f7a5-d6c2-47b6-872f-1b19f78c31c6 None admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:03.374376 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23f7a5-d6c2-47b6-872f-1b19f78c31c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:03.374657 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23f7a5-d6c2-47b6-872f-1b19f78c31c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:03.375440 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23f7a5-d6c2-47b6-872f-1b19f78c31c6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:03.377573 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23f7a5-d6c2-47b6-872f-1b19f78c31c6 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:03.398407 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 422/828] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:43:03.402454 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 407/829] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:43:03 2022] POST /identity/v3/endpoints => generated 346 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:43:03.409380 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f53e08-4c43-47f6-90f8-cf4a81b88225 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:03.411885 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9dd83-d01e-44db-94a1-df7a307dbbcc None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:03.412252 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9dd83-d01e-44db-94a1-df7a307dbbcc None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:03.412521 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9dd83-d01e-44db-94a1-df7a307dbbcc None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:03.414368 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 408/830] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:43:03.420621 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4deaab-806e-4286-9298-94a4cba59444 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:03.420960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4deaab-806e-4286-9298-94a4cba59444 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:03.421248 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4deaab-806e-4286-9298-94a4cba59444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:03.447074 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-7c4deaab-806e-4286-9298-94a4cba59444 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:03.448677 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-7c4deaab-806e-4286-9298-94a4cba59444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:03.558396 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:03.561832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f53e08-4c43-47f6-90f8-cf4a81b88225 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:03.613932 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944589ae-9fc4-435c-8a72-91912729ac93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:03.613932 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944589ae-9fc4-435c-8a72-91912729ac93 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:03.613932 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944589ae-9fc4-435c-8a72-91912729ac93 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:03.614265 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944589ae-9fc4-435c-8a72-91912729ac93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:03.623739 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944589ae-9fc4-435c-8a72-91912729ac93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:03.624508 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944589ae-9fc4-435c-8a72-91912729ac93 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:03.637697 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-944589ae-9fc4-435c-8a72-91912729ac93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:43:03.637697 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:03.637697 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:03.637697 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:03.637697 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:03.637697 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:03.637697 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:03.637697 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:03.637697 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:03.637697 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:03.637697 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:03.637697 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:03.637697 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 17:43:03.637697 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 17:43:03.637697 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 17:43:03.638640 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 17:43:03.638640 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:03.638640 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:03.638640 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:03.638640 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:03.638640 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:03.638640 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:03.638640 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:03.638640 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:03.638640 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:03.638640 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:03.638640 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:03.638640 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:03.638640 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:03.638640 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:03.638640 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:03.638640 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:03.639543 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 17:43:03.639543 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 17:43:03.639543 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 17:43:03.639543 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 17:43:03.639543 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 17:43:03.639543 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 17:43:03.639543 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:43:03.639543 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:03.639543 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 423/831] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:43:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:03.648029 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944589ae-9fc4-435c-8a72-91912729ac93 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:03.687880 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 409/832] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 17:43:03.763323 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944589ae-9fc4-435c-8a72-91912729ac93 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:03.798085 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da5e2e-5f49-4927-9ebe-727f27800d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:03.798698 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da5e2e-5f49-4927-9ebe-727f27800d96 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:03.798973 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da5e2e-5f49-4927-9ebe-727f27800d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:03.799239 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da5e2e-5f49-4927-9ebe-727f27800d96 None admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:03.799926 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da5e2e-5f49-4927-9ebe-727f27800d96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:03.800225 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da5e2e-5f49-4927-9ebe-727f27800d96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:03.801691 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da5e2e-5f49-4927-9ebe-727f27800d96 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:03.815052 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 424/833] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Sep 26 17:43:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:03.820834 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4deaab-806e-4286-9298-94a4cba59444 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:03.872961 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:03.927698 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4deaab-806e-4286-9298-94a4cba59444 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:03.962410 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37e50a-8c7b-4384-b507-39e973473050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:03.963008 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37e50a-8c7b-4384-b507-39e973473050 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:03.963333 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37e50a-8c7b-4384-b507-39e973473050 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:03.963601 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37e50a-8c7b-4384-b507-39e973473050 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:03.964318 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37e50a-8c7b-4384-b507-39e973473050 None admin] RBAC: Adding query filter params (role.id=be6ee971abf54b26be509c14823ece55, scope.project.id=125361b23eb14b53aca5e0139919881e, user.id=1792e79b9c9a47e1923f19bfd2cd495b) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:03.964619 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37e50a-8c7b-4384-b507-39e973473050 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:03.966087 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37e50a-8c7b-4384-b507-39e973473050 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:03.971980 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 410/834] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:43:03 2022] GET /identity/v3/role_assignments?user.id=1792e79b9c9a47e1923f19bfd2cd495b&scope.project.id=125361b23eb14b53aca5e0139919881e&role.id=be6ee971abf54b26be509c14823ece55 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:03.982235 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da5e2e-5f49-4927-9ebe-727f27800d96 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:04.003376 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:04.099444 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da5e2e-5f49-4927-9ebe-727f27800d96 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:04.137772 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48242da-f993-4727-8d62-69b26b9c025f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:04.138324 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48242da-f993-4727-8d62-69b26b9c025f None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:04.138597 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48242da-f993-4727-8d62-69b26b9c025f None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:04.138863 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48242da-f993-4727-8d62-69b26b9c025f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:04.150475 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48242da-f993-4727-8d62-69b26b9c025f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:43:04.155320 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-e48242da-f993-4727-8d62-69b26b9c025f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:43:04.155320 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:04.155320 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:04.155320 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:04.155320 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:04.155320 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:04.155320 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:04.155320 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:04.155320 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:04.155320 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:04.155320 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:04.155320 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:04.155320 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:43:04.155320 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:43:04.155320 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:43:04.155320 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:43:04.156256 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:43:04.156256 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:43:04.156256 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:43:04.156256 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:43:04.156256 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:04.156256 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:04.156256 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:04.156256 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:04.156256 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:04.156256 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:04.156256 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:04.156256 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:04.156256 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:04.156256 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:04.156256 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:04.156256 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:04.157182 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:04.157182 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:04.157182 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:04.157182 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:04.157182 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:43:04.157182 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:43:04.157182 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:43:04.157182 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:43:04.157182 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:43:04.157182 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:43:04.157182 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:43:04.157182 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:04.157182 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 425/835] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Sep 26 17:43:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:04.164296 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37e50a-8c7b-4384-b507-39e973473050 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:04.278806 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37e50a-8c7b-4384-b507-39e973473050 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:04.293362 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:04.317049 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5df21-8f1e-47e4-920d-5ad441552db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:04.318014 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5df21-8f1e-47e4-920d-5ad441552db4 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:04.318684 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5df21-8f1e-47e4-920d-5ad441552db4 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:04.319211 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5df21-8f1e-47e4-920d-5ad441552db4 None admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:04.320077 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5df21-8f1e-47e4-920d-5ad441552db4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:04.320582 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5df21-8f1e-47e4-920d-5ad441552db4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:04.322188 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5df21-8f1e-47e4-920d-5ad441552db4 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:04.332072 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 411/836] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Sep 26 17:43:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:04.338663 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48242da-f993-4727-8d62-69b26b9c025f None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:04.424589 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:04.449694 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48242da-f993-4727-8d62-69b26b9c025f None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:04.487177 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccf14d-416e-4297-9efc-df407d7c4755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:04.487812 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccf14d-416e-4297-9efc-df407d7c4755 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:04.488085 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccf14d-416e-4297-9efc-df407d7c4755 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:04.488352 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccf14d-416e-4297-9efc-df407d7c4755 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:04.499502 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bccf14d-416e-4297-9efc-df407d7c4755 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:04.500940 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bccf14d-416e-4297-9efc-df407d7c4755 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:04.515968 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-4bccf14d-416e-4297-9efc-df407d7c4755 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:04.515968 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:04.515968 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:04.515968 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:04.515968 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:04.515968 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:04.515968 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:04.515968 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:04.515968 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:04.515968 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:04.515968 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:04.515968 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:04.515968 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:43:04.515968 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:43:04.515968 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:43:04.515968 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:43:04.516969 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:04.516969 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:04.516969 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:04.516969 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:04.516969 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:04.516969 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:04.516969 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:04.516969 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:04.516969 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:04.516969 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:04.516969 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:04.516969 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:04.516969 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:04.516969 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:04.516969 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:04.516969 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:04.516969 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:43:04.517912 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:43:04.517912 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:04.517912 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:04.517912 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 426/837] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:43:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:04.524093 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5df21-8f1e-47e4-920d-5ad441552db4 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:04.633941 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5df21-8f1e-47e4-920d-5ad441552db4 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:04.670270 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1f167-1eca-4335-95c8-683ecbee684e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:04.670896 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1f167-1eca-4335-95c8-683ecbee684e None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:04.671174 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1f167-1eca-4335-95c8-683ecbee684e None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:04.671444 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1f167-1eca-4335-95c8-683ecbee684e None admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:04.672107 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1f167-1eca-4335-95c8-683ecbee684e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:04.672413 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1f167-1eca-4335-95c8-683ecbee684e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:04.673857 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1f167-1eca-4335-95c8-683ecbee684e None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:04.687765 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 412/838] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:43:04.693355 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccf14d-416e-4297-9efc-df407d7c4755 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:04.789201 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8124b1-c0b1-4a1f-9ba4-55fa495ec4a6 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:04.789522 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8124b1-c0b1-4a1f-9ba4-55fa495ec4a6 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:04.789755 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8124b1-c0b1-4a1f-9ba4-55fa495ec4a6 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:04.791443 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 413/839] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 17:43:04.796235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6eb0be-f5a4-4c16-82df-f07ea96aed8c None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:04.796515 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6eb0be-f5a4-4c16-82df-f07ea96aed8c None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:04.796785 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6eb0be-f5a4-4c16-82df-f07ea96aed8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:04.801650 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccf14d-416e-4297-9efc-df407d7c4755 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:04.820347 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-df6eb0be-f5a4-4c16-82df-f07ea96aed8c None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:04.821577 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-df6eb0be-f5a4-4c16-82df-f07ea96aed8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:04.830651 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:04.840551 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f156d2-e4bd-436e-888c-8b337433c0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:04.841397 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f156d2-e4bd-436e-888c-8b337433c0ee None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:04.841674 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f156d2-e4bd-436e-888c-8b337433c0ee None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:04.841967 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f156d2-e4bd-436e-888c-8b337433c0ee None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:04.852258 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f156d2-e4bd-436e-888c-8b337433c0ee None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:04.853987 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f156d2-e4bd-436e-888c-8b337433c0ee None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:04.857164 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:04.867291 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-93f156d2-e4bd-436e-888c-8b337433c0ee None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 17:43:04.867291 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:04.867291 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:04.867291 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:04.867291 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:04.867291 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:04.867291 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:04.867291 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:04.867291 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:04.867291 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:04.867291 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:04.867291 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:04.867291 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 17:43:04.867291 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 17:43:04.867291 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 17:43:04.867291 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 17:43:04.868279 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:04.868279 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:04.868279 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 17:43:04.868279 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:43:04.868279 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 17:43:04.868279 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:43:04.868279 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:04.868279 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:04.868279 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:04.868279 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:04.868279 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:04.868279 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:04.868279 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:04.868279 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:04.868279 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:04.868279 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:04.868279 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:04.868279 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:04.869328 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:04.869328 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:04.869328 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 17:43:04.869328 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 17:43:04.869328 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 17:43:04.869328 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 17:43:04.869328 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 17:43:04.869328 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 17:43:04.869328 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 17:43:04.869328 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:04.869328 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 427/840] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Sep 26 17:43:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:04.879815 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f156d2-e4bd-436e-888c-8b337433c0ee None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:04.915071 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 414/841] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:43:04.999058 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f156d2-e4bd-436e-888c-8b337433c0ee None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:05.033376 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec94345-1c7f-4bb2-b159-88643ac4b576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:05.034318 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec94345-1c7f-4bb2-b159-88643ac4b576 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:05.034813 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec94345-1c7f-4bb2-b159-88643ac4b576 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:05.035325 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec94345-1c7f-4bb2-b159-88643ac4b576 None admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:05.036291 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec94345-1c7f-4bb2-b159-88643ac4b576 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:05.036798 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec94345-1c7f-4bb2-b159-88643ac4b576 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:05.038546 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec94345-1c7f-4bb2-b159-88643ac4b576 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:05.057770 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 428/842] 10.222.0.62 () {56 vars in 1149 bytes} [Mon Sep 26 17:43:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:43:05.063856 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6eb0be-f5a4-4c16-82df-f07ea96aed8c None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:05.168846 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6eb0be-f5a4-4c16-82df-f07ea96aed8c None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:05.186056 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec94345-1c7f-4bb2-b159-88643ac4b576 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:05.213304 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64f541-a016-4e80-96a8-c42a6b6f4be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:05.214466 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64f541-a016-4e80-96a8-c42a6b6f4be5 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:05.215984 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64f541-a016-4e80-96a8-c42a6b6f4be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:05.217202 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64f541-a016-4e80-96a8-c42a6b6f4be5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:05.238173 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:05.263633 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:05.300448 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec94345-1c7f-4bb2-b159-88643ac4b576 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:05.306206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64f541-a016-4e80-96a8-c42a6b6f4be5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:05.307671 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64f541-a016-4e80-96a8-c42a6b6f4be5 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:05.340348 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc06e13a-0aef-400f-887c-4a0da3bfd910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:05.342061 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06e13a-0aef-400f-887c-4a0da3bfd910 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:05.342680 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06e13a-0aef-400f-887c-4a0da3bfd910 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:05.343269 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06e13a-0aef-400f-887c-4a0da3bfd910 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:05.354880 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc06e13a-0aef-400f-887c-4a0da3bfd910 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:43:05.361303 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-fc06e13a-0aef-400f-887c-4a0da3bfd910 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:43:05.361303 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:05.361303 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:05.361303 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:05.361303 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:05.361303 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:05.361303 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:05.361303 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:05.361303 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:05.361303 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:05.361303 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:05.361303 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:05.361303 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:43:05.361303 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:43:05.361303 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:43:05.361303 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:43:05.362217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:43:05.362217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:43:05.362217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:43:05.362217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:43:05.362217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:05.362217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:05.362217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:05.362217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:05.362217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:05.362217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:05.362217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:05.362217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:05.362217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:05.362217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:05.362217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:05.362217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:05.363045 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:05.363045 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:05.363045 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:05.363045 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:05.363045 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:43:05.363045 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:43:05.363045 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:43:05.363045 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:43:05.363045 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:43:05.363045 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:43:05.363045 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:43:05.363045 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:05.370273 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 429/843] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Sep 26 17:43:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:05.371809 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc06e13a-0aef-400f-887c-4a0da3bfd910 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:05.433096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 415/844] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:43:05 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 17:43:05.438660 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64f541-a016-4e80-96a8-c42a6b6f4be5 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:05.496457 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc06e13a-0aef-400f-887c-4a0da3bfd910 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:05.504723 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:05.507799 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:05.540881 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebeff14-37d6-41ed-9bef-4148981013c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:05.541834 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebeff14-37d6-41ed-9bef-4148981013c9 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:05.542548 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebeff14-37d6-41ed-9bef-4148981013c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:05.543429 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebeff14-37d6-41ed-9bef-4148981013c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:05.544601 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebeff14-37d6-41ed-9bef-4148981013c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:05.545235 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebeff14-37d6-41ed-9bef-4148981013c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:05.546914 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebeff14-37d6-41ed-9bef-4148981013c9 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:05.548755 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64f541-a016-4e80-96a8-c42a6b6f4be5 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:05.558089 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 430/845] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:43:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:05.564129 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebeff14-37d6-41ed-9bef-4148981013c9 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:05.592595 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dacea9-7f00-4c81-9c30-9905ebd9755f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:05.593265 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dacea9-7f00-4c81-9c30-9905ebd9755f None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:05.593540 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dacea9-7f00-4c81-9c30-9905ebd9755f None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:05.593804 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dacea9-7f00-4c81-9c30-9905ebd9755f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:05.606684 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dacea9-7f00-4c81-9c30-9905ebd9755f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:05.609082 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dacea9-7f00-4c81-9c30-9905ebd9755f None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:05.629328 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-26dacea9-7f00-4c81-9c30-9905ebd9755f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:05.629328 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:05.629328 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:05.629328 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:05.629328 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:05.629328 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:05.629328 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:05.629328 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:05.629328 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:05.629328 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:05.629328 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:05.629328 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:05.629328 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:43:05.629328 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:43:05.629328 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:43:05.629328 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:43:05.630320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:05.630320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:05.630320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:05.630320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:05.630320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:05.630320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:05.630320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:05.630320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:05.630320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:05.630320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:05.630320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:05.630320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:05.630320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:05.630320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:05.630320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:05.630320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:05.630320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:43:05.631884 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:43:05.631884 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:05.631884 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:05.634172 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 416/846] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:43:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:05.639851 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dacea9-7f00-4c81-9c30-9905ebd9755f None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:05.691154 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebeff14-37d6-41ed-9bef-4148981013c9 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:05.730051 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8de98a-0ff0-448e-a0be-31d32425881d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:05.730721 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8de98a-0ff0-448e-a0be-31d32425881d None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:05.730994 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8de98a-0ff0-448e-a0be-31d32425881d None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:05.731290 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8de98a-0ff0-448e-a0be-31d32425881d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:05.744870 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8de98a-0ff0-448e-a0be-31d32425881d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:05.746538 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8de98a-0ff0-448e-a0be-31d32425881d None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:05.762493 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-4b8de98a-0ff0-448e-a0be-31d32425881d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:05.762493 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:05.762493 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:05.762493 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:05.762493 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:05.762493 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:05.762493 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:05.762493 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:05.762493 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:05.762493 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:05.762493 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:05.762493 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:05.762493 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:43:05.762493 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:43:05.762493 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:43:05.762493 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:43:05.763474 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:05.763474 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:05.763474 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:05.763474 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:05.763474 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:05.763474 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:05.763474 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:05.763474 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:05.763474 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:05.763474 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:05.763474 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:05.763474 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:05.763474 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:05.763474 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:05.763474 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:05.763474 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:05.763474 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:43:05.764349 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:43:05.764349 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:05.764349 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:05.768476 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 431/847] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:43:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:05.769484 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8de98a-0ff0-448e-a0be-31d32425881d None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:05.788562 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dacea9-7f00-4c81-9c30-9905ebd9755f None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:05.794730 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:05.813625 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:05.838919 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d7e8d-56cc-42a9-b5d5-9cd7c1ddeaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:05.839614 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d7e8d-56cc-42a9-b5d5-9cd7c1ddeaef None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:05.839958 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d7e8d-56cc-42a9-b5d5-9cd7c1ddeaef None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:05.840292 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d7e8d-56cc-42a9-b5d5-9cd7c1ddeaef None admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:05.841001 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d7e8d-56cc-42a9-b5d5-9cd7c1ddeaef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:05.841412 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d7e8d-56cc-42a9-b5d5-9cd7c1ddeaef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:05.842841 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d7e8d-56cc-42a9-b5d5-9cd7c1ddeaef None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:05.856719 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 417/848] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:43:05.857899 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f30030-debe-4fab-b79b-d5c7c1a745ae None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:05.858243 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f30030-debe-4fab-b79b-d5c7c1a745ae None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:05.858611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f30030-debe-4fab-b79b-d5c7c1a745ae None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:05.864086 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 418/849] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:43:05.864086 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f30030-debe-4fab-b79b-d5c7c1a745ae None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:05.905150 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8de98a-0ff0-448e-a0be-31d32425881d None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:05.945191 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c90e07-c14a-4ba9-b7c3-780d01bf2a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:05.945892 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c90e07-c14a-4ba9-b7c3-780d01bf2a7e None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:05.946240 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c90e07-c14a-4ba9-b7c3-780d01bf2a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:05.946581 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c90e07-c14a-4ba9-b7c3-780d01bf2a7e None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:05.947291 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c90e07-c14a-4ba9-b7c3-780d01bf2a7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:05.947663 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c90e07-c14a-4ba9-b7c3-780d01bf2a7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:05.949232 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c90e07-c14a-4ba9-b7c3-780d01bf2a7e None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:05.968116 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 432/850] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:05.968116 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee860afa-0735-4130-8019-44dfee31743c None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:05.968116 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee860afa-0735-4130-8019-44dfee31743c None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:05.968116 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee860afa-0735-4130-8019-44dfee31743c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:05.981993 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f30030-debe-4fab-b79b-d5c7c1a745ae None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:05.984998 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-ee860afa-0735-4130-8019-44dfee31743c None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:05.986307 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-ee860afa-0735-4130-8019-44dfee31743c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:06.017703 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcdae43-1f46-40b6-a4a0-6253d2f8914c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:06.018483 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdae43-1f46-40b6-a4a0-6253d2f8914c None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:06.018850 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdae43-1f46-40b6-a4a0-6253d2f8914c None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:06.019206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdae43-1f46-40b6-a4a0-6253d2f8914c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:06.026344 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcdae43-1f46-40b6-a4a0-6253d2f8914c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:06.027881 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcdae43-1f46-40b6-a4a0-6253d2f8914c None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:06.039460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-cbcdae43-1f46-40b6-a4a0-6253d2f8914c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:43:06.039460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:06.039460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:06.039460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:06.039460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:06.039460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:06.039460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:06.039460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:06.039460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:06.039460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:06.039460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:06.039460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:06.039460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 17:43:06.039460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 17:43:06.039460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 17:43:06.040519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 17:43:06.040519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:06.040519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:06.040519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:06.040519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:06.040519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:06.040519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:06.040519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:06.040519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:06.040519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:06.040519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:06.040519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:06.040519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:06.040519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:06.040519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:06.040519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:06.040519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:06.041649 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 17:43:06.041649 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 17:43:06.041649 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 17:43:06.041649 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 17:43:06.041649 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 17:43:06.041649 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 17:43:06.041649 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:43:06.041649 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:06.042611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 419/851] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:43:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:06.043376 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcdae43-1f46-40b6-a4a0-6253d2f8914c None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:06.073515 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 433/852] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:05 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:43:06.073515 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee860afa-0735-4130-8019-44dfee31743c None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:06.086575 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:06.104224 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:06.194982 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee860afa-0735-4130-8019-44dfee31743c None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:06.201723 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcdae43-1f46-40b6-a4a0-6253d2f8914c None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:06.241813 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a16ede-355e-49f6-9fcf-9761cce097d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:06.243047 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a16ede-355e-49f6-9fcf-9761cce097d1 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:06.243564 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a16ede-355e-49f6-9fcf-9761cce097d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:06.244125 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a16ede-355e-49f6-9fcf-9761cce097d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:06.245206 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a16ede-355e-49f6-9fcf-9761cce097d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:06.245734 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a16ede-355e-49f6-9fcf-9761cce097d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:06.246658 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c820fff-da7a-4ae2-95f1-07bd5c202398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:06.247383 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c820fff-da7a-4ae2-95f1-07bd5c202398 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:06.247737 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a16ede-355e-49f6-9fcf-9761cce097d1 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:06.247851 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c820fff-da7a-4ae2-95f1-07bd5c202398 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:06.248184 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c820fff-da7a-4ae2-95f1-07bd5c202398 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:06.256713 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c820fff-da7a-4ae2-95f1-07bd5c202398 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:06.258315 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c820fff-da7a-4ae2-95f1-07bd5c202398 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:06.264339 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 434/853] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Sep 26 17:43:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:06.270106 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a16ede-355e-49f6-9fcf-9761cce097d1 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:06.275072 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-8c820fff-da7a-4ae2-95f1-07bd5c202398 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 26 17:43:06.275072 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:06.275072 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:06.275072 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:06.275072 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:06.275072 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:06.275072 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:06.275072 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:06.275072 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:06.275072 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:06.275072 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:06.275072 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:06.275072 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 17:43:06.275072 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 17:43:06.275072 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 17:43:06.275072 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 17:43:06.276003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:06.276003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:06.276003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 17:43:06.276003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:43:06.276003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 17:43:06.276003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:43:06.276003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:06.276003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:06.276003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:06.276003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:06.276003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:06.276003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:06.276003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:06.276003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:06.276003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:06.276003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:06.276003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:06.276003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:06.276960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:06.276960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:06.276960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 17:43:06.276960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 17:43:06.276960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 17:43:06.276960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 17:43:06.276960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 17:43:06.276960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 17:43:06.276960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 26 17:43:06.276960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:06.276960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 420/854] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Sep 26 17:43:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:06.278080 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991b7f0-706d-4366-a530-ee0f271dd2dd None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:06.278080 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991b7f0-706d-4366-a530-ee0f271dd2dd None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:06.278243 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991b7f0-706d-4366-a530-ee0f271dd2dd None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:06.279561 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 421/855] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:43:06.281969 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991b7f0-706d-4366-a530-ee0f271dd2dd None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:06.346193 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:06.378651 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a16ede-355e-49f6-9fcf-9761cce097d1 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:06.381598 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:06.388672 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991b7f0-706d-4366-a530-ee0f271dd2dd None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:06.414877 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b8165-fe01-4ea9-87d9-e1e5c09c2014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:06.415487 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b8165-fe01-4ea9-87d9-e1e5c09c2014 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:06.415768 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b8165-fe01-4ea9-87d9-e1e5c09c2014 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:06.416041 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b8165-fe01-4ea9-87d9-e1e5c09c2014 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:06.416759 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b8165-fe01-4ea9-87d9-e1e5c09c2014 None admin] RBAC: Adding query filter params (role.id=4685fd1f2f284d4498281231160a5f27, scope.project.id=125361b23eb14b53aca5e0139919881e, user.id=8475122232ef4d8893f2a9b98768396e) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:06.417095 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b8165-fe01-4ea9-87d9-e1e5c09c2014 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:06.418517 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b8165-fe01-4ea9-87d9-e1e5c09c2014 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:06.422076 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d90baf-8b95-4bc4-ba19-8f3eb1163dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:06.422675 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d90baf-8b95-4bc4-ba19-8f3eb1163dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:06.422952 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d90baf-8b95-4bc4-ba19-8f3eb1163dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:06.423222 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d90baf-8b95-4bc4-ba19-8f3eb1163dd1 None admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:06.423940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d90baf-8b95-4bc4-ba19-8f3eb1163dd1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:06.426106 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 435/856] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:43:06 2022] GET /identity/v3/role_assignments?user.id=8475122232ef4d8893f2a9b98768396e&scope.project.id=125361b23eb14b53aca5e0139919881e&role.id=4685fd1f2f284d4498281231160a5f27 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:06.426239 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d90baf-8b95-4bc4-ba19-8f3eb1163dd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:06.426239 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d90baf-8b95-4bc4-ba19-8f3eb1163dd1 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:06.430481 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20520071-d7b7-4008-bf85-4629c547e1cc None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:06.430799 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20520071-d7b7-4008-bf85-4629c547e1cc None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:06.431030 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20520071-d7b7-4008-bf85-4629c547e1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:06.448741 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 422/857] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Sep 26 17:43:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:06.449613 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-20520071-d7b7-4008-bf85-4629c547e1cc None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:06.450352 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d90baf-8b95-4bc4-ba19-8f3eb1163dd1 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:06.451081 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-20520071-d7b7-4008-bf85-4629c547e1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:06.527787 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 436/858] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:06 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:43:06.528640 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20520071-d7b7-4008-bf85-4629c547e1cc None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:06.589354 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d90baf-8b95-4bc4-ba19-8f3eb1163dd1 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:06.602655 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:06.636620 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100caeb-99fc-4660-b33f-c02c0bff0d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:06.637370 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100caeb-99fc-4660-b33f-c02c0bff0d54 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:06.637645 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100caeb-99fc-4660-b33f-c02c0bff0d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:06.637911 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100caeb-99fc-4660-b33f-c02c0bff0d54 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:06.638504 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100caeb-99fc-4660-b33f-c02c0bff0d54 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:06.639893 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100caeb-99fc-4660-b33f-c02c0bff0d54 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:06.650262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-4100caeb-99fc-4660-b33f-c02c0bff0d54 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 17:43:06.650262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:06.650262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 17:43:06.650262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 17:43:06.650262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 17:43:06.650262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 17:43:06.650262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 17:43:06.650262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:43:06.650262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 17:43:06.650262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:06.650262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 17:43:06.650262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:06.650262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:06.650262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:06.650262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:06.650262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:06.650262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:06.651381 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:06.651381 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:06.651381 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:06.651381 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:06.651381 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:06.651381 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:06.651381 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 17:43:06.651381 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 17:43:06.651381 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 17:43:06.651381 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 17:43:06.651381 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:06.651381 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:06.651381 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:06.651381 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:06.651381 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:06.651381 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:06.652387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:06.652387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:06.652387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:06.652387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:06.652387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:06.652387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:06.652387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:06.652387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:06.652387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:06.652387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:06.652387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 17:43:06.652387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:43:06.652387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 17:43:06.652387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:06.653573 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20520071-d7b7-4008-bf85-4629c547e1cc None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:06.654734 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 423/859] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Sep 26 17:43:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:06.660277 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100caeb-99fc-4660-b33f-c02c0bff0d54 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:06.681180 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:06.699761 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32328866-c448-4df2-be1c-83cee9f23e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:06.700442 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32328866-c448-4df2-be1c-83cee9f23e61 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:06.700656 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32328866-c448-4df2-be1c-83cee9f23e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:06.701255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32328866-c448-4df2-be1c-83cee9f23e61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:06.783192 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100caeb-99fc-4660-b33f-c02c0bff0d54 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:06.786126 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32328866-c448-4df2-be1c-83cee9f23e61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:06.787634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32328866-c448-4df2-be1c-83cee9f23e61 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:06.826556 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa4a95-1ac6-48c2-ba36-52b34471e0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:06.827159 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa4a95-1ac6-48c2-ba36-52b34471e0df None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:06.827434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa4a95-1ac6-48c2-ba36-52b34471e0df None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:06.827702 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa4a95-1ac6-48c2-ba36-52b34471e0df None admin] PATH_INFO: `/v3/services` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:06.828329 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa4a95-1ac6-48c2-ba36-52b34471e0df None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:06.828623 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa4a95-1ac6-48c2-ba36-52b34471e0df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:06.830021 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa4a95-1ac6-48c2-ba36-52b34471e0df None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:06.839525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 424/860] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Sep 26 17:43:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:43:06.840260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa4a95-1ac6-48c2-ba36-52b34471e0df None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:06.853669 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:06.901972 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 437/861] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:43:06 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 17:43:06.901972 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32328866-c448-4df2-be1c-83cee9f23e61 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:06.931724 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:06.952168 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa4a95-1ac6-48c2-ba36-52b34471e0df None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:06.988543 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5d8da-0db4-4465-b887-a0d3868c6a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:06.989271 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5d8da-0db4-4465-b887-a0d3868c6a26 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:06.989563 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5d8da-0db4-4465-b887-a0d3868c6a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:06.989825 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5d8da-0db4-4465-b887-a0d3868c6a26 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:06.991041 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5d8da-0db4-4465-b887-a0d3868c6a26 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:06.992414 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5d8da-0db4-4465-b887-a0d3868c6a26 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:07.001320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-76d5d8da-0db4-4465-b887-a0d3868c6a26 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 17:43:07.001320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:07.001320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 17:43:07.001320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 17:43:07.001320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 17:43:07.001320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 17:43:07.001320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 17:43:07.001320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:43:07.001320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 17:43:07.001320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:07.001320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 17:43:07.001320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:07.001320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:07.001320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:07.001320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:07.001320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:07.002262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:07.002262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:07.002262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:07.002262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:07.002262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:07.002262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:07.002262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:07.002262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 17:43:07.002262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 17:43:07.002262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 17:43:07.002262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 17:43:07.002262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:07.002262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:07.002262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:07.002262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:07.002262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:07.002262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:07.003147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:07.003147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:07.003147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:07.003147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:07.003147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:07.003147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:07.003147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:07.003147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:07.003147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:07.003147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:07.003147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 17:43:07.003147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:43:07.003147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 17:43:07.003147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:07.003147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 425/862] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Sep 26 17:43:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:07.003939 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5d8da-0db4-4465-b887-a0d3868c6a26 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:07.016863 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32328866-c448-4df2-be1c-83cee9f23e61 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:07.059400 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f2746-d673-4bdc-9567-ac0fc67a459a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:07.060007 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f2746-d673-4bdc-9567-ac0fc67a459a None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:07.060290 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f2746-d673-4bdc-9567-ac0fc67a459a None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:07.060562 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f2746-d673-4bdc-9567-ac0fc67a459a None admin] PATH_INFO: `/v3/services` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:07.061220 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f2746-d673-4bdc-9567-ac0fc67a459a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:07.061526 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f2746-d673-4bdc-9567-ac0fc67a459a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:07.063181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f2746-d673-4bdc-9567-ac0fc67a459a None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:07.067897 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 438/863] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Sep 26 17:43:06 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:07.069325 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f2746-d673-4bdc-9567-ac0fc67a459a None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:07.112688 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:07.127359 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5d8da-0db4-4465-b887-a0d3868c6a26 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:07.167841 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6020b-44f8-4ff8-96f6-68306549dab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:07.168587 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6020b-44f8-4ff8-96f6-68306549dab9 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:07.168938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6020b-44f8-4ff8-96f6-68306549dab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:07.169329 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6020b-44f8-4ff8-96f6-68306549dab9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:07.182555 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6020b-44f8-4ff8-96f6-68306549dab9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:07.184254 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6020b-44f8-4ff8-96f6-68306549dab9 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:07.192015 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:07.206850 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-6ca6020b-44f8-4ff8-96f6-68306549dab9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:07.206850 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:07.206850 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:07.206850 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:07.206850 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:07.206850 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:07.206850 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:07.206850 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:07.206850 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:07.206850 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:07.206850 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:07.206850 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:07.206850 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:43:07.206850 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:43:07.206850 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:43:07.206850 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:43:07.207892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:07.207892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:07.207892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:07.207892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:07.207892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:07.207892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:07.207892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:07.207892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:07.207892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:07.207892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:07.207892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:07.207892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:07.207892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:07.207892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:07.207892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:07.207892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:07.207892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:43:07.208779 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:43:07.208779 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:07.208779 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:07.208779 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 426/864] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:43:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:07.214043 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f2746-d673-4bdc-9567-ac0fc67a459a None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:07.215260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6020b-44f8-4ff8-96f6-68306549dab9 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:07.265792 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03116e-6c01-4941-b223-c2601d8fc7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:07.266764 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03116e-6c01-4941-b223-c2601d8fc7f5 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:07.267185 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03116e-6c01-4941-b223-c2601d8fc7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:07.267589 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03116e-6c01-4941-b223-c2601d8fc7f5 None admin] PATH_INFO: `/v3/services` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:07.268552 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03116e-6c01-4941-b223-c2601d8fc7f5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:07.269112 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03116e-6c01-4941-b223-c2601d8fc7f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:07.270965 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03116e-6c01-4941-b223-c2601d8fc7f5 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:07.280571 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 439/865] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Sep 26 17:43:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:07.287984 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03116e-6c01-4941-b223-c2601d8fc7f5 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:07.350023 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6020b-44f8-4ff8-96f6-68306549dab9 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:07.397598 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d835abd-d9f8-40d8-bc3e-7720b04a55ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:07.398299 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d835abd-d9f8-40d8-bc3e-7720b04a55ef None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:07.398649 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d835abd-d9f8-40d8-bc3e-7720b04a55ef None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:07.398988 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d835abd-d9f8-40d8-bc3e-7720b04a55ef None admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:07.399974 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d835abd-d9f8-40d8-bc3e-7720b04a55ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:07.400345 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d835abd-d9f8-40d8-bc3e-7720b04a55ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:07.402609 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d835abd-d9f8-40d8-bc3e-7720b04a55ef None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:07.411482 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:07.423129 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03116e-6c01-4941-b223-c2601d8fc7f5 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:07.425157 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 427/866] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:07.428413 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d835abd-d9f8-40d8-bc3e-7720b04a55ef None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:07.472579 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76b691-a08b-4960-a8db-54bf3b59dd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:07.473811 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76b691-a08b-4960-a8db-54bf3b59dd82 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:07.474305 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76b691-a08b-4960-a8db-54bf3b59dd82 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:07.474869 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76b691-a08b-4960-a8db-54bf3b59dd82 None admin] PATH_INFO: `/v3/services` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:07.475989 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e76b691-a08b-4960-a8db-54bf3b59dd82 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:07.477475 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e76b691-a08b-4960-a8db-54bf3b59dd82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:07.479130 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e76b691-a08b-4960-a8db-54bf3b59dd82 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:07.491355 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 440/867] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Sep 26 17:43:07 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:43:07.517459 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:07.555857 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d835abd-d9f8-40d8-bc3e-7720b04a55ef None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:07.606304 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e529c-e9eb-4c92-88e5-8f6e5d11a672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:07.607321 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e529c-e9eb-4c92-88e5-8f6e5d11a672 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:07.607832 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e529c-e9eb-4c92-88e5-8f6e5d11a672 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:07.608322 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e529c-e9eb-4c92-88e5-8f6e5d11a672 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:07.617204 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e529c-e9eb-4c92-88e5-8f6e5d11a672 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:07.618708 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e529c-e9eb-4c92-88e5-8f6e5d11a672 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:07.632821 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-8b5e529c-e9eb-4c92-88e5-8f6e5d11a672 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:43:07.632821 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:07.632821 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:07.632821 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:07.632821 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:07.632821 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:07.632821 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:07.632821 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:07.632821 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:07.632821 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:07.632821 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:07.632821 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:07.632821 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 17:43:07.632821 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 17:43:07.632821 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 17:43:07.633976 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 17:43:07.633976 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:07.633976 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:07.633976 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:07.633976 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:07.633976 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:07.633976 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:07.633976 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:07.633976 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:07.633976 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:07.633976 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:07.633976 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:07.633976 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:07.633976 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:07.633976 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:07.633976 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:07.633976 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:07.634966 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 17:43:07.634966 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 17:43:07.634966 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 17:43:07.634966 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 17:43:07.634966 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 17:43:07.634966 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 17:43:07.634966 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:43:07.634966 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:07.634966 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 428/868] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:43:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:07.645913 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76b691-a08b-4960-a8db-54bf3b59dd82 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:07.761730 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76b691-a08b-4960-a8db-54bf3b59dd82 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:07.799192 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b9465-4538-4edf-a010-a0a8cb6d1787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:07.800202 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b9465-4538-4edf-a010-a0a8cb6d1787 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:07.800684 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b9465-4538-4edf-a010-a0a8cb6d1787 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:07.801187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b9465-4538-4edf-a010-a0a8cb6d1787 None admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:07.802083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b9465-4538-4edf-a010-a0a8cb6d1787 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:07.802623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b9465-4538-4edf-a010-a0a8cb6d1787 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:07.804267 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b9465-4538-4edf-a010-a0a8cb6d1787 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:07.817733 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 441/869] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Sep 26 17:43:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:07.824587 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e529c-e9eb-4c92-88e5-8f6e5d11a672 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:07.933109 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e529c-e9eb-4c92-88e5-8f6e5d11a672 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:07.952707 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:07.972518 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c682845-78eb-46b3-8ca5-859d756289c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:07.973155 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c682845-78eb-46b3-8ca5-859d756289c7 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:07.973439 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c682845-78eb-46b3-8ca5-859d756289c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:07.973712 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c682845-78eb-46b3-8ca5-859d756289c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:07.974920 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c682845-78eb-46b3-8ca5-859d756289c7 None admin] RBAC: Adding query filter params (role.id=be6ee971abf54b26be509c14823ece55, scope.project.id=125361b23eb14b53aca5e0139919881e, user.id=ea49cd9839474232a0cbe66ccffbf082) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:07.974920 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c682845-78eb-46b3-8ca5-859d756289c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:07.976665 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c682845-78eb-46b3-8ca5-859d756289c7 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:07.986187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 429/870] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:43:07 2022] GET /identity/v3/role_assignments?user.id=ea49cd9839474232a0cbe66ccffbf082&scope.project.id=125361b23eb14b53aca5e0139919881e&role.id=be6ee971abf54b26be509c14823ece55 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:08.751144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96d1b3-5040-4330-9255-0d5947e3242f None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:08.751718 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96d1b3-5040-4330-9255-0d5947e3242f None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:08.751718 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96d1b3-5040-4330-9255-0d5947e3242f None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:08.753474 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 442/871] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:43:08.759432 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2221c-5354-4624-9fed-2b7bdc8fcc24 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:08.759888 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2221c-5354-4624-9fed-2b7bdc8fcc24 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:08.759972 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2221c-5354-4624-9fed-2b7bdc8fcc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:08.779768 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-6ab2221c-5354-4624-9fed-2b7bdc8fcc24 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:08.781021 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-6ab2221c-5354-4624-9fed-2b7bdc8fcc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:08.857813 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 430/872] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:08 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:43:09.127399 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96d1b3-5040-4330-9255-0d5947e3242f None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:09.147814 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:09.243807 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96d1b3-5040-4330-9255-0d5947e3242f None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:09.279908 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f17c8e-03fe-41e2-b4a7-4cff8e620b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:09.280537 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f17c8e-03fe-41e2-b4a7-4cff8e620b07 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:09.280817 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f17c8e-03fe-41e2-b4a7-4cff8e620b07 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:09.281113 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f17c8e-03fe-41e2-b4a7-4cff8e620b07 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:09.292089 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f17c8e-03fe-41e2-b4a7-4cff8e620b07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:43:09.297322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-d1f17c8e-03fe-41e2-b4a7-4cff8e620b07 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 17:43:09.297322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:09.297322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:09.297322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:09.297322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:09.297322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:09.297322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:09.297322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:09.297322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:09.297322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:09.297322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:09.297322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:09.297322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:43:09.297322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:43:09.297322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:43:09.297322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:43:09.298332 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:43:09.298332 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:43:09.298332 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:43:09.298332 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:43:09.298332 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:09.298332 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:09.298332 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:09.298332 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:09.298332 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:09.298332 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:09.298332 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:09.298332 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:09.298332 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:09.298332 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:09.298332 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:09.298332 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:09.299619 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:09.299619 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:09.299619 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:09.299619 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:09.299619 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:43:09.299619 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:43:09.299619 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:43:09.299619 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:43:09.299619 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:43:09.299619 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:43:09.299619 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 17:43:09.299619 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:09.299619 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 443/873] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Sep 26 17:43:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:09.306603 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2221c-5354-4624-9fed-2b7bdc8fcc24 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:09.318932 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c599a-b6ea-4377-8c74-2c5eda03d891 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:09.319252 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c599a-b6ea-4377-8c74-2c5eda03d891 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:09.319472 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c599a-b6ea-4377-8c74-2c5eda03d891 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:09.320948 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 444/874] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 17:43:09.326315 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627965b-8d3a-4dd5-92c9-2762ab0964b4 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:09.326610 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627965b-8d3a-4dd5-92c9-2762ab0964b4 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:09.326853 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627965b-8d3a-4dd5-92c9-2762ab0964b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:09.345659 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-c627965b-8d3a-4dd5-92c9-2762ab0964b4 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:09.346842 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-c627965b-8d3a-4dd5-92c9-2762ab0964b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:09.433297 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 445/875] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:09 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 17:43:09.438185 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2221c-5354-4624-9fed-2b7bdc8fcc24 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:09.452390 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:09.475763 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba8f5f-695c-401d-baf1-c0865e511a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:09.476362 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba8f5f-695c-401d-baf1-c0865e511a7c None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:09.476633 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba8f5f-695c-401d-baf1-c0865e511a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:09.476899 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba8f5f-695c-401d-baf1-c0865e511a7c None admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:09.477581 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba8f5f-695c-401d-baf1-c0865e511a7c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:09.477876 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba8f5f-695c-401d-baf1-c0865e511a7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:09.479236 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba8f5f-695c-401d-baf1-c0865e511a7c None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:09.488050 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 431/876] 10.222.0.62 () {56 vars in 1115 bytes} [Mon Sep 26 17:43:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:09.493744 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627965b-8d3a-4dd5-92c9-2762ab0964b4 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:09.502957 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:09.602411 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627965b-8d3a-4dd5-92c9-2762ab0964b4 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:09.637383 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9e35c-d1a3-4c25-af00-edf57988f69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:09.637944 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9e35c-d1a3-4c25-af00-edf57988f69a None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:09.638222 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9e35c-d1a3-4c25-af00-edf57988f69a None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:09.638495 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9e35c-d1a3-4c25-af00-edf57988f69a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:09.649572 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9e35c-d1a3-4c25-af00-edf57988f69a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:09.651018 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9e35c-d1a3-4c25-af00-edf57988f69a None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:09.665881 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-56e9e35c-d1a3-4c25-af00-edf57988f69a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:09.665881 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:09.665881 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:09.665881 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:09.665881 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:09.665881 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:09.665881 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:09.665881 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:09.665881 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:09.665881 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:09.665881 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:09.665881 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:09.665881 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:43:09.665881 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:43:09.665881 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:43:09.665881 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:43:09.666829 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:09.666829 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:09.666829 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:09.666829 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:09.666829 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:09.666829 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:09.666829 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:09.666829 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:09.666829 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:09.666829 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:09.666829 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:09.666829 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:09.666829 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:09.666829 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:09.666829 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:09.666829 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:09.666829 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:43:09.667723 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:43:09.667723 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:09.667723 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:09.667723 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 446/877] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:43:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:09.672644 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba8f5f-695c-401d-baf1-c0865e511a7c None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:09.706267 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9e35c-d1a3-4c25-af00-edf57988f69a None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:09.781577 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:09.791395 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba8f5f-695c-401d-baf1-c0865e511a7c None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:09.831321 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309cd4b-72ee-42f6-ab55-f635c151d550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:09.831950 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309cd4b-72ee-42f6-ab55-f635c151d550 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:09.832224 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309cd4b-72ee-42f6-ab55-f635c151d550 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:09.832494 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309cd4b-72ee-42f6-ab55-f635c151d550 None admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:09.833155 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3309cd4b-72ee-42f6-ab55-f635c151d550 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:09.833454 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3309cd4b-72ee-42f6-ab55-f635c151d550 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:09.835638 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3309cd4b-72ee-42f6-ab55-f635c151d550 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:09.835863 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9e35c-d1a3-4c25-af00-edf57988f69a None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:09.847888 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 432/878] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:43:09.849172 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761baa3-97c9-430b-a582-90a057dd98d7 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:09.849491 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761baa3-97c9-430b-a582-90a057dd98d7 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:09.849757 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761baa3-97c9-430b-a582-90a057dd98d7 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:09.851213 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 433/879] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:43:09.852836 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761baa3-97c9-430b-a582-90a057dd98d7 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:09.877805 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da29ce-f2e4-4073-a0d8-f0f80ac444d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:09.878672 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da29ce-f2e4-4073-a0d8-f0f80ac444d3 None admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:09.878951 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da29ce-f2e4-4073-a0d8-f0f80ac444d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:09.879222 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da29ce-f2e4-4073-a0d8-f0f80ac444d3 None admin] PATH_INFO: `/v3/services` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:09.879879 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da29ce-f2e4-4073-a0d8-f0f80ac444d3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:09.881786 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da29ce-f2e4-4073-a0d8-f0f80ac444d3 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:09.897487 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:09.905222 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 447/880] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Sep 26 17:43:09 2022] POST /identity/v3/services => generated 251 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 17:43:09.906684 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7ac9b-7821-4b6b-b610-9acf0535d9fe None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:09.906975 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7ac9b-7821-4b6b-b610-9acf0535d9fe None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:09.907251 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7ac9b-7821-4b6b-b610-9acf0535d9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:09.935422 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-87c7ac9b-7821-4b6b-b610-9acf0535d9fe None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:09.937599 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-87c7ac9b-7821-4b6b-b610-9acf0535d9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:10.005375 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761baa3-97c9-430b-a582-90a057dd98d7 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:10.045263 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 448/881] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:09 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:43:10.056906 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec2410-efac-4b3e-b81b-42c01403d67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:10.057596 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec2410-efac-4b3e-b81b-42c01403d67b None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:10.057875 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec2410-efac-4b3e-b81b-42c01403d67b None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:10.058144 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec2410-efac-4b3e-b81b-42c01403d67b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:10.066612 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ec2410-efac-4b3e-b81b-42c01403d67b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:10.068624 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ec2410-efac-4b3e-b81b-42c01403d67b None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:10.081485 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-15ec2410-efac-4b3e-b81b-42c01403d67b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 17:43:10.081485 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:10.081485 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:10.081485 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:10.081485 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:10.081485 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:10.081485 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:10.081485 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:10.081485 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:10.081485 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:10.081485 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:10.081485 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:10.081485 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 17:43:10.081485 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 17:43:10.081485 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 17:43:10.081485 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 17:43:10.082460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:10.082460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:10.082460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 17:43:10.082460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:43:10.082460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 17:43:10.082460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:43:10.082460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:10.082460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:10.082460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:10.082460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:10.082460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:10.082460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:10.082460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:10.082460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:10.082460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:10.082460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:10.082460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:10.082460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:10.083422 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:10.083422 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:10.083422 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 17:43:10.083422 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 17:43:10.083422 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 17:43:10.083422 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 17:43:10.083422 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 17:43:10.083422 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 17:43:10.083422 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 17:43:10.083422 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:10.083422 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 434/882] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Sep 26 17:43:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:10.092802 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7ac9b-7821-4b6b-b610-9acf0535d9fe None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:10.148756 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:10.208365 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7ac9b-7821-4b6b-b610-9acf0535d9fe None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:10.245895 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75c88b-b901-4d78-a352-8ab228a066c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:10.246785 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75c88b-b901-4d78-a352-8ab228a066c5 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:10.247217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75c88b-b901-4d78-a352-8ab228a066c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:10.247641 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75c88b-b901-4d78-a352-8ab228a066c5 None admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:10.248525 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75c88b-b901-4d78-a352-8ab228a066c5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:10.248987 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75c88b-b901-4d78-a352-8ab228a066c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:10.250579 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75c88b-b901-4d78-a352-8ab228a066c5 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:10.269846 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 449/883] 10.222.0.62 () {56 vars in 1149 bytes} [Mon Sep 26 17:43:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:10.275920 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec2410-efac-4b3e-b81b-42c01403d67b None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:10.302905 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47d978-ed17-464b-a7b8-a4b0ffddb409 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:10.303230 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47d978-ed17-464b-a7b8-a4b0ffddb409 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:10.303470 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47d978-ed17-464b-a7b8-a4b0ffddb409 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:10.308658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 450/884] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 17:43:10.310213 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0f17b-02c6-424c-ace4-a4d095af47a8 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:10.310504 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0f17b-02c6-424c-ace4-a4d095af47a8 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:10.310777 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0f17b-02c6-424c-ace4-a4d095af47a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:10.329710 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-0dd0f17b-02c6-424c-ace4-a4d095af47a8 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:10.331194 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-0dd0f17b-02c6-424c-ace4-a4d095af47a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:10.376381 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:10.393846 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec2410-efac-4b3e-b81b-42c01403d67b None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:10.409076 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 451/885] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:10 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 17:43:10.409814 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0f17b-02c6-424c-ace4-a4d095af47a8 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:10.433200 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46692e9e-7157-4087-add4-c9581a84b58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:10.434152 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46692e9e-7157-4087-add4-c9581a84b58b None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:10.434665 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46692e9e-7157-4087-add4-c9581a84b58b None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:10.435122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46692e9e-7157-4087-add4-c9581a84b58b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:10.451658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:10.512856 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46692e9e-7157-4087-add4-c9581a84b58b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:10.514445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46692e9e-7157-4087-add4-c9581a84b58b None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:10.527981 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0f17b-02c6-424c-ace4-a4d095af47a8 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:10.563918 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b5871-72e8-408f-8f7f-e37e95659d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:10.564867 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b5871-72e8-408f-8f7f-e37e95659d84 None admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:10.565250 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b5871-72e8-408f-8f7f-e37e95659d84 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:10.565587 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b5871-72e8-408f-8f7f-e37e95659d84 None admin] PATH_INFO: `/v3/services` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:10.566307 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b5871-72e8-408f-8f7f-e37e95659d84 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:10.567737 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b5871-72e8-408f-8f7f-e37e95659d84 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:10.591135 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 452/886] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Sep 26 17:43:10 2022] POST /identity/v3/services => generated 269 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:43:10.623710 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:10.640016 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 435/887] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:43:10 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 17:43:10.646572 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b5871-72e8-408f-8f7f-e37e95659d84 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:10.694378 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46692e9e-7157-4087-add4-c9581a84b58b None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:10.764064 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:10.784570 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b5871-72e8-408f-8f7f-e37e95659d84 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:10.818636 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46692e9e-7157-4087-add4-c9581a84b58b None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:10.832595 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a890c-f7bd-42df-817a-59aa046cf818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:10.833689 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a890c-f7bd-42df-817a-59aa046cf818 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:10.833997 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a890c-f7bd-42df-817a-59aa046cf818 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:10.834277 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a890c-f7bd-42df-817a-59aa046cf818 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:10.847523 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a890c-f7bd-42df-817a-59aa046cf818 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:10.850064 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a890c-f7bd-42df-817a-59aa046cf818 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:10.856710 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112e6c0-92f6-474b-982e-a58ee2a54e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:10.857383 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112e6c0-92f6-474b-982e-a58ee2a54e62 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:10.857656 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112e6c0-92f6-474b-982e-a58ee2a54e62 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:10.857921 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112e6c0-92f6-474b-982e-a58ee2a54e62 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:10.858502 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4112e6c0-92f6-474b-982e-a58ee2a54e62 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:10.859858 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4112e6c0-92f6-474b-982e-a58ee2a54e62 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:10.867540 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-f05a890c-f7bd-42df-817a-59aa046cf818 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:10.867540 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:10.867540 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:10.867540 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:10.867540 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:10.867540 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:10.867540 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:10.867540 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:10.867540 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:10.867540 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:10.867540 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:10.867540 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:10.867540 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:43:10.867540 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:43:10.867540 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:43:10.867540 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:43:10.868556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:10.868556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:10.868556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:10.868556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:10.868556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:10.868556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:10.868556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:10.868556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:10.868556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:10.868556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:10.868556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:10.868556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:10.868556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:10.868556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:10.868556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:10.868556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:10.868556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:43:10.869789 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:43:10.869789 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:10.869789 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:10.869789 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 453/888] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:43:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:10.871001 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-4112e6c0-92f6-474b-982e-a58ee2a54e62 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 17:43:10.871001 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:10.871001 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 17:43:10.871001 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 17:43:10.871001 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 17:43:10.871001 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 17:43:10.871001 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 17:43:10.871001 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:43:10.871001 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 17:43:10.871001 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:10.871001 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 17:43:10.871001 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:10.871001 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:10.871001 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:10.871001 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:10.871001 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:10.871001 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:10.872671 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:10.872671 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:10.872671 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:10.872671 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:10.872671 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:10.872671 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:10.872671 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 17:43:10.872671 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 17:43:10.872671 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 17:43:10.872671 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 17:43:10.872671 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:10.872671 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:10.872671 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:10.872671 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:10.872671 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:10.872671 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:10.874025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:10.874025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:10.874025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:10.874025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:10.874025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:10.874025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:10.874025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:10.874025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:10.874025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:10.874025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:10.874025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 17:43:10.874025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:43:10.874025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 17:43:10.874025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:10.874025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 436/889] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Sep 26 17:43:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:10.874994 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a890c-f7bd-42df-817a-59aa046cf818 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:10.878106 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112e6c0-92f6-474b-982e-a58ee2a54e62 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:10.953919 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:10.989901 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a890c-f7bd-42df-817a-59aa046cf818 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:11.012272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112e6c0-92f6-474b-982e-a58ee2a54e62 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:11.025563 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4068a-664c-40b8-9901-4a01d3063b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:11.026196 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4068a-664c-40b8-9901-4a01d3063b4a None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:11.026668 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4068a-664c-40b8-9901-4a01d3063b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:11.026786 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4068a-664c-40b8-9901-4a01d3063b4a None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:11.027488 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d4068a-664c-40b8-9901-4a01d3063b4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:11.027802 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d4068a-664c-40b8-9901-4a01d3063b4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:11.029222 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d4068a-664c-40b8-9901-4a01d3063b4a None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:11.048377 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 454/890] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:43:11.049569 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4068a-664c-40b8-9901-4a01d3063b4a None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:11.053570 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:11.063006 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d1f56-8097-4bd9-824c-936edf208686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:11.064121 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d1f56-8097-4bd9-824c-936edf208686 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:11.064499 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d1f56-8097-4bd9-824c-936edf208686 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:11.064872 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d1f56-8097-4bd9-824c-936edf208686 None admin] PATH_INFO: `/v3/services` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:11.065624 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d1f56-8097-4bd9-824c-936edf208686 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:11.066302 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d1f56-8097-4bd9-824c-936edf208686 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:11.068102 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d1f56-8097-4bd9-824c-936edf208686 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:11.074860 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 437/891] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Sep 26 17:43:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:43:11.081081 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d1f56-8097-4bd9-824c-936edf208686 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:11.163622 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4068a-664c-40b8-9901-4a01d3063b4a None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:11.200670 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe50cf-10c2-4cd0-bdf5-08c54affdf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:11.202057 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe50cf-10c2-4cd0-bdf5-08c54affdf5b None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:11.202487 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe50cf-10c2-4cd0-bdf5-08c54affdf5b None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:11.202994 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe50cf-10c2-4cd0-bdf5-08c54affdf5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:11.209940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d1f56-8097-4bd9-824c-936edf208686 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:11.211162 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe50cf-10c2-4cd0-bdf5-08c54affdf5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:11.212967 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe50cf-10c2-4cd0-bdf5-08c54affdf5b None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:11.225911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-ecbe50cf-10c2-4cd0-bdf5-08c54affdf5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:43:11.225911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:11.225911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:11.225911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:11.225911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:11.225911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:11.225911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:11.225911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:11.225911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:11.225911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:11.225911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:11.225911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:11.225911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 17:43:11.225911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 17:43:11.225911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 17:43:11.226991 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 17:43:11.226991 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:11.226991 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:11.226991 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:11.226991 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:11.226991 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:11.226991 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:11.226991 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:11.226991 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:11.226991 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:11.226991 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:11.226991 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:11.226991 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:11.226991 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:11.226991 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:11.226991 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:11.226991 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:11.228076 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 17:43:11.228076 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 17:43:11.228076 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 17:43:11.228076 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 17:43:11.228076 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 17:43:11.228076 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 17:43:11.228076 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:43:11.228076 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:11.230142 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 455/892] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:43:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:11.235752 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe50cf-10c2-4cd0-bdf5-08c54affdf5b None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:11.237607 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:11.257608 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5b6c7-5868-4331-b1f1-bdbcedf04d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:11.258210 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5b6c7-5868-4331-b1f1-bdbcedf04d24 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:11.258485 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5b6c7-5868-4331-b1f1-bdbcedf04d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:11.258752 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5b6c7-5868-4331-b1f1-bdbcedf04d24 None admin] PATH_INFO: `/v3/services` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:11.259428 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5b6c7-5868-4331-b1f1-bdbcedf04d24 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:11.259728 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5b6c7-5868-4331-b1f1-bdbcedf04d24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:11.261160 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5b6c7-5868-4331-b1f1-bdbcedf04d24 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:11.266492 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 438/893] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Sep 26 17:43:11 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:43:11.317590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:11.362885 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe50cf-10c2-4cd0-bdf5-08c54affdf5b None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:11.402170 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9535e4-01b7-47dc-8e69-eb50cbad5030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:11.403087 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9535e4-01b7-47dc-8e69-eb50cbad5030 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:11.403520 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9535e4-01b7-47dc-8e69-eb50cbad5030 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:11.403942 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9535e4-01b7-47dc-8e69-eb50cbad5030 None admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:11.404810 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9535e4-01b7-47dc-8e69-eb50cbad5030 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:11.405299 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9535e4-01b7-47dc-8e69-eb50cbad5030 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:11.406914 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9535e4-01b7-47dc-8e69-eb50cbad5030 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:11.422084 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 456/894] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Sep 26 17:43:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:11.428585 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5b6c7-5868-4331-b1f1-bdbcedf04d24 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:11.539335 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5b6c7-5868-4331-b1f1-bdbcedf04d24 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:11.577003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ec096-6605-4230-b202-28c04066601e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:11.577633 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ec096-6605-4230-b202-28c04066601e None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:11.577910 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ec096-6605-4230-b202-28c04066601e None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:11.578182 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ec096-6605-4230-b202-28c04066601e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:11.578906 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ec096-6605-4230-b202-28c04066601e None admin] RBAC: Adding query filter params (role.id=5a55d35da255419c9b63146c84cfaf6f, scope.project.id=125361b23eb14b53aca5e0139919881e, user.id=8475122232ef4d8893f2a9b98768396e) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:11.579211 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ec096-6605-4230-b202-28c04066601e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:11.580767 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ec096-6605-4230-b202-28c04066601e None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:11.586975 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 439/895] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:43:11 2022] GET /identity/v3/role_assignments?user.id=8475122232ef4d8893f2a9b98768396e&scope.project.id=125361b23eb14b53aca5e0139919881e&role.id=5a55d35da255419c9b63146c84cfaf6f => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:12.221625 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeac55f-dd1b-4820-af20-913e3f42e323 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:12.222150 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeac55f-dd1b-4820-af20-913e3f42e323 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:12.222150 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeac55f-dd1b-4820-af20-913e3f42e323 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:12.223737 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 457/896] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:43:12.229667 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4de669-7431-4fce-8732-8c5e83bcdc7b None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:12.230086 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4de669-7431-4fce-8732-8c5e83bcdc7b None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:12.230263 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4de669-7431-4fce-8732-8c5e83bcdc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:12.249937 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-0b4de669-7431-4fce-8732-8c5e83bcdc7b None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:12.251177 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-0b4de669-7431-4fce-8732-8c5e83bcdc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:12.296187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:12.323161 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 440/897] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:12 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:43:12.598391 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeac55f-dd1b-4820-af20-913e3f42e323 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:12.713180 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeac55f-dd1b-4820-af20-913e3f42e323 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:12.741681 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:12.753534 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a0626-f3c9-4df0-b94c-3b95fc4f5559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:12.754199 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a0626-f3c9-4df0-b94c-3b95fc4f5559 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:12.754488 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a0626-f3c9-4df0-b94c-3b95fc4f5559 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:12.754766 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a0626-f3c9-4df0-b94c-3b95fc4f5559 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:12.755365 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a0626-f3c9-4df0-b94c-3b95fc4f5559 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:12.756805 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a0626-f3c9-4df0-b94c-3b95fc4f5559 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:12.766777 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-662a0626-f3c9-4df0-b94c-3b95fc4f5559 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 17:43:12.766777 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:12.766777 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 17:43:12.766777 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 17:43:12.766777 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 17:43:12.766777 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 17:43:12.766777 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 17:43:12.766777 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:43:12.766777 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 17:43:12.766777 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:12.766777 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 17:43:12.766777 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:12.766777 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:12.766777 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:12.766777 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:12.766777 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:12.766777 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:12.767859 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:12.767859 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:12.767859 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:12.767859 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:12.767859 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:12.767859 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:12.767859 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 17:43:12.767859 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 17:43:12.767859 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 17:43:12.767859 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 17:43:12.767859 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:12.767859 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:12.767859 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:12.767859 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:12.767859 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:12.767859 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:12.768690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:12.768690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:12.768690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:12.768690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:12.768690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:12.768690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:12.768690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:12.768690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:12.768690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:12.768690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:12.768690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 17:43:12.768690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:43:12.768690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 17:43:12.768690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:12.768690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 458/898] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Sep 26 17:43:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:12.776455 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4de669-7431-4fce-8732-8c5e83bcdc7b None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:12.889850 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4de669-7431-4fce-8732-8c5e83bcdc7b None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:12.905390 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b014f8-958d-4916-94b0-ee19fcdf2993 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:12.905717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b014f8-958d-4916-94b0-ee19fcdf2993 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:12.905949 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b014f8-958d-4916-94b0-ee19fcdf2993 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:12.908847 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 459/899] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:43:12.913762 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b55b60-0789-485c-b531-28db9f6a59c3 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:12.914103 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b55b60-0789-485c-b531-28db9f6a59c3 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:12.914310 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b55b60-0789-485c-b531-28db9f6a59c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:12.929162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4c25b-1485-4cee-bc11-c4f30ef8277b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:12.929782 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4c25b-1485-4cee-bc11-c4f30ef8277b None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:12.930053 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4c25b-1485-4cee-bc11-c4f30ef8277b None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:12.930316 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4c25b-1485-4cee-bc11-c4f30ef8277b None admin] PATH_INFO: `/v3/services` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:12.930951 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb4c25b-1485-4cee-bc11-c4f30ef8277b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:12.931247 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb4c25b-1485-4cee-bc11-c4f30ef8277b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:12.932723 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb4c25b-1485-4cee-bc11-c4f30ef8277b None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:12.933434 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-42b55b60-0789-485c-b531-28db9f6a59c3 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:12.934702 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-42b55b60-0789-485c-b531-28db9f6a59c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:12.938087 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 441/900] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Sep 26 17:43:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:12.944284 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4c25b-1485-4cee-bc11-c4f30ef8277b None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:12.997421 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:13.017098 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 460/901] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:12 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 17:43:13.058608 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4c25b-1485-4cee-bc11-c4f30ef8277b None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:13.096573 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09b47f-5d02-42df-990f-abfce7b061e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:13.097570 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09b47f-5d02-42df-990f-abfce7b061e8 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:13.098079 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09b47f-5d02-42df-990f-abfce7b061e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:13.098545 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09b47f-5d02-42df-990f-abfce7b061e8 None admin] PATH_INFO: `/v3/services` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:13.099393 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db09b47f-5d02-42df-990f-abfce7b061e8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:13.099898 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db09b47f-5d02-42df-990f-abfce7b061e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:13.101557 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db09b47f-5d02-42df-990f-abfce7b061e8 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:13.107175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 442/902] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Sep 26 17:43:12 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:43:13.113336 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b55b60-0789-485c-b531-28db9f6a59c3 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:13.224022 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b55b60-0789-485c-b531-28db9f6a59c3 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:13.243260 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:13.261471 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c464ab-deb5-4d00-90b9-38429e03a62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:13.262085 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c464ab-deb5-4d00-90b9-38429e03a62a None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:13.262359 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c464ab-deb5-4d00-90b9-38429e03a62a None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:13.262624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c464ab-deb5-4d00-90b9-38429e03a62a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:13.263395 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c464ab-deb5-4d00-90b9-38429e03a62a None admin] RBAC: Adding query filter params (interface=public, service_id=9fe558fe923a43fa8a3ca13377a53106, region_id=RegionOne) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:13.263698 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c464ab-deb5-4d00-90b9-38429e03a62a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:13.265149 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c464ab-deb5-4d00-90b9-38429e03a62a None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:13.273549 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 461/903] 10.222.0.62 () {56 vars in 1251 bytes} [Mon Sep 26 17:43:13 2022] GET /identity/v3/endpoints?service_id=9fe558fe923a43fa8a3ca13377a53106&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:13.279153 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09b47f-5d02-42df-990f-abfce7b061e8 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:13.306993 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c464ab-deb5-4d00-90b9-38429e03a62a None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:13.403109 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09b47f-5d02-42df-990f-abfce7b061e8 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:13.406163 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:13.435767 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c464ab-deb5-4d00-90b9-38429e03a62a None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:13.442218 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576267e8-0991-4d70-a59a-a3b37c6e1e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:13.443489 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576267e8-0991-4d70-a59a-a3b37c6e1e93 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:13.443968 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576267e8-0991-4d70-a59a-a3b37c6e1e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:13.444385 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576267e8-0991-4d70-a59a-a3b37c6e1e93 None admin] PATH_INFO: `/v3/services` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:13.445166 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576267e8-0991-4d70-a59a-a3b37c6e1e93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:13.446725 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576267e8-0991-4d70-a59a-a3b37c6e1e93 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:13.461411 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 443/904] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Sep 26 17:43:13 2022] GET /identity/v3/services => generated 1268 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:43:13.476430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a2b68-48e3-4f9d-b532-3e4d807f500c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:13.477395 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a2b68-48e3-4f9d-b532-3e4d807f500c None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:13.477831 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a2b68-48e3-4f9d-b532-3e4d807f500c None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:13.478248 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a2b68-48e3-4f9d-b532-3e4d807f500c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:13.479020 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a2b68-48e3-4f9d-b532-3e4d807f500c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:13.480617 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a2b68-48e3-4f9d-b532-3e4d807f500c None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:13.491496 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-211a2b68-48e3-4f9d-b532-3e4d807f500c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 17:43:13.491496 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:13.491496 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 17:43:13.491496 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 17:43:13.491496 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 17:43:13.491496 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 17:43:13.491496 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 17:43:13.491496 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:43:13.491496 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 17:43:13.491496 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:13.491496 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 17:43:13.491496 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:13.491496 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:13.491496 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:13.491496 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:13.491496 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:13.492696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:13.492696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:13.492696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:13.492696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:13.492696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:13.492696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:13.492696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:13.492696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 17:43:13.492696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 17:43:13.492696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 17:43:13.492696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 17:43:13.492696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:13.492696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:13.492696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:13.492696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:13.492696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:13.492696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:13.493833 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:13.493833 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:13.493833 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:13.493833 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:13.493833 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:13.493833 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:13.493833 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:13.493833 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:13.493833 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:13.493833 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:13.493833 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 17:43:13.493833 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:43:13.493833 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 17:43:13.493833 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:13.501135 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 462/905] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Sep 26 17:43:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:13.502828 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576267e8-0991-4d70-a59a-a3b37c6e1e93 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:13.511902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c11b3-2164-402b-904a-e0f1b0dbbc17 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:13.512503 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c11b3-2164-402b-904a-e0f1b0dbbc17 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:13.512993 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c11b3-2164-402b-904a-e0f1b0dbbc17 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:13.514930 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 463/906] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 17:43:13.521668 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32903fbf-f207-4b62-895a-83007a09ce2f None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:13.522018 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32903fbf-f207-4b62-895a-83007a09ce2f None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:13.522303 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32903fbf-f207-4b62-895a-83007a09ce2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:13.543259 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-32903fbf-f207-4b62-895a-83007a09ce2f None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:13.544487 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-32903fbf-f207-4b62-895a-83007a09ce2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:13.603006 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:13.629497 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576267e8-0991-4d70-a59a-a3b37c6e1e93 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:13.633478 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 464/907] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:13 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 17:43:13.680164 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c121fff8-eb08-4877-a5dd-3f4fc4f9be40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:13.681200 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121fff8-eb08-4877-a5dd-3f4fc4f9be40 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:13.681707 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121fff8-eb08-4877-a5dd-3f4fc4f9be40 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:13.682209 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121fff8-eb08-4877-a5dd-3f4fc4f9be40 None admin] PATH_INFO: `/v3/services` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:13.683047 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c121fff8-eb08-4877-a5dd-3f4fc4f9be40 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:13.683554 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c121fff8-eb08-4877-a5dd-3f4fc4f9be40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:13.685171 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c121fff8-eb08-4877-a5dd-3f4fc4f9be40 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:13.693673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 444/908] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Sep 26 17:43:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:43:13.698929 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32903fbf-f207-4b62-895a-83007a09ce2f None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:13.817269 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32903fbf-f207-4b62-895a-83007a09ce2f None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:13.853835 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42900523-54cf-4520-8fdc-c50c75786b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:13.854453 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42900523-54cf-4520-8fdc-c50c75786b4a None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:13.854796 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42900523-54cf-4520-8fdc-c50c75786b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:13.855076 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42900523-54cf-4520-8fdc-c50c75786b4a None admin] PATH_INFO: `/v3/services` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:13.855712 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42900523-54cf-4520-8fdc-c50c75786b4a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:13.856016 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42900523-54cf-4520-8fdc-c50c75786b4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:13.857412 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42900523-54cf-4520-8fdc-c50c75786b4a None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:13.862897 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 465/909] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Sep 26 17:43:13 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:13.866598 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de2b2d-b502-41fe-b2a0-c46378d2c9dc None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:13.866879 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de2b2d-b502-41fe-b2a0-c46378d2c9dc None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:13.867144 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de2b2d-b502-41fe-b2a0-c46378d2c9dc None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:13.868870 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 445/910] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:43:13.870003 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42900523-54cf-4520-8fdc-c50c75786b4a None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:13.873794 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeee7d9-56a1-4073-91c1-967c28ca1459 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:13.874088 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeee7d9-56a1-4073-91c1-967c28ca1459 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:13.874348 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeee7d9-56a1-4073-91c1-967c28ca1459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:13.892968 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-4eeee7d9-56a1-4073-91c1-967c28ca1459 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:13.894188 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-4eeee7d9-56a1-4073-91c1-967c28ca1459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:13.919062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:13.923627 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:13.971502 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 446/911] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:13 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 17:43:13.972332 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeee7d9-56a1-4073-91c1-967c28ca1459 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:13.992192 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42900523-54cf-4520-8fdc-c50c75786b4a None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:14.033760 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da8e5c-86b6-4c01-86d7-f85f4a108a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:14.035251 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da8e5c-86b6-4c01-86d7-f85f4a108a6a None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:14.035714 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da8e5c-86b6-4c01-86d7-f85f4a108a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:14.036164 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da8e5c-86b6-4c01-86d7-f85f4a108a6a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:14.037317 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da8e5c-86b6-4c01-86d7-f85f4a108a6a None admin] RBAC: Adding query filter params (interface=public, service_id=60ec8c32ac8c4edba15169ffcfb92206, region_id=RegionOne) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:14.037804 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da8e5c-86b6-4c01-86d7-f85f4a108a6a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:14.039411 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da8e5c-86b6-4c01-86d7-f85f4a108a6a None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:14.045792 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 466/912] 10.222.0.62 () {56 vars in 1251 bytes} [Mon Sep 26 17:43:13 2022] GET /identity/v3/endpoints?service_id=60ec8c32ac8c4edba15169ffcfb92206&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:14.053587 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da8e5c-86b6-4c01-86d7-f85f4a108a6a None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:14.086241 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeee7d9-56a1-4073-91c1-967c28ca1459 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:14.124340 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daaf02b-61f6-4637-95c5-bc97fad6a821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:14.124983 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daaf02b-61f6-4637-95c5-bc97fad6a821 None admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:14.125305 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daaf02b-61f6-4637-95c5-bc97fad6a821 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:14.125580 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daaf02b-61f6-4637-95c5-bc97fad6a821 None admin] PATH_INFO: `/v3/services` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:14.126350 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daaf02b-61f6-4637-95c5-bc97fad6a821 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:14.127848 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daaf02b-61f6-4637-95c5-bc97fad6a821 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:14.153040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 447/913] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Sep 26 17:43:13 2022] POST /identity/v3/services => generated 241 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:43:14.178571 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da8e5c-86b6-4c01-86d7-f85f4a108a6a None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:14.181383 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:14.226256 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9093a9-eb1f-4733-b2d8-1d040ff29336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:14.226892 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9093a9-eb1f-4733-b2d8-1d040ff29336 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:14.227174 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9093a9-eb1f-4733-b2d8-1d040ff29336 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:14.227395 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9093a9-eb1f-4733-b2d8-1d040ff29336 None admin] PATH_INFO: `/v3/services` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:14.228000 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9093a9-eb1f-4733-b2d8-1d040ff29336 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:14.229420 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9093a9-eb1f-4733-b2d8-1d040ff29336 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:14.241204 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 467/914] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Sep 26 17:43:14 2022] GET /identity/v3/services => generated 1497 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:43:14.254143 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daaf02b-61f6-4637-95c5-bc97fad6a821 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:14.285588 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:14.388459 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daaf02b-61f6-4637-95c5-bc97fad6a821 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:14.429810 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea063d-a556-42b1-bda8-ceba96b9e4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:14.430464 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea063d-a556-42b1-bda8-ceba96b9e4b9 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:14.430740 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea063d-a556-42b1-bda8-ceba96b9e4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:14.431014 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea063d-a556-42b1-bda8-ceba96b9e4b9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:14.448985 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea063d-a556-42b1-bda8-ceba96b9e4b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:43:14.457747 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-0fea063d-a556-42b1-bda8-ceba96b9e4b9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 17:43:14.457747 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:14.457747 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:14.457747 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:14.457747 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:14.457747 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:14.457747 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:14.457747 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:14.457747 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:14.457747 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:14.457747 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:14.457747 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:14.457747 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:43:14.457747 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:43:14.457747 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:43:14.457747 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:43:14.459336 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:43:14.459336 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:43:14.459336 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:43:14.459336 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:43:14.459336 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:14.459336 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:14.459336 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:14.459336 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:14.459336 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:14.459336 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:14.459336 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:14.459336 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:14.459336 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:14.459336 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:14.459336 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:14.459336 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:14.460223 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:14.460223 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:14.460223 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:14.460223 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:14.460223 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:43:14.460223 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:43:14.460223 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:43:14.460223 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:43:14.460223 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:43:14.460223 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:43:14.460223 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 17:43:14.460223 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:14.461136 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 448/915] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Sep 26 17:43:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:14.466560 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9093a9-eb1f-4733-b2d8-1d040ff29336 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:14.578016 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9093a9-eb1f-4733-b2d8-1d040ff29336 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:14.613776 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301dac2-652c-4e40-adf2-1ccf3e3c8007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:14.614393 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301dac2-652c-4e40-adf2-1ccf3e3c8007 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:14.615256 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301dac2-652c-4e40-adf2-1ccf3e3c8007 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:14.615542 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301dac2-652c-4e40-adf2-1ccf3e3c8007 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:14.616209 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301dac2-652c-4e40-adf2-1ccf3e3c8007 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:14.616511 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301dac2-652c-4e40-adf2-1ccf3e3c8007 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:14.617898 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301dac2-652c-4e40-adf2-1ccf3e3c8007 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:14.627984 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 468/916] 10.222.0.62 () {56 vars in 1115 bytes} [Mon Sep 26 17:43:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:14.633853 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea063d-a556-42b1-bda8-ceba96b9e4b9 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:14.720133 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:14.739362 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea063d-a556-42b1-bda8-ceba96b9e4b9 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:14.774973 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91b5fe-f9d4-40da-b888-441f3dab30a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:14.775606 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91b5fe-f9d4-40da-b888-441f3dab30a4 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:14.775885 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91b5fe-f9d4-40da-b888-441f3dab30a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:14.776160 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91b5fe-f9d4-40da-b888-441f3dab30a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:14.787299 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91b5fe-f9d4-40da-b888-441f3dab30a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:14.788837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91b5fe-f9d4-40da-b888-441f3dab30a4 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:14.804764 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-3d91b5fe-f9d4-40da-b888-441f3dab30a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:14.804764 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:14.804764 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:14.804764 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:14.804764 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:14.804764 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:14.804764 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:14.804764 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:14.804764 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:14.804764 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:14.804764 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:14.804764 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:14.804764 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:43:14.804764 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:43:14.804764 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:43:14.804764 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:43:14.805789 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:14.805789 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:14.805789 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:14.805789 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:14.805789 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:14.805789 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:14.805789 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:14.805789 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:14.805789 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:14.805789 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:14.805789 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:14.805789 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:14.805789 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:14.805789 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:14.805789 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:14.805789 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:14.805789 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:43:14.806679 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:43:14.806679 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:14.806679 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:14.806679 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 449/917] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:43:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:14.812861 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301dac2-652c-4e40-adf2-1ccf3e3c8007 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:14.841689 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:14.919583 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301dac2-652c-4e40-adf2-1ccf3e3c8007 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:14.956436 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432c60d-d288-4775-86d2-38eb1fb005bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:14.957348 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432c60d-d288-4775-86d2-38eb1fb005bb None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:14.957787 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432c60d-d288-4775-86d2-38eb1fb005bb None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:14.958221 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432c60d-d288-4775-86d2-38eb1fb005bb None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:14.959665 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a432c60d-d288-4775-86d2-38eb1fb005bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:14.960122 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a432c60d-d288-4775-86d2-38eb1fb005bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:14.961669 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a432c60d-d288-4775-86d2-38eb1fb005bb None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:14.974739 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 469/918] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:14.980528 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91b5fe-f9d4-40da-b888-441f3dab30a4 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:15.093092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91b5fe-f9d4-40da-b888-441f3dab30a4 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:15.131157 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70c2ed-e799-44ac-8005-e1a0255c811f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:15.131874 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70c2ed-e799-44ac-8005-e1a0255c811f None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:15.132153 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70c2ed-e799-44ac-8005-e1a0255c811f None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:15.132478 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70c2ed-e799-44ac-8005-e1a0255c811f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:15.134691 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:15.141405 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70c2ed-e799-44ac-8005-e1a0255c811f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:15.143360 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70c2ed-e799-44ac-8005-e1a0255c811f None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:15.156122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-ae70c2ed-e799-44ac-8005-e1a0255c811f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 17:43:15.156122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:15.156122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:15.156122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:15.156122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:15.156122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:15.156122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:15.156122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:15.156122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:15.156122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:15.156122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:15.156122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:15.156122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 17:43:15.156122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 17:43:15.156122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 17:43:15.156122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 17:43:15.157092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:15.157092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:15.157092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 17:43:15.157092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:43:15.157092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 17:43:15.157092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:43:15.157092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:15.157092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:15.157092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:15.157092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:15.157092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:15.157092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:15.157092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:15.157092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:15.157092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:15.157092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:15.157092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:15.157092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:15.158048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:15.158048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:15.158048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 17:43:15.158048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 17:43:15.158048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 17:43:15.158048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 17:43:15.158048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 17:43:15.158048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 17:43:15.158048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 17:43:15.158048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:15.158048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 450/919] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Sep 26 17:43:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:15.164827 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432c60d-d288-4775-86d2-38eb1fb005bb None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:15.258120 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:15.276222 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432c60d-d288-4775-86d2-38eb1fb005bb None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:15.311567 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f482e-1958-4683-ab13-22a7752a9600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:15.312541 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f482e-1958-4683-ab13-22a7752a9600 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:15.313042 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f482e-1958-4683-ab13-22a7752a9600 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:15.313530 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f482e-1958-4683-ab13-22a7752a9600 None admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:15.314530 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f482e-1958-4683-ab13-22a7752a9600 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:15.315039 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f482e-1958-4683-ab13-22a7752a9600 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:15.316758 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f482e-1958-4683-ab13-22a7752a9600 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:15.336521 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 470/920] 10.222.0.62 () {56 vars in 1149 bytes} [Mon Sep 26 17:43:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:15.342376 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70c2ed-e799-44ac-8005-e1a0255c811f None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:15.452720 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70c2ed-e799-44ac-8005-e1a0255c811f None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:15.488386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49017c00-f44c-4ae5-99ba-237fc605eb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:15.489058 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49017c00-f44c-4ae5-99ba-237fc605eb91 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:15.489525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49017c00-f44c-4ae5-99ba-237fc605eb91 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:15.490333 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49017c00-f44c-4ae5-99ba-237fc605eb91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:15.503280 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49017c00-f44c-4ae5-99ba-237fc605eb91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:15.503280 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49017c00-f44c-4ae5-99ba-237fc605eb91 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:15.517845 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-49017c00-f44c-4ae5-99ba-237fc605eb91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:15.517845 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:15.517845 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:15.517845 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:15.517845 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:15.517845 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:15.517845 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:15.517845 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:15.517845 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:15.517845 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:15.517845 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:15.517845 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:15.517845 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:43:15.517845 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:43:15.517845 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:43:15.517845 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:43:15.518938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:15.518938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:15.518938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:15.518938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:15.518938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:15.518938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:15.518938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:15.518938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:15.518938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:15.518938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:15.518938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:15.518938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:15.518938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:15.518938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:15.518938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:15.518938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:15.518938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:43:15.520033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:43:15.520033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:15.520033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:15.522338 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 451/921] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:43:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:15.533072 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f482e-1958-4683-ab13-22a7752a9600 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:15.634047 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f482e-1958-4683-ab13-22a7752a9600 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:15.670039 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7612a-1933-439d-a6e9-e02157a497da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:15.670647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7612a-1933-439d-a6e9-e02157a497da None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:15.670926 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7612a-1933-439d-a6e9-e02157a497da None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:15.671199 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7612a-1933-439d-a6e9-e02157a497da None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:15.671838 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7612a-1933-439d-a6e9-e02157a497da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:15.672140 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7612a-1933-439d-a6e9-e02157a497da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:15.673537 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7612a-1933-439d-a6e9-e02157a497da None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:15.686294 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 471/922] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:15.691805 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49017c00-f44c-4ae5-99ba-237fc605eb91 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:15.747914 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:15.802839 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49017c00-f44c-4ae5-99ba-237fc605eb91 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:15.837933 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c1f68-b2fe-4f44-abff-5a4af61ff834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:15.838567 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c1f68-b2fe-4f44-abff-5a4af61ff834 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:15.838846 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c1f68-b2fe-4f44-abff-5a4af61ff834 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:15.839116 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c1f68-b2fe-4f44-abff-5a4af61ff834 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:15.846198 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c1f68-b2fe-4f44-abff-5a4af61ff834 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:15.846503 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49887fd4-7428-489f-8f8d-dc80033bbc0d None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:15.847008 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49887fd4-7428-489f-8f8d-dc80033bbc0d None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:15.847481 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49887fd4-7428-489f-8f8d-dc80033bbc0d None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:15.847844 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c1f68-b2fe-4f44-abff-5a4af61ff834 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:15.850087 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 472/923] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 17:43:15.855305 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf2474-b8ac-426d-9fa4-28828ee893ae None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:15.855656 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf2474-b8ac-426d-9fa4-28828ee893ae None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:15.856000 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf2474-b8ac-426d-9fa4-28828ee893ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:15.861212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-af3c1f68-b2fe-4f44-abff-5a4af61ff834 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:43:15.861212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:15.861212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:15.861212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:15.861212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:15.861212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:15.861212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:15.861212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:15.861212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:15.861212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:15.861212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:15.861212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:15.861212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 17:43:15.861212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 17:43:15.861212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 17:43:15.862487 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 17:43:15.862487 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:15.862487 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:15.862487 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:15.862487 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:15.862487 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:15.862487 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:15.862487 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:15.862487 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:15.862487 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:15.862487 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:15.862487 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:15.862487 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:15.862487 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:15.862487 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:15.862487 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:15.862487 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:15.863384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 17:43:15.863384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 17:43:15.863384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 17:43:15.863384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 17:43:15.863384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 17:43:15.863384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 17:43:15.863384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:43:15.863384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:15.863813 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:15.865820 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 452/924] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:43:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:15.873987 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c1f68-b2fe-4f44-abff-5a4af61ff834 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:15.881858 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-a1cf2474-b8ac-426d-9fa4-28828ee893ae None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:15.883319 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-a1cf2474-b8ac-426d-9fa4-28828ee893ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:15.973166 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 473/925] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 17:43:15.990166 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c1f68-b2fe-4f44-abff-5a4af61ff834 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:15.997625 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:16.027966 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3e586-187a-45a5-ad99-ebbd4fde9dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:16.028973 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3e586-187a-45a5-ad99-ebbd4fde9dee None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:16.029558 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3e586-187a-45a5-ad99-ebbd4fde9dee None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:16.030051 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3e586-187a-45a5-ad99-ebbd4fde9dee None admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:16.030954 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e3e586-187a-45a5-ad99-ebbd4fde9dee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:16.031460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e3e586-187a-45a5-ad99-ebbd4fde9dee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:16.033287 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e3e586-187a-45a5-ad99-ebbd4fde9dee None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:16.047508 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 453/926] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Sep 26 17:43:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:16.054647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf2474-b8ac-426d-9fa4-28828ee893ae None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:16.160737 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf2474-b8ac-426d-9fa4-28828ee893ae None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:16.196570 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083ecc0-aa4d-40ce-b015-10f6f4d446da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:16.197355 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083ecc0-aa4d-40ce-b015-10f6f4d446da None admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:16.197637 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083ecc0-aa4d-40ce-b015-10f6f4d446da None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:16.197909 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083ecc0-aa4d-40ce-b015-10f6f4d446da None admin] PATH_INFO: `/v3/projects/125361b23eb14b53aca5e0139919881e/users/8475122232ef4d8893f2a9b98768396e/roles/5a55d35da255419c9b63146c84cfaf6f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:16.200056 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083ecc0-aa4d-40ce-b015-10f6f4d446da None admin] RBAC: Authorizing `identity:create_grant(project_id=125361b23eb14b53aca5e0139919881e, user_id=8475122232ef4d8893f2a9b98768396e, role_id=5a55d35da255419c9b63146c84cfaf6f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:16.202224 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083ecc0-aa4d-40ce-b015-10f6f4d446da None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:16.204376 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:16.218926 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 474/927] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Sep 26 17:43:16 2022] PUT /identity/v3/projects/125361b23eb14b53aca5e0139919881e/users/8475122232ef4d8893f2a9b98768396e/roles/5a55d35da255419c9b63146c84cfaf6f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:43:16.270240 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3e586-187a-45a5-ad99-ebbd4fde9dee None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:16.399271 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3e586-187a-45a5-ad99-ebbd4fde9dee None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:16.439385 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986f11a-7434-477b-a74f-efd8943fea8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:16.440014 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986f11a-7434-477b-a74f-efd8943fea8c None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:16.440348 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986f11a-7434-477b-a74f-efd8943fea8c None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:16.440624 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986f11a-7434-477b-a74f-efd8943fea8c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:16.442473 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e986f11a-7434-477b-a74f-efd8943fea8c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:16.442653 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e986f11a-7434-477b-a74f-efd8943fea8c None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:16.454208 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-e986f11a-7434-477b-a74f-efd8943fea8c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 17:43:16.454208 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:16.454208 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 17:43:16.454208 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 17:43:16.454208 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 17:43:16.454208 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 17:43:16.454208 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 17:43:16.454208 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:43:16.454208 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 17:43:16.454208 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:16.454208 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 17:43:16.454208 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:16.454208 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:16.454208 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:16.454208 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:16.454208 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:16.454208 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:16.455260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:16.455260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:16.455260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:16.455260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:16.455260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:16.455260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:16.455260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 17:43:16.455260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 17:43:16.455260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 17:43:16.455260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 17:43:16.455260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:16.455260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:16.455260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:16.455260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:16.455260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:16.455260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:16.456104 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:16.456104 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:16.456104 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:16.456104 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:16.456104 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:16.456104 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:16.456104 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:16.456104 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:16.456104 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:16.456104 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:16.456104 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 17:43:16.456104 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:43:16.456104 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 17:43:16.456104 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:16.456104 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 454/928] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Sep 26 17:43:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:16.463575 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083ecc0-aa4d-40ce-b015-10f6f4d446da None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:16.480237 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de69d83-41e7-404a-a174-8b0b24723e54 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:16.480520 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de69d83-41e7-404a-a174-8b0b24723e54 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:16.480788 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de69d83-41e7-404a-a174-8b0b24723e54 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:16.482183 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 455/929] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 17:43:16.488424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41eb94-1c18-4d30-86ee-2a89bbd7e64c None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:16.488705 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41eb94-1c18-4d30-86ee-2a89bbd7e64c None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:16.488980 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41eb94-1c18-4d30-86ee-2a89bbd7e64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:16.512790 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-8b41eb94-1c18-4d30-86ee-2a89bbd7e64c None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:16.514026 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-8b41eb94-1c18-4d30-86ee-2a89bbd7e64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:16.541536 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:16.585318 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083ecc0-aa4d-40ce-b015-10f6f4d446da None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:16.598136 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 456/930] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 17:43:16.600113 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3850a0f-f759-45f7-91b6-b082035be859 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:16.600535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3850a0f-f759-45f7-91b6-b082035be859 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:16.600949 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3850a0f-f759-45f7-91b6-b082035be859 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:16.606387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 457/931] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:43:16.608209 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d89d6-7d72-4f64-b3ba-9e59c0c8710d None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:16.608490 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d89d6-7d72-4f64-b3ba-9e59c0c8710d None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:16.608757 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d89d6-7d72-4f64-b3ba-9e59c0c8710d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:16.632776 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb7120-79ec-45b8-ab0b-0deb6d986422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:16.633817 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb7120-79ec-45b8-ab0b-0deb6d986422 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:16.634275 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb7120-79ec-45b8-ab0b-0deb6d986422 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:16.634707 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb7120-79ec-45b8-ab0b-0deb6d986422 None admin] PATH_INFO: `/v3/services` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:16.635536 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb7120-79ec-45b8-ab0b-0deb6d986422 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:16.635983 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb7120-79ec-45b8-ab0b-0deb6d986422 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:16.637542 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-369d89d6-7d72-4f64-b3ba-9e59c0c8710d None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:16.637946 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb7120-79ec-45b8-ab0b-0deb6d986422 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:16.638939 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-369d89d6-7d72-4f64-b3ba-9e59c0c8710d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:16.648373 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 475/932] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Sep 26 17:43:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:43:16.649492 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb7120-79ec-45b8-ab0b-0deb6d986422 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:16.721752 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:16.725372 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 458/933] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:43:16.768517 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb7120-79ec-45b8-ab0b-0deb6d986422 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:16.803348 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55d915-3a80-43ab-afb2-492444d48dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:16.804312 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55d915-3a80-43ab-afb2-492444d48dca None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:16.804817 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55d915-3a80-43ab-afb2-492444d48dca None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:16.805305 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55d915-3a80-43ab-afb2-492444d48dca None admin] PATH_INFO: `/v3/services` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:16.806144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac55d915-3a80-43ab-afb2-492444d48dca None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:16.806647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac55d915-3a80-43ab-afb2-492444d48dca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:16.808479 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac55d915-3a80-43ab-afb2-492444d48dca None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:16.813855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 476/934] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Sep 26 17:43:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:16.819781 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d89d6-7d72-4f64-b3ba-9e59c0c8710d None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:16.874320 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55d915-3a80-43ab-afb2-492444d48dca None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:16.932859 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:16.945238 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d89d6-7d72-4f64-b3ba-9e59c0c8710d None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:16.981621 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cfbe6-982c-4fd3-ad2a-7901a858d541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:16.982595 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cfbe6-982c-4fd3-ad2a-7901a858d541 None admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:16.983095 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cfbe6-982c-4fd3-ad2a-7901a858d541 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:16.983561 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cfbe6-982c-4fd3-ad2a-7901a858d541 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:16.984420 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971cfbe6-982c-4fd3-ad2a-7901a858d541 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:16.986803 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971cfbe6-982c-4fd3-ad2a-7901a858d541 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:16.992381 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55d915-3a80-43ab-afb2-492444d48dca None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:17.010674 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 459/935] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:43:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:43:17.011603 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cfbe6-982c-4fd3-ad2a-7901a858d541 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:17.031198 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:17.059214 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055533a-56ad-4dca-9443-11caf9b397d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:17.060341 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055533a-56ad-4dca-9443-11caf9b397d5 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:17.061454 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055533a-56ad-4dca-9443-11caf9b397d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:17.061904 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055533a-56ad-4dca-9443-11caf9b397d5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:17.062717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0055533a-56ad-4dca-9443-11caf9b397d5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:17.064732 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0055533a-56ad-4dca-9443-11caf9b397d5 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:17.079217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-0055533a-56ad-4dca-9443-11caf9b397d5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 17:43:17.079217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:17.079217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 17:43:17.079217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 17:43:17.079217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 17:43:17.079217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 17:43:17.079217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 17:43:17.079217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:43:17.079217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 17:43:17.079217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:17.079217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 17:43:17.079217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:17.079217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:17.079217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:17.079217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:17.079217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:17.079217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:17.080322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:17.080322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:17.080322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:17.080322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:17.080322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:17.080322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:17.080322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 17:43:17.080322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 17:43:17.080322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 17:43:17.080322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 17:43:17.080322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:17.080322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:17.080322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:17.080322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:17.080322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:17.080322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:17.081205 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:17.081205 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:17.081205 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:17.081205 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:17.081205 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:17.081205 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:17.081205 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:17.081205 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:17.081205 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:17.081205 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:17.081205 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 17:43:17.081205 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:43:17.081205 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 17:43:17.081205 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:17.085104 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 477/936] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Sep 26 17:43:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:43:17.087627 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055533a-56ad-4dca-9443-11caf9b397d5 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:17.141144 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cfbe6-982c-4fd3-ad2a-7901a858d541 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:17.180766 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb883b98-22dc-409b-9f84-47d722473082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:17.181922 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb883b98-22dc-409b-9f84-47d722473082 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:17.181922 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb883b98-22dc-409b-9f84-47d722473082 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:17.182202 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb883b98-22dc-409b-9f84-47d722473082 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:17.182781 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb883b98-22dc-409b-9f84-47d722473082 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:17.184393 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb883b98-22dc-409b-9f84-47d722473082 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:17.194458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-fb883b98-22dc-409b-9f84-47d722473082 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 17:43:17.194458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:17.194458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 17:43:17.194458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 17:43:17.194458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 17:43:17.194458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 17:43:17.194458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 17:43:17.194458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:43:17.194458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 17:43:17.194458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:17.194458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 17:43:17.194458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:17.194458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:17.194458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:17.194458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:17.194458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:17.195496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:17.195496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:17.195496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:17.195496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:17.195496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:17.195496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:17.195496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:17.195496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 17:43:17.195496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 17:43:17.195496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 17:43:17.195496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 17:43:17.195496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:17.195496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:17.195496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:17.195496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:17.195496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:17.195496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:17.196398 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:17.196398 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:17.196398 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:17.196398 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:17.196398 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:17.196398 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:17.196398 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:17.196398 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:17.196398 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:17.196398 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:17.196398 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 17:43:17.196398 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:43:17.196398 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 17:43:17.196398 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:17.201329 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 460/937] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Sep 26 17:43:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:17.202316 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb883b98-22dc-409b-9f84-47d722473082 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:17.216347 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:17.240469 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055533a-56ad-4dca-9443-11caf9b397d5 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:17.287460 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d14c8-3850-4926-b394-3f2142953ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:17.288067 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d14c8-3850-4926-b394-3f2142953ece None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:17.288341 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d14c8-3850-4926-b394-3f2142953ece None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:17.288607 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d14c8-3850-4926-b394-3f2142953ece None admin] PATH_INFO: `/v3/services` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:17.289308 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d14c8-3850-4926-b394-3f2142953ece None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:17.289604 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d14c8-3850-4926-b394-3f2142953ece None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:17.290958 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d14c8-3850-4926-b394-3f2142953ece None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:17.296089 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 478/938] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Sep 26 17:43:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:17.301602 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d14c8-3850-4926-b394-3f2142953ece None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:17.336691 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb883b98-22dc-409b-9f84-47d722473082 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:17.358966 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:17.389507 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff793d2-965d-467c-8015-a8770462befb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:17.390119 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff793d2-965d-467c-8015-a8770462befb None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:17.390395 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff793d2-965d-467c-8015-a8770462befb None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:17.390662 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff793d2-965d-467c-8015-a8770462befb None admin] PATH_INFO: `/v3/services` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:17.391295 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff793d2-965d-467c-8015-a8770462befb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:17.391593 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff793d2-965d-467c-8015-a8770462befb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:17.397266 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff793d2-965d-467c-8015-a8770462befb None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:17.404570 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 461/939] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Sep 26 17:43:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:17.410249 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff793d2-965d-467c-8015-a8770462befb None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:17.426050 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d14c8-3850-4926-b394-3f2142953ece None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:17.466924 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6e076-190d-4380-924c-366904a7c67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:17.467541 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6e076-190d-4380-924c-366904a7c67d None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:17.467708 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6e076-190d-4380-924c-366904a7c67d None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:17.467977 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6e076-190d-4380-924c-366904a7c67d None admin] PATH_INFO: `/v3/services` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:17.468600 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6e076-190d-4380-924c-366904a7c67d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:17.468896 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6e076-190d-4380-924c-366904a7c67d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:17.470278 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6e076-190d-4380-924c-366904a7c67d None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:17.476356 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 479/940] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Sep 26 17:43:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:43:17.482284 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6e076-190d-4380-924c-366904a7c67d None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:17.513449 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:17.543424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff793d2-965d-467c-8015-a8770462befb None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:17.581936 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024febf-3be1-479f-adf0-35847effd2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:17.582971 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024febf-3be1-479f-adf0-35847effd2af None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:17.585292 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024febf-3be1-479f-adf0-35847effd2af None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:17.585544 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024febf-3be1-479f-adf0-35847effd2af None admin] PATH_INFO: `/v3/services` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:17.586352 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a024febf-3be1-479f-adf0-35847effd2af None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:17.586675 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a024febf-3be1-479f-adf0-35847effd2af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:17.588048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a024febf-3be1-479f-adf0-35847effd2af None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:17.594936 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 462/941] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Sep 26 17:43:17 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:17.600281 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024febf-3be1-479f-adf0-35847effd2af None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:17.605885 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6e076-190d-4380-924c-366904a7c67d None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:17.617433 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:17.646341 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b1888-4343-4a86-89a1-2572f0d79abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:17.646964 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b1888-4343-4a86-89a1-2572f0d79abd None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:17.647253 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b1888-4343-4a86-89a1-2572f0d79abd None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:17.647529 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b1888-4343-4a86-89a1-2572f0d79abd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:17.648233 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b1888-4343-4a86-89a1-2572f0d79abd None admin] RBAC: Adding query filter params (interface=public, service_id=ed5969a305a5485db9d486b32dad5df7, region_id=RegionOne) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:17.648542 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b1888-4343-4a86-89a1-2572f0d79abd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:17.649949 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b1888-4343-4a86-89a1-2572f0d79abd None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:17.655758 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 480/942] 10.222.0.62 () {56 vars in 1251 bytes} [Mon Sep 26 17:43:17 2022] GET /identity/v3/endpoints?service_id=ed5969a305a5485db9d486b32dad5df7&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:17.661379 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b1888-4343-4a86-89a1-2572f0d79abd None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:17.732380 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024febf-3be1-479f-adf0-35847effd2af None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:17.768347 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd62617-c077-43f6-b4d5-46c718b9d187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:17.769287 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd62617-c077-43f6-b4d5-46c718b9d187 None admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:17.769739 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd62617-c077-43f6-b4d5-46c718b9d187 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:17.770153 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd62617-c077-43f6-b4d5-46c718b9d187 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:17.771465 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd62617-c077-43f6-b4d5-46c718b9d187 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:17.772975 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd62617-c077-43f6-b4d5-46c718b9d187 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:17.781860 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:17.787054 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b1888-4343-4a86-89a1-2572f0d79abd None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:17.799781 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 463/943] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:43:17 2022] POST /identity/v3/endpoints => generated 347 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 17:43:17.834298 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf11c2c-f63c-4822-8923-ffa258f11eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:17.835026 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf11c2c-f63c-4822-8923-ffa258f11eaf None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:17.835363 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf11c2c-f63c-4822-8923-ffa258f11eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:17.835716 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf11c2c-f63c-4822-8923-ffa258f11eaf None admin] PATH_INFO: `/v3/services` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:17.836402 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf11c2c-f63c-4822-8923-ffa258f11eaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:17.837900 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf11c2c-f63c-4822-8923-ffa258f11eaf None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:17.845267 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 481/944] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Sep 26 17:43:17 2022] GET /identity/v3/services => generated 1497 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 17:43:18.510165 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e74523-dc9d-4a91-b26b-4a813ba0bf23 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:18.510677 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e74523-dc9d-4a91-b26b-4a813ba0bf23 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:18.510755 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e74523-dc9d-4a91-b26b-4a813ba0bf23 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:18.512310 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 464/945] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:43:18.517998 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df7c19-27c4-444c-8a16-d16c71a7373d None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:18.518458 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df7c19-27c4-444c-8a16-d16c71a7373d None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:18.518545 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df7c19-27c4-444c-8a16-d16c71a7373d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:18.538496 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-81df7c19-27c4-444c-8a16-d16c71a7373d None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:18.539694 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-81df7c19-27c4-444c-8a16-d16c71a7373d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:18.572970 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:18.621135 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 482/946] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:43:18.888578 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e74523-dc9d-4a91-b26b-4a813ba0bf23 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:19.000054 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e74523-dc9d-4a91-b26b-4a813ba0bf23 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:19.034517 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d727891-0eef-4015-abee-48e6ef5b058d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:19.035494 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d727891-0eef-4015-abee-48e6ef5b058d None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:19.035995 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d727891-0eef-4015-abee-48e6ef5b058d None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:19.036516 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d727891-0eef-4015-abee-48e6ef5b058d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:19.047755 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d727891-0eef-4015-abee-48e6ef5b058d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:43:19.053130 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-3d727891-0eef-4015-abee-48e6ef5b058d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 17:43:19.053130 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:19.053130 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:19.053130 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:19.053130 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:19.053130 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:19.053130 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:19.053130 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:19.053130 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:19.053130 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:19.053130 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:19.053130 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:19.053130 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:43:19.053130 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:43:19.053130 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:43:19.053130 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:43:19.054113 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:43:19.054113 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:43:19.054113 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:43:19.054113 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:43:19.054113 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:19.054113 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:19.054113 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:19.054113 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:19.054113 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:19.054113 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:19.054113 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:19.054113 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:19.054113 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:19.054113 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:19.054113 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:19.054113 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:19.054940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:19.054940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:19.054940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:19.054940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:19.054940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:43:19.054940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:43:19.054940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:43:19.054940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:43:19.054940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:43:19.054940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:43:19.054940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 17:43:19.054940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:19.057662 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 465/947] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Sep 26 17:43:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:19.065213 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df7c19-27c4-444c-8a16-d16c71a7373d None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:19.166826 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df7c19-27c4-444c-8a16-d16c71a7373d None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:19.207424 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c501404-9fa5-43d1-9d08-cd4e3051379b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:19.208036 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c501404-9fa5-43d1-9d08-cd4e3051379b None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:19.208353 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c501404-9fa5-43d1-9d08-cd4e3051379b None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:19.208624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c501404-9fa5-43d1-9d08-cd4e3051379b None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:19.209380 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c501404-9fa5-43d1-9d08-cd4e3051379b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:19.209680 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c501404-9fa5-43d1-9d08-cd4e3051379b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:19.211040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c501404-9fa5-43d1-9d08-cd4e3051379b None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:19.219750 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 483/948] 10.222.0.62 () {56 vars in 1115 bytes} [Mon Sep 26 17:43:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:19.225385 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d727891-0eef-4015-abee-48e6ef5b058d None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:19.297069 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:19.346849 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d727891-0eef-4015-abee-48e6ef5b058d None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:19.386414 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7bc93-8357-4c55-afa3-355d31c08d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:19.387249 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7bc93-8357-4c55-afa3-355d31c08d2c None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:19.388076 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7bc93-8357-4c55-afa3-355d31c08d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:19.388479 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7bc93-8357-4c55-afa3-355d31c08d2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:19.390758 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1bf3b-dd1d-4bf8-b738-cb5a44db1b63 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:19.391188 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1bf3b-dd1d-4bf8-b738-cb5a44db1b63 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:19.391602 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1bf3b-dd1d-4bf8-b738-cb5a44db1b63 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:19.393096 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 484/949] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 17:43:19.400477 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064b1d6-398a-4e2f-af49-7fb88f45e868 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:19.400878 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064b1d6-398a-4e2f-af49-7fb88f45e868 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:19.401302 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064b1d6-398a-4e2f-af49-7fb88f45e868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:19.405216 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee7bc93-8357-4c55-afa3-355d31c08d2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:19.406972 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee7bc93-8357-4c55-afa3-355d31c08d2c None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:19.423364 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-6064b1d6-398a-4e2f-af49-7fb88f45e868 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:19.424728 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-6064b1d6-398a-4e2f-af49-7fb88f45e868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:19.426299 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-9ee7bc93-8357-4c55-afa3-355d31c08d2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:19.426299 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:19.426299 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:19.426299 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:19.426299 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:19.426299 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:19.426299 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:19.426299 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:19.426299 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:19.426299 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:19.426299 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:19.426299 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:19.426299 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:43:19.426299 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:43:19.426299 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:43:19.426299 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:43:19.427773 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:19.427773 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:19.427773 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:19.427773 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:19.427773 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:19.427773 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:19.427773 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:19.427773 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:19.427773 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:19.427773 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:19.427773 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:19.427773 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:19.427773 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:19.427773 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:19.427773 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:19.427773 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:19.427773 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:43:19.428655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:43:19.428655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:19.428655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:19.435236 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 466/950] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:43:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:19.436633 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7bc93-8357-4c55-afa3-355d31c08d2c None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:19.449627 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:19.509109 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 485/951] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 17:43:19.554687 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7bc93-8357-4c55-afa3-355d31c08d2c None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:19.562549 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:19.591827 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e9f83-f3c8-4f35-96e4-91dcfff19033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:19.592878 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e9f83-f3c8-4f35-96e4-91dcfff19033 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:19.593410 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e9f83-f3c8-4f35-96e4-91dcfff19033 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:19.594038 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e9f83-f3c8-4f35-96e4-91dcfff19033 None admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:19.594890 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e9f83-f3c8-4f35-96e4-91dcfff19033 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:19.595388 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e9f83-f3c8-4f35-96e4-91dcfff19033 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:19.597098 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e9f83-f3c8-4f35-96e4-91dcfff19033 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:19.614098 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 467/952] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:43:19.616558 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064b1d6-398a-4e2f-af49-7fb88f45e868 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:19.722310 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064b1d6-398a-4e2f-af49-7fb88f45e868 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:19.759453 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410da2d-8811-4235-a82b-05a394c6b406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:19.760466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410da2d-8811-4235-a82b-05a394c6b406 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:19.760947 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410da2d-8811-4235-a82b-05a394c6b406 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:19.761473 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410da2d-8811-4235-a82b-05a394c6b406 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:19.769120 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9410da2d-8811-4235-a82b-05a394c6b406 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:19.770869 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9410da2d-8811-4235-a82b-05a394c6b406 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:19.778376 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e9f83-f3c8-4f35-96e4-91dcfff19033 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:19.784756 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-9410da2d-8811-4235-a82b-05a394c6b406 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 17:43:19.784756 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:19.784756 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:19.784756 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:19.784756 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:19.784756 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:19.784756 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:19.784756 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:19.784756 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:19.784756 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:19.784756 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:19.784756 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:19.784756 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 17:43:19.784756 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 17:43:19.784756 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 17:43:19.784756 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 17:43:19.785722 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:19.785722 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:19.785722 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 17:43:19.785722 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:43:19.785722 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 17:43:19.785722 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:43:19.785722 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:19.785722 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:19.785722 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:19.785722 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:19.785722 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:19.785722 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:19.785722 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:19.785722 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:19.785722 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:19.785722 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:19.785722 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:19.785722 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:19.787210 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:19.787210 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:19.787210 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 17:43:19.787210 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 17:43:19.787210 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 17:43:19.787210 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 17:43:19.787210 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 17:43:19.787210 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 17:43:19.787210 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 17:43:19.787210 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:19.794774 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 486/953] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Sep 26 17:43:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:19.796735 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410da2d-8811-4235-a82b-05a394c6b406 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:19.815554 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:19.904037 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410da2d-8811-4235-a82b-05a394c6b406 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:19.922013 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e9f83-f3c8-4f35-96e4-91dcfff19033 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:19.943659 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067337e-0852-41ab-944f-2df17e1a760c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:19.944270 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067337e-0852-41ab-944f-2df17e1a760c None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:19.944555 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067337e-0852-41ab-944f-2df17e1a760c None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:19.944831 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067337e-0852-41ab-944f-2df17e1a760c None admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:19.945628 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067337e-0852-41ab-944f-2df17e1a760c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:19.945901 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067337e-0852-41ab-944f-2df17e1a760c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:19.947348 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067337e-0852-41ab-944f-2df17e1a760c None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:19.970339 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 487/954] 10.222.0.62 () {56 vars in 1149 bytes} [Mon Sep 26 17:43:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:19.972212 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067337e-0852-41ab-944f-2df17e1a760c None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:19.972511 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa3b09-b467-4e9a-8d87-490769dc2fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:19.973119 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa3b09-b467-4e9a-8d87-490769dc2fe2 None admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:19.973402 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa3b09-b467-4e9a-8d87-490769dc2fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:19.973678 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa3b09-b467-4e9a-8d87-490769dc2fe2 None admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:19.974514 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaa3b09-b467-4e9a-8d87-490769dc2fe2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:19.975985 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaa3b09-b467-4e9a-8d87-490769dc2fe2 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:19.978709 dv-cinder-859318-1-smb devstack@keystone.service[81278]: WARNING keystone.server.flask.common [None req-feaa3b09-b467-4e9a-8d87-490769dc2fe2 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 26 17:43:20.000260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.sql.core [None req-feaa3b09-b467-4e9a-8d87-490769dc2fe2 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 26 17:43:20.000260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 26 17:43:20.000260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [parameters: {'id': '7f0062f062ea469ba330f28a783de172', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 26 17:43:20.000260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81278) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 26 17:43:20.018258 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-feaa3b09-b467-4e9a-8d87-490769dc2fe2 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7f0062f062ea469ba330f28a783de172.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7f0062f062ea469ba330f28a783de172. Sep 26 17:43:20.018258 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:20.018258 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 26 17:43:20.018258 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 26 17:43:20.018258 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 26 17:43:20.018258 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 26 17:43:20.018258 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 26 17:43:20.018258 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application result = self._query(query) Sep 26 17:43:20.018258 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 26 17:43:20.018258 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application conn.query(q) Sep 26 17:43:20.018258 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 26 17:43:20.018258 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 26 17:43:20.018258 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 26 17:43:20.019175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application result.read() Sep 26 17:43:20.019175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 26 17:43:20.019175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 26 17:43:20.019175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 26 17:43:20.019175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 26 17:43:20.019175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 26 17:43:20.019175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 26 17:43:20.019175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 26 17:43:20.019175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 26 17:43:20.019175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 26 17:43:20.019175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:20.019175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 26 17:43:20.019175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:20.019175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:20.019175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 26 17:43:20.019175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 26 17:43:20.019175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 26 17:43:20.019175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 26 17:43:20.020122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 26 17:43:20.020122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application next(self.gen) Sep 26 17:43:20.020122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 26 17:43:20.020122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application yield resource Sep 26 17:43:20.020122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 26 17:43:20.020122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application next(self.gen) Sep 26 17:43:20.020122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 26 17:43:20.020122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application self.session.rollback() Sep 26 17:43:20.020122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 26 17:43:20.020122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application self.force_reraise() Sep 26 17:43:20.020122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 26 17:43:20.020122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise self.value Sep 26 17:43:20.020122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 26 17:43:20.020122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 26 17:43:20.020122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 26 17:43:20.020122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application session.commit() Sep 26 17:43:20.020122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 26 17:43:20.022245 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 26 17:43:20.022245 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 26 17:43:20.022245 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application self._prepare_impl() Sep 26 17:43:20.022245 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 26 17:43:20.022245 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application self.session.flush() Sep 26 17:43:20.022245 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 26 17:43:20.022245 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application self._flush(objects) Sep 26 17:43:20.022245 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 26 17:43:20.022245 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 26 17:43:20.022245 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 26 17:43:20.022245 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application compat.raise_( Sep 26 17:43:20.022245 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 26 17:43:20.022245 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception Sep 26 17:43:20.022245 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 26 17:43:20.022245 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application flush_context.execute() Sep 26 17:43:20.022245 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 26 17:43:20.022245 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rec.execute(self) Sep 26 17:43:20.023162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 26 17:43:20.023162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 26 17:43:20.023162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 26 17:43:20.023162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 26 17:43:20.023162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 26 17:43:20.023162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 26 17:43:20.023162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 26 17:43:20.023162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 26 17:43:20.023162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 26 17:43:20.023162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 26 17:43:20.023162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 26 17:43:20.023162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 26 17:43:20.023162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 26 17:43:20.023162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 26 17:43:20.023162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 26 17:43:20.023945 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 26 17:43:20.023945 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 26 17:43:20.023945 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception Sep 26 17:43:20.023945 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 26 17:43:20.023945 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 26 17:43:20.023945 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 26 17:43:20.023945 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 26 17:43:20.023945 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 26 17:43:20.023945 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application result = self._query(query) Sep 26 17:43:20.023945 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 26 17:43:20.023945 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application conn.query(q) Sep 26 17:43:20.023945 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 26 17:43:20.023945 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 26 17:43:20.023945 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 26 17:43:20.023945 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application result.read() Sep 26 17:43:20.023945 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 26 17:43:20.023945 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 26 17:43:20.026782 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 26 17:43:20.026782 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 26 17:43:20.026782 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 26 17:43:20.026782 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 26 17:43:20.026782 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 26 17:43:20.026782 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 26 17:43:20.026782 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 26 17:43:20.026782 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 26 17:43:20.026782 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [parameters: {'id': '7f0062f062ea469ba330f28a783de172', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 26 17:43:20.026782 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 26 17:43:20.026782 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:20.026782 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 17:43:20.026782 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:20.026782 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:20.026782 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 26 17:43:20.028758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 26 17:43:20.028758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 26 17:43:20.028758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 26 17:43:20.028758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 26 17:43:20.028758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:20.028758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 17:43:20.028758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:20.028758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:20.028758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:20.028758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:20.028758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:20.028758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:20.028758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:20.028758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:20.028758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:20.028758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:20.028758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:20.032278 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:20.032278 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 26 17:43:20.032278 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 26 17:43:20.032278 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:20.032278 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:20.032278 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 26 17:43:20.032278 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 26 17:43:20.032278 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7f0062f062ea469ba330f28a783de172. Sep 26 17:43:20.032278 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:20.032278 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 468/955] 10.222.0.62 () {60 vars in 1140 bytes} [Mon Sep 26 17:43:19 2022] POST /identity/v3/projects => generated 262 bytes in 242 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:43:20.032278 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa3b09-b467-4e9a-8d87-490769dc2fe2 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:20.058041 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:20.091937 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:20.124977 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067337e-0852-41ab-944f-2df17e1a760c None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:20.143504 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa3b09-b467-4e9a-8d87-490769dc2fe2 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:20.166333 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7916b986-f3d0-4fb5-b27a-6c8189334b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:20.166940 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916b986-f3d0-4fb5-b27a-6c8189334b1b None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:20.167217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916b986-f3d0-4fb5-b27a-6c8189334b1b None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:20.167489 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916b986-f3d0-4fb5-b27a-6c8189334b1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:20.177456 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc362e-0581-4f41-bb4e-8e654f78324e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:20.178086 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc362e-0581-4f41-bb4e-8e654f78324e None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:20.178357 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc362e-0581-4f41-bb4e-8e654f78324e None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:20.178620 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc362e-0581-4f41-bb4e-8e654f78324e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:20.187070 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc362e-0581-4f41-bb4e-8e654f78324e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:20.188708 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc362e-0581-4f41-bb4e-8e654f78324e None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:20.200893 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-b5bc362e-0581-4f41-bb4e-8e654f78324e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:43:20.200893 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:20.200893 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:20.200893 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:20.200893 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:20.200893 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:20.200893 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:20.200893 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:20.200893 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:20.200893 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:20.200893 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:20.200893 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:20.200893 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 17:43:20.200893 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 17:43:20.200893 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 17:43:20.202003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 17:43:20.202003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:20.202003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:20.202003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:20.202003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:20.202003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:20.202003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:20.202003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:20.202003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:20.202003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:20.202003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:20.202003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:20.202003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:20.202003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:20.202003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:20.202003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:20.202003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:20.202960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 17:43:20.202960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 17:43:20.202960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 17:43:20.202960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 17:43:20.202960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 17:43:20.202960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 17:43:20.202960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:43:20.202960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:20.202960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 469/956] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:43:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:43:20.203544 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac6950-8282-4d9b-82c5-9893d03b3480 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:20.203819 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac6950-8282-4d9b-82c5-9893d03b3480 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:20.204089 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac6950-8282-4d9b-82c5-9893d03b3480 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:20.208331 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 470/957] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:43:20.209382 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20162d94-504d-4b53-9485-398c63ab2dc4 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:20.209726 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20162d94-504d-4b53-9485-398c63ab2dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:20.209918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20162d94-504d-4b53-9485-398c63ab2dc4 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:20.213512 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 471/958] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:43:20.213512 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20162d94-504d-4b53-9485-398c63ab2dc4 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:20.243275 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7916b986-f3d0-4fb5-b27a-6c8189334b1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:20.244652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7916b986-f3d0-4fb5-b27a-6c8189334b1b None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:20.297077 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:20.317305 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20162d94-504d-4b53-9485-398c63ab2dc4 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:20.319067 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:20.345193 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 488/959] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:43:19 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 26 17:43:20.346502 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebce04-0286-44ea-8490-89905113c76f None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:20.346783 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebce04-0286-44ea-8490-89905113c76f None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:20.347051 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebce04-0286-44ea-8490-89905113c76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:20.356303 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3935b6ed-b998-4565-a3dc-e1f9aeb00147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:20.356907 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935b6ed-b998-4565-a3dc-e1f9aeb00147 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:20.357218 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935b6ed-b998-4565-a3dc-e1f9aeb00147 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:20.357489 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935b6ed-b998-4565-a3dc-e1f9aeb00147 None admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:20.358146 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3935b6ed-b998-4565-a3dc-e1f9aeb00147 None admin] RBAC: Adding query filter params (name=service) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:20.358446 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3935b6ed-b998-4565-a3dc-e1f9aeb00147 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:20.359867 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3935b6ed-b998-4565-a3dc-e1f9aeb00147 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:20.365140 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-63ebce04-0286-44ea-8490-89905113c76f None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:20.366330 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-63ebce04-0286-44ea-8490-89905113c76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:20.377160 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 472/960] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Sep 26 17:43:20 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:20.378329 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fb960-3c33-47b1-b068-ab67f45db4ff None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:20.378612 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fb960-3c33-47b1-b068-ab67f45db4ff None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:20.378883 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fb960-3c33-47b1-b068-ab67f45db4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:20.401085 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-898fb960-3c33-47b1-b068-ab67f45db4ff None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:20.402987 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-898fb960-3c33-47b1-b068-ab67f45db4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:20.450191 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 489/961] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:43:20.451130 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ebce04-0286-44ea-8490-89905113c76f None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:20.485292 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 473/962] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:43:20.585186 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ebce04-0286-44ea-8490-89905113c76f None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:20.587490 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:20.622080 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b627061-103a-469d-85b1-f34974838412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:20.622797 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b627061-103a-469d-85b1-f34974838412 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:20.623180 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b627061-103a-469d-85b1-f34974838412 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:20.623513 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b627061-103a-469d-85b1-f34974838412 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:20.634569 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b627061-103a-469d-85b1-f34974838412 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:20.636108 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b627061-103a-469d-85b1-f34974838412 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:20.652635 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-2b627061-103a-469d-85b1-f34974838412 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:20.652635 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:20.652635 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:20.652635 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:20.652635 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:20.652635 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:20.652635 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:20.652635 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:20.652635 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:20.652635 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:20.652635 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:20.652635 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:20.652635 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:43:20.652635 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:43:20.652635 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:43:20.652635 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:43:20.653863 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:20.653863 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:20.653863 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:20.653863 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:20.653863 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:20.653863 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:20.653863 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:20.653863 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:20.653863 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:20.653863 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:20.653863 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:20.653863 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:20.653863 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:20.653863 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:20.653863 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:20.653863 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:20.653863 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:43:20.655038 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:43:20.655038 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:20.655038 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:20.655038 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 490/963] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:43:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:20.659916 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898fb960-3c33-47b1-b068-ab67f45db4ff None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:20.734155 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:20.750566 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b627061-103a-469d-85b1-f34974838412 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:20.767370 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898fb960-3c33-47b1-b068-ab67f45db4ff None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:20.806928 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab141fe-616a-45ea-a99e-72d0bc3630a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:20.807777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab141fe-616a-45ea-a99e-72d0bc3630a5 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:20.808232 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab141fe-616a-45ea-a99e-72d0bc3630a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:20.808660 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab141fe-616a-45ea-a99e-72d0bc3630a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:20.809492 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab141fe-616a-45ea-a99e-72d0bc3630a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:20.809954 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab141fe-616a-45ea-a99e-72d0bc3630a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:20.811461 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab141fe-616a-45ea-a99e-72d0bc3630a5 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:20.828285 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 474/964] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:20.829429 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab141fe-616a-45ea-a99e-72d0bc3630a5 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:20.860704 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b627061-103a-469d-85b1-f34974838412 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:20.894543 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3aad02-f5a7-49ef-baad-7c01a094e54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:20.895176 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3aad02-f5a7-49ef-baad-7c01a094e54c None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:20.896106 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3aad02-f5a7-49ef-baad-7c01a094e54c None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:20.896402 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3aad02-f5a7-49ef-baad-7c01a094e54c None admin] PATH_INFO: `/v3/services/compute` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:20.896991 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3aad02-f5a7-49ef-baad-7c01a094e54c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:20.898391 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3aad02-f5a7-49ef-baad-7c01a094e54c None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:20.907040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-1b3aad02-f5a7-49ef-baad-7c01a094e54c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 17:43:20.907040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:20.907040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 17:43:20.907040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 17:43:20.907040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 17:43:20.907040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 17:43:20.907040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 17:43:20.907040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:43:20.907040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 17:43:20.907040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:20.907040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 17:43:20.907040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:20.907040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:20.907040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:20.907040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:20.907040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:20.907040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:20.908375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:20.908375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:20.908375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:20.908375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:20.908375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:20.908375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:20.908375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 17:43:20.908375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 17:43:20.908375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 17:43:20.908375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 17:43:20.908375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:20.908375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:20.908375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:20.908375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:20.908375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:20.908375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:20.909472 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:20.909472 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:20.909472 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:20.909472 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:20.909472 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:20.909472 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:20.909472 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:20.909472 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:20.909472 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:20.909472 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:20.909472 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 17:43:20.909472 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:43:20.909472 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 17:43:20.909472 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:20.913215 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 491/965] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:43:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:43:20.914082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3aad02-f5a7-49ef-baad-7c01a094e54c None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:20.935941 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:20.943655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab141fe-616a-45ea-a99e-72d0bc3630a5 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:20.977024 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:20.983216 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548adeb-efcb-47ab-a6cb-eff2bfe23f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:20.983849 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548adeb-efcb-47ab-a6cb-eff2bfe23f90 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:20.984122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548adeb-efcb-47ab-a6cb-eff2bfe23f90 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:20.984395 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548adeb-efcb-47ab-a6cb-eff2bfe23f90 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:20.984975 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548adeb-efcb-47ab-a6cb-eff2bfe23f90 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:20.986373 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548adeb-efcb-47ab-a6cb-eff2bfe23f90 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:20.995316 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-f548adeb-efcb-47ab-a6cb-eff2bfe23f90 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 17:43:20.995316 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:20.995316 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 17:43:20.995316 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 17:43:20.995316 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 17:43:20.995316 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 17:43:20.995316 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 17:43:20.995316 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:43:20.995316 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 17:43:20.995316 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:20.995316 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 17:43:20.995316 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:20.995316 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:20.995316 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:20.995316 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:20.995316 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:20.995316 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:20.996326 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:20.996326 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:20.996326 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:20.996326 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:20.996326 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:20.996326 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:20.996326 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 17:43:20.996326 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 17:43:20.996326 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 17:43:20.996326 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 17:43:20.996326 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:20.996326 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:20.996326 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:20.996326 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:20.996326 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:20.996326 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:20.997195 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:20.997195 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:20.997195 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:20.997195 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:20.997195 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:20.997195 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:20.997195 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:20.997195 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:20.997195 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:20.997195 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:20.997195 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 17:43:20.997195 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:43:20.997195 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 17:43:20.997195 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:20.997195 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 475/966] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Sep 26 17:43:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:20.998013 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548adeb-efcb-47ab-a6cb-eff2bfe23f90 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:21.027916 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3aad02-f5a7-49ef-baad-7c01a094e54c None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:21.064150 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd54b13-ac69-4cc5-bf41-91aaa209c785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:21.065053 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd54b13-ac69-4cc5-bf41-91aaa209c785 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:21.065655 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd54b13-ac69-4cc5-bf41-91aaa209c785 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:21.065945 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd54b13-ac69-4cc5-bf41-91aaa209c785 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:21.073368 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd54b13-ac69-4cc5-bf41-91aaa209c785 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:21.074799 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd54b13-ac69-4cc5-bf41-91aaa209c785 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:21.087106 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-6dd54b13-ac69-4cc5-bf41-91aaa209c785 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:43:21.087106 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:21.087106 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:21.087106 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:21.087106 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:21.087106 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:21.087106 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:21.087106 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:21.087106 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:21.087106 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:21.087106 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:21.087106 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:21.087106 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 17:43:21.087106 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 17:43:21.087106 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 17:43:21.087986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 17:43:21.087986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:21.087986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:21.087986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:21.087986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:21.087986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:21.087986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:21.087986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:21.087986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:21.087986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:21.087986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:21.087986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:21.087986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:21.087986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:21.087986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:21.087986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:21.087986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:21.088875 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 17:43:21.088875 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 17:43:21.088875 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 17:43:21.088875 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 17:43:21.088875 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 17:43:21.088875 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 17:43:21.088875 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:43:21.088875 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:21.088875 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 492/967] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:43:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:21.089401 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd54b13-ac69-4cc5-bf41-91aaa209c785 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:21.110679 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548adeb-efcb-47ab-a6cb-eff2bfe23f90 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:21.148324 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a88b9-3a88-4e37-ba22-3f921476a421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:21.149264 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a88b9-3a88-4e37-ba22-3f921476a421 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:21.149609 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a88b9-3a88-4e37-ba22-3f921476a421 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:21.149880 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a88b9-3a88-4e37-ba22-3f921476a421 None admin] PATH_INFO: `/v3/services` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:21.150555 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737a88b9-3a88-4e37-ba22-3f921476a421 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:21.150801 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737a88b9-3a88-4e37-ba22-3f921476a421 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:21.152164 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737a88b9-3a88-4e37-ba22-3f921476a421 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:21.157359 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 476/968] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Sep 26 17:43:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:21.158150 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a88b9-3a88-4e37-ba22-3f921476a421 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:21.183062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:21.205644 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd54b13-ac69-4cc5-bf41-91aaa209c785 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:21.222417 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:21.239270 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4e707-a2d0-4fa8-a5b5-b136b4e3db57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:21.239881 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4e707-a2d0-4fa8-a5b5-b136b4e3db57 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:21.240165 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4e707-a2d0-4fa8-a5b5-b136b4e3db57 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:21.240430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4e707-a2d0-4fa8-a5b5-b136b4e3db57 None admin] PATH_INFO: `/v3/services` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:21.241088 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c4e707-a2d0-4fa8-a5b5-b136b4e3db57 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:21.241393 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c4e707-a2d0-4fa8-a5b5-b136b4e3db57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:21.242745 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c4e707-a2d0-4fa8-a5b5-b136b4e3db57 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:21.252060 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 493/969] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Sep 26 17:43:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:21.252060 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4e707-a2d0-4fa8-a5b5-b136b4e3db57 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:21.272595 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a88b9-3a88-4e37-ba22-3f921476a421 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:21.308164 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ee210-a5eb-43d3-bbbd-0acdf62ec0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:21.309261 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ee210-a5eb-43d3-bbbd-0acdf62ec0f4 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:21.309712 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ee210-a5eb-43d3-bbbd-0acdf62ec0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:21.310134 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ee210-a5eb-43d3-bbbd-0acdf62ec0f4 None admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:21.310958 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ee210-a5eb-43d3-bbbd-0acdf62ec0f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:21.311404 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ee210-a5eb-43d3-bbbd-0acdf62ec0f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:21.313143 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ee210-a5eb-43d3-bbbd-0acdf62ec0f4 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:21.326226 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 477/970] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Sep 26 17:43:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:21.327272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ee210-a5eb-43d3-bbbd-0acdf62ec0f4 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:21.353256 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4e707-a2d0-4fa8-a5b5-b136b4e3db57 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:21.396463 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d73b06-add2-4a1a-ac2c-635466a9cfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:21.397100 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d73b06-add2-4a1a-ac2c-635466a9cfcc None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:21.397379 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d73b06-add2-4a1a-ac2c-635466a9cfcc None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:21.397646 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d73b06-add2-4a1a-ac2c-635466a9cfcc None admin] PATH_INFO: `/v3/services` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:21.398269 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d73b06-add2-4a1a-ac2c-635466a9cfcc None admin] RBAC: Adding query filter params (type=compute) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:21.398793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d73b06-add2-4a1a-ac2c-635466a9cfcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:21.400416 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d73b06-add2-4a1a-ac2c-635466a9cfcc None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:21.413037 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 494/971] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Sep 26 17:43:21 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:21.413037 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d73b06-add2-4a1a-ac2c-635466a9cfcc None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:21.423681 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:21.465549 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ee210-a5eb-43d3-bbbd-0acdf62ec0f4 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:21.498351 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:21.519125 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01093c27-8e6b-4181-b123-d3f907b0f285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:21.519852 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01093c27-8e6b-4181-b123-d3f907b0f285 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:21.521193 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01093c27-8e6b-4181-b123-d3f907b0f285 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:21.522751 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01093c27-8e6b-4181-b123-d3f907b0f285 None admin] PATH_INFO: `/v3/services` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:21.523417 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01093c27-8e6b-4181-b123-d3f907b0f285 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:21.523728 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01093c27-8e6b-4181-b123-d3f907b0f285 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:21.525166 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01093c27-8e6b-4181-b123-d3f907b0f285 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:21.530942 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 478/972] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Sep 26 17:43:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:21.538038 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01093c27-8e6b-4181-b123-d3f907b0f285 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:21.539798 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d73b06-add2-4a1a-ac2c-635466a9cfcc None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:21.588017 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d2e0d-2c87-4312-8114-40792d871e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:21.589367 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d2e0d-2c87-4312-8114-40792d871e60 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:21.589643 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d2e0d-2c87-4312-8114-40792d871e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:21.589910 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d2e0d-2c87-4312-8114-40792d871e60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:21.590816 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d2e0d-2c87-4312-8114-40792d871e60 None admin] RBAC: Adding query filter params (role.id=5a55d35da255419c9b63146c84cfaf6f, scope.project.id=125361b23eb14b53aca5e0139919881e, user.id=8475122232ef4d8893f2a9b98768396e) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:21.591126 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d2e0d-2c87-4312-8114-40792d871e60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:21.592958 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d2e0d-2c87-4312-8114-40792d871e60 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:21.600703 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 495/973] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:43:21 2022] GET /identity/v3/role_assignments?user.id=8475122232ef4d8893f2a9b98768396e&scope.project.id=125361b23eb14b53aca5e0139919881e&role.id=5a55d35da255419c9b63146c84cfaf6f => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:21.666483 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01093c27-8e6b-4181-b123-d3f907b0f285 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:21.706965 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb1814-0334-4e98-8997-ca42c7324f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:21.707584 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb1814-0334-4e98-8997-ca42c7324f6a None admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:21.707858 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb1814-0334-4e98-8997-ca42c7324f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:21.708166 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb1814-0334-4e98-8997-ca42c7324f6a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:21.708844 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffb1814-0334-4e98-8997-ca42c7324f6a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:21.710273 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffb1814-0334-4e98-8997-ca42c7324f6a None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:21.734380 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 479/974] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:43:21 2022] POST /identity/v3/endpoints => generated 349 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:43:22.675093 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280710e-73a5-45ce-b11e-992a94acb69d None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:22.675600 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280710e-73a5-45ce-b11e-992a94acb69d None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:22.675707 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280710e-73a5-45ce-b11e-992a94acb69d None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:22.677385 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 496/975] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:43:22.682781 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512385b-176d-41df-b5ad-6c3757f541eb None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:22.683198 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512385b-176d-41df-b5ad-6c3757f541eb None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:22.683409 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512385b-176d-41df-b5ad-6c3757f541eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:22.702486 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-e512385b-176d-41df-b5ad-6c3757f541eb None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:22.703715 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-e512385b-176d-41df-b5ad-6c3757f541eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:22.738819 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:22.780748 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 480/976] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:43:23.058029 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c280710e-73a5-45ce-b11e-992a94acb69d None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:23.133351 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:23.166013 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c280710e-73a5-45ce-b11e-992a94acb69d None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:23.200676 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07922f-c9b9-4c36-af61-85a7910980b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:23.201412 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07922f-c9b9-4c36-af61-85a7910980b8 None admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:23.201693 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07922f-c9b9-4c36-af61-85a7910980b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:23.201967 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07922f-c9b9-4c36-af61-85a7910980b8 None admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:23.202610 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc07922f-c9b9-4c36-af61-85a7910980b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:23.204045 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc07922f-c9b9-4c36-af61-85a7910980b8 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:23.206844 dv-cinder-859318-1-smb devstack@keystone.service[81277]: WARNING keystone.server.flask.common [None req-fc07922f-c9b9-4c36-af61-85a7910980b8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 26 17:43:23.221441 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.sql.core [None req-fc07922f-c9b9-4c36-af61-85a7910980b8 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 26 17:43:23.221441 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 26 17:43:23.221441 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [parameters: {'user_id': 'fd020278085c4da19fd2f4e815c4606b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 26 17:43:23.221441 dv-cinder-859318-1-smb devstack@keystone.service[81277]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81277) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 26 17:43:23.229294 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-fc07922f-c9b9-4c36-af61-85a7910980b8 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 26 17:43:23.229294 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:23.229294 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 26 17:43:23.229294 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 26 17:43:23.229294 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 26 17:43:23.229294 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 26 17:43:23.229294 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 26 17:43:23.229294 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application result = self._query(query) Sep 26 17:43:23.229294 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 26 17:43:23.229294 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application conn.query(q) Sep 26 17:43:23.229294 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 26 17:43:23.229294 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 26 17:43:23.229294 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 26 17:43:23.229294 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application result.read() Sep 26 17:43:23.229294 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 26 17:43:23.230175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 26 17:43:23.230175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 26 17:43:23.230175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 26 17:43:23.230175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 26 17:43:23.230175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 26 17:43:23.230175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 26 17:43:23.230175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 26 17:43:23.230175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 26 17:43:23.230175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:23.230175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 26 17:43:23.230175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:23.230175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:23.230175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 26 17:43:23.230175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 26 17:43:23.230175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 26 17:43:23.230175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 26 17:43:23.230175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 26 17:43:23.230175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application next(self.gen) Sep 26 17:43:23.231134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 26 17:43:23.231134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application yield resource Sep 26 17:43:23.231134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 26 17:43:23.231134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application next(self.gen) Sep 26 17:43:23.231134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 26 17:43:23.231134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self.session.rollback() Sep 26 17:43:23.231134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 26 17:43:23.231134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self.force_reraise() Sep 26 17:43:23.231134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 26 17:43:23.231134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise self.value Sep 26 17:43:23.231134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 26 17:43:23.231134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 26 17:43:23.231134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 26 17:43:23.231134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application session.commit() Sep 26 17:43:23.231134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 26 17:43:23.231134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 26 17:43:23.231134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 26 17:43:23.232031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self._prepare_impl() Sep 26 17:43:23.232031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 26 17:43:23.232031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self.session.flush() Sep 26 17:43:23.232031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 26 17:43:23.232031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self._flush(objects) Sep 26 17:43:23.232031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 26 17:43:23.232031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 26 17:43:23.232031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 26 17:43:23.232031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application compat.raise_( Sep 26 17:43:23.232031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 26 17:43:23.232031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception Sep 26 17:43:23.232031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 26 17:43:23.232031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application flush_context.execute() Sep 26 17:43:23.232031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 26 17:43:23.232031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rec.execute(self) Sep 26 17:43:23.232031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 26 17:43:23.232031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 26 17:43:23.232928 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 26 17:43:23.232928 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 26 17:43:23.232928 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 26 17:43:23.232928 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 26 17:43:23.232928 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 26 17:43:23.232928 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 26 17:43:23.232928 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 26 17:43:23.232928 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 26 17:43:23.232928 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 26 17:43:23.232928 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 26 17:43:23.232928 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 26 17:43:23.232928 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 26 17:43:23.232928 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 26 17:43:23.232928 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 26 17:43:23.232928 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 26 17:43:23.232928 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception Sep 26 17:43:23.235545 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 26 17:43:23.235545 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 26 17:43:23.235545 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 26 17:43:23.235545 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 26 17:43:23.235545 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 26 17:43:23.235545 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application result = self._query(query) Sep 26 17:43:23.235545 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 26 17:43:23.235545 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application conn.query(q) Sep 26 17:43:23.235545 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 26 17:43:23.235545 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 26 17:43:23.235545 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 26 17:43:23.235545 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application result.read() Sep 26 17:43:23.235545 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 26 17:43:23.235545 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 26 17:43:23.235545 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 26 17:43:23.235545 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 26 17:43:23.237634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 26 17:43:23.237634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 26 17:43:23.237634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 26 17:43:23.237634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 26 17:43:23.237634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 26 17:43:23.237634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 26 17:43:23.237634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [parameters: {'user_id': 'fd020278085c4da19fd2f4e815c4606b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 26 17:43:23.237634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 26 17:43:23.237634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:23.237634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 17:43:23.237634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:23.237634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:23.237634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:23.237634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:23.237634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:23.239665 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:23.239665 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:23.239665 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:23.239665 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:23.239665 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:23.239665 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:23.239665 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:23.239665 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 26 17:43:23.239665 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 26 17:43:23.239665 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:23.239665 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:23.239665 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 17:43:23.239665 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:43:23.239665 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 17:43:23.239665 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:43:23.239665 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 26 17:43:23.239665 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 26 17:43:23.245641 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 26 17:43:23.245641 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 26 17:43:23.245641 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 26 17:43:23.245641 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 26 17:43:23.245641 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 26 17:43:23.245641 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:23.245641 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 497/977] 10.222.0.62 () {60 vars in 1131 bytes} [Mon Sep 26 17:43:23 2022] POST /identity/v3/users => generated 160 bytes in 173 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:23.246043 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512385b-176d-41df-b5ad-6c3757f541eb None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:23.356586 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512385b-176d-41df-b5ad-6c3757f541eb None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:23.398999 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca6a9a2-2b3f-417d-83aa-df05b06a5abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:23.400045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6a9a2-2b3f-417d-83aa-df05b06a5abd None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:23.400605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6a9a2-2b3f-417d-83aa-df05b06a5abd None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:23.401125 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6a9a2-2b3f-417d-83aa-df05b06a5abd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:23.409475 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca6a9a2-2b3f-417d-83aa-df05b06a5abd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:23.411849 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca6a9a2-2b3f-417d-83aa-df05b06a5abd None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:23.425384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-fca6a9a2-2b3f-417d-83aa-df05b06a5abd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 17:43:23.425384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:23.425384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:23.425384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:23.425384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:23.425384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:23.425384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:23.425384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:23.425384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:23.425384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:23.425384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:23.425384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:23.425384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 17:43:23.425384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 17:43:23.425384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 17:43:23.425384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 17:43:23.426434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:23.426434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:23.426434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 17:43:23.426434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:43:23.426434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 17:43:23.426434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:43:23.426434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:23.426434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:23.426434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:23.426434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:23.426434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:23.426434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:23.426434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:23.426434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:23.426434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:23.426434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:23.426434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:23.426434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:23.427960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:23.427960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:23.427960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 17:43:23.427960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 17:43:23.427960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 17:43:23.427960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 17:43:23.427960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 17:43:23.427960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 17:43:23.427960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 17:43:23.427960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:23.430583 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 481/978] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:43:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:43:23.436807 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07922f-c9b9-4c36-af61-85a7910980b8 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:23.542309 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07922f-c9b9-4c36-af61-85a7910980b8 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:23.579026 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12541133-e6cb-4979-aa0c-013ea370e925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:23.579733 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12541133-e6cb-4979-aa0c-013ea370e925 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:23.580134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12541133-e6cb-4979-aa0c-013ea370e925 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:23.580486 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12541133-e6cb-4979-aa0c-013ea370e925 None admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:23.581234 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12541133-e6cb-4979-aa0c-013ea370e925 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:23.581544 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12541133-e6cb-4979-aa0c-013ea370e925 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:23.583274 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12541133-e6cb-4979-aa0c-013ea370e925 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:23.585146 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:23.625344 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 498/979] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Sep 26 17:43:23 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:23.819349 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30fe40-3511-43e0-a064-6734366ca8e1 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:23.820878 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30fe40-3511-43e0-a064-6734366ca8e1 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:23.820878 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30fe40-3511-43e0-a064-6734366ca8e1 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:23.822718 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 482/980] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:43:23.829090 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0c68e-510f-421b-a93d-6cba86fe2001 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:23.830089 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0c68e-510f-421b-a93d-6cba86fe2001 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:23.830604 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0c68e-510f-421b-a93d-6cba86fe2001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:23.855763 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-c8a0c68e-510f-421b-a93d-6cba86fe2001 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:23.857804 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-c8a0c68e-510f-421b-a93d-6cba86fe2001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:23.862235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8dfd9-6436-43d5-88b3-0f372b9b7986 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:23.862518 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8dfd9-6436-43d5-88b3-0f372b9b7986 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:23.862791 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8dfd9-6436-43d5-88b3-0f372b9b7986 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:23.864973 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 483/981] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:43:23.871600 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e09da-bb58-4cd8-b7b7-e9191f152959 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:23.871994 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e09da-bb58-4cd8-b7b7-e9191f152959 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:23.872267 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e09da-bb58-4cd8-b7b7-e9191f152959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:23.894142 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-d97e09da-bb58-4cd8-b7b7-e9191f152959 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:23.895268 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-d97e09da-bb58-4cd8-b7b7-e9191f152959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:23.923138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:23.950831 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 499/982] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:43:23.951737 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855164d3-05b8-4793-be22-f9721414de63 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:23.952023 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855164d3-05b8-4793-be22-f9721414de63 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:23.952299 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855164d3-05b8-4793-be22-f9721414de63 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:23.953731 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 500/983] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:43:23.959029 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c129fa-7287-4ba9-ada3-af2ad9164d21 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:23.959257 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c129fa-7287-4ba9-ada3-af2ad9164d21 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:23.959526 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c129fa-7287-4ba9-ada3-af2ad9164d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:23.979937 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-a2c129fa-7287-4ba9-ada3-af2ad9164d21 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:23.981520 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-a2c129fa-7287-4ba9-ada3-af2ad9164d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:23.988352 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 484/984] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:43:24.049758 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 501/985] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 17:43:24.226072 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e09da-bb58-4cd8-b7b7-e9191f152959 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:24.257996 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c129fa-7287-4ba9-ada3-af2ad9164d21 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:24.314840 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:24.329240 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e09da-bb58-4cd8-b7b7-e9191f152959 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:24.362770 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad956d-bd8e-4d17-b0af-04e1ce88d6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:24.363367 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad956d-bd8e-4d17-b0af-04e1ce88d6c2 None admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:24.363644 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad956d-bd8e-4d17-b0af-04e1ce88d6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:24.363782 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c129fa-7287-4ba9-ada3-af2ad9164d21 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:24.363911 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad956d-bd8e-4d17-b0af-04e1ce88d6c2 None admin] PATH_INFO: `/v3/services` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:24.364619 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad956d-bd8e-4d17-b0af-04e1ce88d6c2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:24.366043 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad956d-bd8e-4d17-b0af-04e1ce88d6c2 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:24.380722 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 485/986] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Sep 26 17:43:24 2022] POST /identity/v3/services => generated 242 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:43:24.381877 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad956d-bd8e-4d17-b0af-04e1ce88d6c2 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:24.404913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:24.418212 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18509a9-a032-4974-be95-0ce987970e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:24.419214 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18509a9-a032-4974-be95-0ce987970e60 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:24.419726 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18509a9-a032-4974-be95-0ce987970e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:24.420290 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18509a9-a032-4974-be95-0ce987970e60 None admin] PATH_INFO: `/v3/services/image` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:24.420921 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18509a9-a032-4974-be95-0ce987970e60 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:24.422439 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18509a9-a032-4974-be95-0ce987970e60 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:24.433845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-b18509a9-a032-4974-be95-0ce987970e60 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 17:43:24.433845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:24.433845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 17:43:24.433845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 17:43:24.433845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 17:43:24.433845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 17:43:24.433845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 17:43:24.433845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:43:24.433845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 17:43:24.433845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:24.433845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 17:43:24.433845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:24.433845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:24.433845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:24.433845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:24.433845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:24.433845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:24.435036 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:24.435036 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:24.435036 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:24.435036 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:24.435036 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:24.435036 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:24.435036 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 17:43:24.435036 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 17:43:24.435036 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 17:43:24.435036 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 17:43:24.435036 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:24.435036 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:24.435036 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:24.435036 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:24.435036 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:24.435036 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:24.436568 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:24.436568 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:24.436568 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:24.436568 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:24.436568 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:24.436568 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:24.436568 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:24.436568 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:24.436568 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:24.436568 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:24.436568 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 17:43:24.436568 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:43:24.436568 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 17:43:24.436568 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:24.436568 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 502/987] 10.222.0.62 () {56 vars in 1105 bytes} [Mon Sep 26 17:43:24 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:43:24.441299 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18509a9-a032-4974-be95-0ce987970e60 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:24.501649 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad956d-bd8e-4d17-b0af-04e1ce88d6c2 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:24.542144 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30face-beb5-436a-bcb4-7bd6a0a50d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:24.542817 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30face-beb5-436a-bcb4-7bd6a0a50d00 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:24.543090 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30face-beb5-436a-bcb4-7bd6a0a50d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:24.543418 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30face-beb5-436a-bcb4-7bd6a0a50d00 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:24.544012 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30face-beb5-436a-bcb4-7bd6a0a50d00 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:24.545462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30face-beb5-436a-bcb4-7bd6a0a50d00 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:24.555188 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-cd30face-beb5-436a-bcb4-7bd6a0a50d00 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 17:43:24.555188 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:24.555188 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 17:43:24.555188 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 17:43:24.555188 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 17:43:24.555188 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 17:43:24.555188 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 17:43:24.555188 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:43:24.555188 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 17:43:24.555188 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:24.555188 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 17:43:24.555188 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:24.555188 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:24.555188 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:24.555188 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:24.555188 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:24.555188 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:24.556390 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:24.556390 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:24.556390 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:24.556390 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:24.556390 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:24.556390 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:24.556390 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 17:43:24.556390 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 17:43:24.556390 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 17:43:24.556390 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 17:43:24.556390 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:24.556390 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:24.556390 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:24.556390 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:24.556390 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:24.556390 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:24.557489 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:24.557489 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:24.557489 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:24.557489 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:24.557489 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:24.557489 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:24.557489 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:24.557489 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:24.557489 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:24.557489 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:24.557489 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 17:43:24.557489 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:43:24.557489 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 17:43:24.557489 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:24.558409 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18509a9-a032-4974-be95-0ce987970e60 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:24.558495 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 486/988] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Sep 26 17:43:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:24.562295 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30face-beb5-436a-bcb4-7bd6a0a50d00 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:24.571349 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:24.597363 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcaf2db-cd12-473f-a00a-e5c38f1aa708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:24.597975 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcaf2db-cd12-473f-a00a-e5c38f1aa708 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:24.598254 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcaf2db-cd12-473f-a00a-e5c38f1aa708 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:24.598869 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcaf2db-cd12-473f-a00a-e5c38f1aa708 None admin] PATH_INFO: `/v3/services` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:24.599504 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcaf2db-cd12-473f-a00a-e5c38f1aa708 None admin] RBAC: Adding query filter params (name=image) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:24.599804 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcaf2db-cd12-473f-a00a-e5c38f1aa708 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:24.602135 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcaf2db-cd12-473f-a00a-e5c38f1aa708 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:24.606494 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 503/989] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:43:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:43:24.612049 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcaf2db-cd12-473f-a00a-e5c38f1aa708 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:24.653036 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:24.674564 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30face-beb5-436a-bcb4-7bd6a0a50d00 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:24.711212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347051e-9e0b-413e-9f21-5db0a84ab60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:24.711819 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347051e-9e0b-413e-9f21-5db0a84ab60b None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:24.712100 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347051e-9e0b-413e-9f21-5db0a84ab60b None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:24.712367 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347051e-9e0b-413e-9f21-5db0a84ab60b None admin] PATH_INFO: `/v3/services` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:24.713001 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9347051e-9e0b-413e-9f21-5db0a84ab60b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:24.713329 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9347051e-9e0b-413e-9f21-5db0a84ab60b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:24.714684 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9347051e-9e0b-413e-9f21-5db0a84ab60b None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:24.718488 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcaf2db-cd12-473f-a00a-e5c38f1aa708 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:24.719834 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 487/990] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Sep 26 17:43:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:43:24.725872 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347051e-9e0b-413e-9f21-5db0a84ab60b None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:24.758732 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a28eb-f236-49d4-b83a-40bee8d0716e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:24.759255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a28eb-f236-49d4-b83a-40bee8d0716e None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:24.759533 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a28eb-f236-49d4-b83a-40bee8d0716e None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:24.759801 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a28eb-f236-49d4-b83a-40bee8d0716e None admin] PATH_INFO: `/v3/services` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:24.760508 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a28eb-f236-49d4-b83a-40bee8d0716e None admin] RBAC: Adding query filter params (type=image) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:24.760722 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a28eb-f236-49d4-b83a-40bee8d0716e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:24.762373 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a28eb-f236-49d4-b83a-40bee8d0716e None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:24.766905 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 504/991] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:43:24 2022] GET /identity/v3/services?type=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:43:24.835542 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347051e-9e0b-413e-9f21-5db0a84ab60b None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:24.873349 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d52a62-1adf-46cf-926a-367e892e507a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:24.873975 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d52a62-1adf-46cf-926a-367e892e507a None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:24.874252 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d52a62-1adf-46cf-926a-367e892e507a None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:24.874522 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d52a62-1adf-46cf-926a-367e892e507a None admin] PATH_INFO: `/v3/services` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:24.875161 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d52a62-1adf-46cf-926a-367e892e507a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:24.875465 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d52a62-1adf-46cf-926a-367e892e507a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:24.876865 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d52a62-1adf-46cf-926a-367e892e507a None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:24.882652 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 488/992] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Sep 26 17:43:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:43:24.888316 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a28eb-f236-49d4-b83a-40bee8d0716e None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:24.934094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:24.996516 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a28eb-f236-49d4-b83a-40bee8d0716e None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:25.030738 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f980b60-e8ed-486a-8131-ad91071d4443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:25.031271 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f980b60-e8ed-486a-8131-ad91071d4443 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:25.031549 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f980b60-e8ed-486a-8131-ad91071d4443 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:25.031822 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f980b60-e8ed-486a-8131-ad91071d4443 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:25.032606 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f980b60-e8ed-486a-8131-ad91071d4443 None admin] RBAC: Adding query filter params (interface=admin, service_id=ed5969a305a5485db9d486b32dad5df7, region_id=RegionOne) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:25.032916 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f980b60-e8ed-486a-8131-ad91071d4443 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:25.034301 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f980b60-e8ed-486a-8131-ad91071d4443 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:25.039584 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 505/993] 10.222.0.62 () {56 vars in 1249 bytes} [Mon Sep 26 17:43:24 2022] GET /identity/v3/endpoints?service_id=ed5969a305a5485db9d486b32dad5df7&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:25.045072 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d52a62-1adf-46cf-926a-367e892e507a None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:25.056991 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:25.150371 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d52a62-1adf-46cf-926a-367e892e507a None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:25.184870 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df44fe6-dd88-4de2-b880-c121dd0d9d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:25.185500 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df44fe6-dd88-4de2-b880-c121dd0d9d77 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:25.185777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df44fe6-dd88-4de2-b880-c121dd0d9d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:25.186044 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df44fe6-dd88-4de2-b880-c121dd0d9d77 None admin] PATH_INFO: `/v3/services` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:25.186642 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df44fe6-dd88-4de2-b880-c121dd0d9d77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:25.188005 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df44fe6-dd88-4de2-b880-c121dd0d9d77 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:25.195321 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 489/994] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Sep 26 17:43:25 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:43:26.585622 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690e922-65ca-404e-946f-0375b5a0bcce None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:26.586143 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690e922-65ca-404e-946f-0375b5a0bcce None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:26.586255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690e922-65ca-404e-946f-0375b5a0bcce None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:26.587687 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 506/995] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:43:26.592666 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93902f38-849f-46d7-8519-8b63122c0a5b None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:26.593063 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93902f38-849f-46d7-8519-8b63122c0a5b None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:26.593249 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93902f38-849f-46d7-8519-8b63122c0a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:26.611755 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-93902f38-849f-46d7-8519-8b63122c0a5b None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:26.612935 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-93902f38-849f-46d7-8519-8b63122c0a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:26.685039 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 490/996] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:26 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:43:26.924589 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e55bbc-b7a3-4ea0-bbb1-f0749b5923c0 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:26.924957 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e55bbc-b7a3-4ea0-bbb1-f0749b5923c0 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:26.925186 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e55bbc-b7a3-4ea0-bbb1-f0749b5923c0 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:26.929056 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 507/997] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:43:26.932450 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f34a57-bd7f-4db4-8b3b-2f04e489c94d None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:26.932733 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f34a57-bd7f-4db4-8b3b-2f04e489c94d None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:26.932998 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f34a57-bd7f-4db4-8b3b-2f04e489c94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:26.939260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:26.953099 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e55bbc-b7a3-4ea0-bbb1-f0749b5923c0 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:26.953917 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-26f34a57-bd7f-4db4-8b3b-2f04e489c94d None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:26.955109 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-26f34a57-bd7f-4db4-8b3b-2f04e489c94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:27.029053 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 491/998] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:26 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:43:27.061551 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e55bbc-b7a3-4ea0-bbb1-f0749b5923c0 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:27.064752 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:27.098209 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9b4cf-d384-48cd-b906-042dcb0b1114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:27.099357 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9b4cf-d384-48cd-b906-042dcb0b1114 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:27.099638 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9b4cf-d384-48cd-b906-042dcb0b1114 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:27.099910 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9b4cf-d384-48cd-b906-042dcb0b1114 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:27.100592 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a9b4cf-d384-48cd-b906-042dcb0b1114 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:27.102076 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a9b4cf-d384-48cd-b906-042dcb0b1114 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:27.111108 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-03a9b4cf-d384-48cd-b906-042dcb0b1114 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 17:43:27.111108 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:27.111108 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 17:43:27.111108 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 17:43:27.111108 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 17:43:27.111108 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 17:43:27.111108 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 17:43:27.111108 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:43:27.111108 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 17:43:27.111108 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:27.111108 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 17:43:27.111108 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:27.111108 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:27.111108 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:27.111108 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:27.111108 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:27.111108 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:27.112094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:27.112094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:27.112094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:27.112094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:27.112094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:27.112094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:27.112094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 17:43:27.112094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 17:43:27.112094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 17:43:27.112094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 17:43:27.112094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:27.112094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:27.112094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:27.112094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:27.112094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:27.112094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:27.112911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:27.112911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:27.112911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:27.112911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:27.112911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:27.112911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:27.112911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:27.112911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:27.112911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:27.112911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:27.112911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 17:43:27.112911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:43:27.112911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 17:43:27.112911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:27.115052 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 508/999] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:43:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:43:27.118747 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f34a57-bd7f-4db4-8b3b-2f04e489c94d None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:27.220536 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f34a57-bd7f-4db4-8b3b-2f04e489c94d None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:27.254952 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:27.261268 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb02d52-d224-4000-8d65-1bdf38a82b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:27.261879 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb02d52-d224-4000-8d65-1bdf38a82b3e None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:27.262152 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb02d52-d224-4000-8d65-1bdf38a82b3e None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:27.262417 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb02d52-d224-4000-8d65-1bdf38a82b3e None admin] PATH_INFO: `/v3/services` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:27.263049 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb02d52-d224-4000-8d65-1bdf38a82b3e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:27.263345 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb02d52-d224-4000-8d65-1bdf38a82b3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:27.264709 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb02d52-d224-4000-8d65-1bdf38a82b3e None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:27.274228 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 492/1000] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Sep 26 17:43:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:27.275745 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9b4cf-d384-48cd-b906-042dcb0b1114 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:27.342530 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb02d52-d224-4000-8d65-1bdf38a82b3e None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:27.384922 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9b4cf-d384-48cd-b906-042dcb0b1114 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:27.420609 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58491d75-3fc9-4295-bb7d-b5f7cc3b94bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:27.421265 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58491d75-3fc9-4295-bb7d-b5f7cc3b94bd None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:27.421548 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58491d75-3fc9-4295-bb7d-b5f7cc3b94bd None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:27.421822 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58491d75-3fc9-4295-bb7d-b5f7cc3b94bd None admin] PATH_INFO: `/v3/services` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:27.422475 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58491d75-3fc9-4295-bb7d-b5f7cc3b94bd None admin] RBAC: Adding query filter params (type=compute) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:27.422780 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58491d75-3fc9-4295-bb7d-b5f7cc3b94bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:27.424180 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58491d75-3fc9-4295-bb7d-b5f7cc3b94bd None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:27.430166 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 509/1001] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Sep 26 17:43:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:27.431213 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7663d-7635-4d7d-a517-c60cc83d80e2 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:27.431496 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7663d-7635-4d7d-a517-c60cc83d80e2 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:27.431770 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7663d-7635-4d7d-a517-c60cc83d80e2 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:27.432975 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 510/1002] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:43:27.435684 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7663d-7635-4d7d-a517-c60cc83d80e2 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:27.458694 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb02d52-d224-4000-8d65-1bdf38a82b3e None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:27.468238 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:27.492487 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4227c-020b-466e-99c5-c15da303fc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:27.493030 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4227c-020b-466e-99c5-c15da303fc72 None admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:27.493327 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4227c-020b-466e-99c5-c15da303fc72 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:27.493602 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4227c-020b-466e-99c5-c15da303fc72 None admin] PATH_INFO: `/v3/services` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:27.494264 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4227c-020b-466e-99c5-c15da303fc72 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:27.495689 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4227c-020b-466e-99c5-c15da303fc72 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:27.511308 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 493/1003] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Sep 26 17:43:27 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 17:43:27.512294 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e571a-fb9b-490f-bf94-e630b45b0221 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:27.512578 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e571a-fb9b-490f-bf94-e630b45b0221 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:27.512849 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e571a-fb9b-490f-bf94-e630b45b0221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:27.534241 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-f17e571a-fb9b-490f-bf94-e630b45b0221 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:27.535527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-f17e571a-fb9b-490f-bf94-e630b45b0221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:27.550841 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7663d-7635-4d7d-a517-c60cc83d80e2 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:27.590570 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff7cdb-3bb3-47f1-9315-dd5dd62918ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:27.591298 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff7cdb-3bb3-47f1-9315-dd5dd62918ec None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:27.591455 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff7cdb-3bb3-47f1-9315-dd5dd62918ec None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:27.591720 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff7cdb-3bb3-47f1-9315-dd5dd62918ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:27.592430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff7cdb-3bb3-47f1-9315-dd5dd62918ec None admin] RBAC: Adding query filter params (interface=public, service_id=2a34357925f540208d27e5ccd407618d, region_id=RegionOne) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:27.592766 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff7cdb-3bb3-47f1-9315-dd5dd62918ec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:27.594190 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff7cdb-3bb3-47f1-9315-dd5dd62918ec None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:27.597446 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:27.601561 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 511/1004] 10.222.0.62 () {56 vars in 1251 bytes} [Mon Sep 26 17:43:27 2022] GET /identity/v3/endpoints?service_id=2a34357925f540208d27e5ccd407618d&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:43:27.607609 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff7cdb-3bb3-47f1-9315-dd5dd62918ec None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:27.618411 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 494/1005] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:27 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:43:27.705884 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:27.717263 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff7cdb-3bb3-47f1-9315-dd5dd62918ec None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:27.750263 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef24304-3683-46eb-86da-928141fb07b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:27.750789 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef24304-3683-46eb-86da-928141fb07b1 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:27.751061 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef24304-3683-46eb-86da-928141fb07b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:27.751328 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef24304-3683-46eb-86da-928141fb07b1 None admin] PATH_INFO: `/v3/services` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:27.751919 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef24304-3683-46eb-86da-928141fb07b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:27.753384 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef24304-3683-46eb-86da-928141fb07b1 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:27.760534 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 512/1006] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Sep 26 17:43:27 2022] GET /identity/v3/services => generated 1957 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 17:43:27.887164 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e571a-fb9b-490f-bf94-e630b45b0221 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:27.997289 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e571a-fb9b-490f-bf94-e630b45b0221 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:28.032663 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc390b-ce09-43ea-b59d-a3b4bcae52c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:28.033231 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc390b-ce09-43ea-b59d-a3b4bcae52c1 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:28.033512 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc390b-ce09-43ea-b59d-a3b4bcae52c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:28.033778 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc390b-ce09-43ea-b59d-a3b4bcae52c1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:28.034357 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc390b-ce09-43ea-b59d-a3b4bcae52c1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:28.035734 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc390b-ce09-43ea-b59d-a3b4bcae52c1 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:28.044927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-49bc390b-ce09-43ea-b59d-a3b4bcae52c1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 17:43:28.044927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:28.044927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 17:43:28.044927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 17:43:28.044927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 17:43:28.044927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 17:43:28.044927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 17:43:28.044927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:43:28.044927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 17:43:28.044927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:28.044927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 17:43:28.044927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:28.044927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:28.044927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:28.044927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:28.044927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:28.044927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:28.045920 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:28.045920 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:28.045920 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:28.045920 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:28.045920 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:28.045920 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:28.045920 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 17:43:28.045920 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 17:43:28.045920 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 17:43:28.045920 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 17:43:28.045920 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:28.045920 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:28.045920 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:28.045920 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:28.045920 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:28.045920 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:28.047318 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:28.047318 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:28.047318 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:28.047318 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:28.047318 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:28.047318 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:28.047318 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:28.047318 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:28.047318 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:28.047318 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:28.047318 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 17:43:28.047318 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:43:28.047318 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 17:43:28.047318 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:28.047318 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 495/1007] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Sep 26 17:43:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:28.052060 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef24304-3683-46eb-86da-928141fb07b1 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:28.152326 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef24304-3683-46eb-86da-928141fb07b1 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:28.186375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf26b9-8f78-4ac6-bfab-1a6af9b0c761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:28.186984 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf26b9-8f78-4ac6-bfab-1a6af9b0c761 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:28.187261 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf26b9-8f78-4ac6-bfab-1a6af9b0c761 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:28.187530 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf26b9-8f78-4ac6-bfab-1a6af9b0c761 None admin] PATH_INFO: `/v3/services` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:28.188152 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf26b9-8f78-4ac6-bfab-1a6af9b0c761 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:28.188452 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf26b9-8f78-4ac6-bfab-1a6af9b0c761 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:28.189847 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf26b9-8f78-4ac6-bfab-1a6af9b0c761 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:28.199925 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 513/1008] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Sep 26 17:43:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:43:28.201452 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc390b-ce09-43ea-b59d-a3b4bcae52c1 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:28.253383 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:28.306584 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc390b-ce09-43ea-b59d-a3b4bcae52c1 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:28.342339 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf14e3e-69da-456a-82b0-ead3736ac2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:28.343185 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf14e3e-69da-456a-82b0-ead3736ac2fb None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:28.343642 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf14e3e-69da-456a-82b0-ead3736ac2fb None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:28.344064 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf14e3e-69da-456a-82b0-ead3736ac2fb None admin] PATH_INFO: `/v3/services` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:28.344845 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf14e3e-69da-456a-82b0-ead3736ac2fb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:28.345320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf14e3e-69da-456a-82b0-ead3736ac2fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:28.346845 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf14e3e-69da-456a-82b0-ead3736ac2fb None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:28.352503 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 496/1009] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Sep 26 17:43:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:28.357855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf26b9-8f78-4ac6-bfab-1a6af9b0c761 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:28.381865 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:28.467973 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf26b9-8f78-4ac6-bfab-1a6af9b0c761 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:28.503375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7789b12-06d2-4261-9847-5edfd176ae2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:28.503989 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7789b12-06d2-4261-9847-5edfd176ae2a None admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:28.504271 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7789b12-06d2-4261-9847-5edfd176ae2a None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:28.505047 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7789b12-06d2-4261-9847-5edfd176ae2a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:28.505721 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7789b12-06d2-4261-9847-5edfd176ae2a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:28.507090 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7789b12-06d2-4261-9847-5edfd176ae2a None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:28.526244 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 514/1010] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:43:28 2022] POST /identity/v3/endpoints => generated 325 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:43:29.713402 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b717a-a73c-4f44-b412-c7d95a3c324a None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:29.713923 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b717a-a73c-4f44-b412-c7d95a3c324a None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:29.713923 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b717a-a73c-4f44-b412-c7d95a3c324a None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:29.715443 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 497/1011] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 17:43:29.720383 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a4528-f807-4979-9183-a498cb9abb9e None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:29.720777 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a4528-f807-4979-9183-a498cb9abb9e None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:29.720938 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a4528-f807-4979-9183-a498cb9abb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:29.740054 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-9c1a4528-f807-4979-9183-a498cb9abb9e None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:29.741255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-9c1a4528-f807-4979-9183-a498cb9abb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:29.821119 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 515/1012] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:29 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:43:29.995092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cc3b5-204f-4454-a761-852ff4f5481a None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:29.995384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cc3b5-204f-4454-a761-852ff4f5481a None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:29.995561 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cc3b5-204f-4454-a761-852ff4f5481a None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:29.997078 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 498/1013] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:43:30.002092 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad88a8-2493-4111-9156-a9dbbc7ce26c None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:30.002378 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad88a8-2493-4111-9156-a9dbbc7ce26c None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:30.002656 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad88a8-2493-4111-9156-a9dbbc7ce26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:30.015442 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:30.022388 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-ffad88a8-2493-4111-9156-a9dbbc7ce26c None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:30.024408 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-ffad88a8-2493-4111-9156-a9dbbc7ce26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:30.088752 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1cc3b5-204f-4454-a761-852ff4f5481a None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:30.096911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 516/1014] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:30 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:43:30.191739 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1cc3b5-204f-4454-a761-852ff4f5481a None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:30.207300 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:30.229369 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343783e3-af1f-4068-9656-8661935ce51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:30.230000 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343783e3-af1f-4068-9656-8661935ce51e None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:30.230277 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343783e3-af1f-4068-9656-8661935ce51e None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:30.230545 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343783e3-af1f-4068-9656-8661935ce51e None admin] PATH_INFO: `/v3/services/image` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:30.231119 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343783e3-af1f-4068-9656-8661935ce51e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:30.232477 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343783e3-af1f-4068-9656-8661935ce51e None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:30.241222 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-343783e3-af1f-4068-9656-8661935ce51e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 17:43:30.241222 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:30.241222 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 17:43:30.241222 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 17:43:30.241222 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 17:43:30.241222 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 17:43:30.241222 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 17:43:30.241222 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:43:30.241222 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 17:43:30.241222 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:30.241222 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 17:43:30.241222 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:30.241222 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:30.241222 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:30.241222 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:30.241222 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:30.241222 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:30.242199 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:30.242199 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:30.242199 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:30.242199 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:30.242199 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:30.242199 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:30.242199 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 17:43:30.242199 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 17:43:30.242199 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 17:43:30.242199 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 17:43:30.242199 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:30.242199 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:30.242199 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:30.242199 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:30.242199 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:30.242199 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:30.243068 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:30.243068 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:30.243068 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:30.243068 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:30.243068 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:30.243068 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:30.243068 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:30.243068 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:30.243068 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:30.243068 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:30.243068 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 17:43:30.243068 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:43:30.243068 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 17:43:30.243068 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:30.247331 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 499/1015] 10.222.0.62 () {56 vars in 1105 bytes} [Mon Sep 26 17:43:30 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:43:30.248123 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad88a8-2493-4111-9156-a9dbbc7ce26c None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:30.347147 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad88a8-2493-4111-9156-a9dbbc7ce26c None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:30.385775 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2cae1d-8f6c-4a69-818c-4932bcdd5d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:30.386405 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cae1d-8f6c-4a69-818c-4932bcdd5d73 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:30.386686 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cae1d-8f6c-4a69-818c-4932bcdd5d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:30.386952 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cae1d-8f6c-4a69-818c-4932bcdd5d73 None admin] PATH_INFO: `/v3/services` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:30.387562 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343783e3-af1f-4068-9656-8661935ce51e None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:30.387670 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2cae1d-8f6c-4a69-818c-4932bcdd5d73 None admin] RBAC: Adding query filter params (name=image) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:30.387876 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2cae1d-8f6c-4a69-818c-4932bcdd5d73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:30.391207 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2cae1d-8f6c-4a69-818c-4932bcdd5d73 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:30.391735 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:30.397054 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 517/1016] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:43:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:30.401308 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2cae1d-8f6c-4a69-818c-4932bcdd5d73 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:30.497934 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343783e3-af1f-4068-9656-8661935ce51e None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:30.505780 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2cae1d-8f6c-4a69-818c-4932bcdd5d73 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:30.532884 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6b30d-1c29-4b3f-b3ef-df8eb9894289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:30.533574 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6b30d-1c29-4b3f-b3ef-df8eb9894289 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:30.533852 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6b30d-1c29-4b3f-b3ef-df8eb9894289 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:30.534124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6b30d-1c29-4b3f-b3ef-df8eb9894289 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:30.534707 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6b30d-1c29-4b3f-b3ef-df8eb9894289 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:30.536685 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6b30d-1c29-4b3f-b3ef-df8eb9894289 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:30.543617 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741fed4a-0dea-46d8-9234-ee1036b27d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:30.544386 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fed4a-0dea-46d8-9234-ee1036b27d65 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:30.544824 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fed4a-0dea-46d8-9234-ee1036b27d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:30.545298 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fed4a-0dea-46d8-9234-ee1036b27d65 None admin] PATH_INFO: `/v3/services` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:30.545519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-1be6b30d-1c29-4b3f-b3ef-df8eb9894289 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 17:43:30.545519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:30.545519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 17:43:30.545519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 17:43:30.545519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 17:43:30.545519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 17:43:30.545519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 17:43:30.545519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:43:30.545519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 17:43:30.545519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:30.545519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 17:43:30.545519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:30.545519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:30.545519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:30.545519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:30.545519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:30.545519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:30.546657 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:30.546657 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:30.546657 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:30.546657 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:30.546657 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:30.546657 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:30.546657 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 17:43:30.546657 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 17:43:30.546657 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 17:43:30.546657 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 17:43:30.546657 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:30.546657 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:30.546657 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:30.546657 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:30.546657 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:30.546657 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:30.547756 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:30.547756 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:30.547756 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:30.547756 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:30.547756 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:30.547756 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:30.547756 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:30.547756 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:30.547756 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:30.547756 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:30.547756 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 17:43:30.547756 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:43:30.547756 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 17:43:30.547756 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:30.549296 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741fed4a-0dea-46d8-9234-ee1036b27d65 None admin] RBAC: Adding query filter params (type=image) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:30.549755 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741fed4a-0dea-46d8-9234-ee1036b27d65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:30.551417 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741fed4a-0dea-46d8-9234-ee1036b27d65 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:30.551630 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 500/1017] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:43:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:43:30.552454 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6b30d-1c29-4b3f-b3ef-df8eb9894289 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:30.558162 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 518/1018] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:43:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:43:30.564201 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741fed4a-0dea-46d8-9234-ee1036b27d65 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:30.602266 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:30.636212 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:30.679820 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6b30d-1c29-4b3f-b3ef-df8eb9894289 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:30.680332 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741fed4a-0dea-46d8-9234-ee1036b27d65 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:30.715754 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eca9d4-2f25-42da-bb62-bc2b5b23b377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:30.716362 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eca9d4-2f25-42da-bb62-bc2b5b23b377 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:30.716474 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ce155-1649-4e35-b489-00089f92f19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:30.716640 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eca9d4-2f25-42da-bb62-bc2b5b23b377 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:30.716912 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eca9d4-2f25-42da-bb62-bc2b5b23b377 None admin] PATH_INFO: `/v3/services` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:30.717060 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ce155-1649-4e35-b489-00089f92f19b None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:30.717344 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ce155-1649-4e35-b489-00089f92f19b None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:30.717576 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eca9d4-2f25-42da-bb62-bc2b5b23b377 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:30.717665 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ce155-1649-4e35-b489-00089f92f19b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:30.717879 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eca9d4-2f25-42da-bb62-bc2b5b23b377 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:30.718298 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ce155-1649-4e35-b489-00089f92f19b None admin] RBAC: Adding query filter params (interface=public, service_id=f877ee566b914de5a5b09bd22066116d, region_id=RegionOne) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:30.718607 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ce155-1649-4e35-b489-00089f92f19b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:30.719245 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eca9d4-2f25-42da-bb62-bc2b5b23b377 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:30.719960 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ce155-1649-4e35-b489-00089f92f19b None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:30.724802 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 501/1019] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Sep 26 17:43:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:30.726098 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 519/1020] 10.222.0.62 () {56 vars in 1251 bytes} [Mon Sep 26 17:43:30 2022] GET /identity/v3/endpoints?service_id=f877ee566b914de5a5b09bd22066116d&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:30.726725 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded835d2-b434-4f23-964b-ce30d01520c7 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:30.727015 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded835d2-b434-4f23-964b-ce30d01520c7 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:30.727290 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded835d2-b434-4f23-964b-ce30d01520c7 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:30.728514 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 502/1021] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:43:30.731335 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded835d2-b434-4f23-964b-ce30d01520c7 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:30.731476 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ce155-1649-4e35-b489-00089f92f19b None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:30.830274 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ce155-1649-4e35-b489-00089f92f19b None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:30.835108 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded835d2-b434-4f23-964b-ce30d01520c7 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:30.842085 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:30.857467 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:30.865941 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9aa42b-ebeb-41e3-abd9-3cc3d16a8a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:30.866541 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9aa42b-ebeb-41e3-abd9-3cc3d16a8a77 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:30.866819 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9aa42b-ebeb-41e3-abd9-3cc3d16a8a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:30.867087 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9aa42b-ebeb-41e3-abd9-3cc3d16a8a77 None admin] PATH_INFO: `/v3/services` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:30.867711 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9aa42b-ebeb-41e3-abd9-3cc3d16a8a77 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:30.868020 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9aa42b-ebeb-41e3-abd9-3cc3d16a8a77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:30.869410 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9aa42b-ebeb-41e3-abd9-3cc3d16a8a77 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:30.869786 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612ca73-4aa7-4387-ac06-16b75adacea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:30.870384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612ca73-4aa7-4387-ac06-16b75adacea8 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:30.870659 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612ca73-4aa7-4387-ac06-16b75adacea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:30.870925 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612ca73-4aa7-4387-ac06-16b75adacea8 None admin] PATH_INFO: `/v3/services` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:30.871518 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612ca73-4aa7-4387-ac06-16b75adacea8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:30.872853 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612ca73-4aa7-4387-ac06-16b75adacea8 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:30.874184 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 520/1022] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Sep 26 17:43:30 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:43:30.875313 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4cc58-7cd8-4d53-8608-1cfb7472e619 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:30.875592 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4cc58-7cd8-4d53-8608-1cfb7472e619 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:30.875924 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4cc58-7cd8-4d53-8608-1cfb7472e619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:30.897038 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 503/1023] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Sep 26 17:43:30 2022] GET /identity/v3/services => generated 1957 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:43:30.897038 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612ca73-4aa7-4387-ac06-16b75adacea8 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:30.897329 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-a2d4cc58-7cd8-4d53-8608-1cfb7472e619 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:30.897329 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-a2d4cc58-7cd8-4d53-8608-1cfb7472e619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:30.970849 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 521/1024] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:30 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:43:30.997211 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612ca73-4aa7-4387-ac06-16b75adacea8 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:31.034137 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb68899-72e7-4683-9632-789fd520fd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:31.034755 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb68899-72e7-4683-9632-789fd520fd7d None admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:31.035081 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb68899-72e7-4683-9632-789fd520fd7d None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:31.035353 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb68899-72e7-4683-9632-789fd520fd7d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:31.036566 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb68899-72e7-4683-9632-789fd520fd7d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:31.038051 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb68899-72e7-4683-9632-789fd520fd7d None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:31.063900 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 504/1025] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:43:30 2022] POST /identity/v3/endpoints => generated 334 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:43:31.240957 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4cc58-7cd8-4d53-8608-1cfb7472e619 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:31.351360 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4cc58-7cd8-4d53-8608-1cfb7472e619 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:31.375360 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:31.399757 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5103995-92d7-4376-86e0-5f34b4d054f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:31.400451 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5103995-92d7-4376-86e0-5f34b4d054f3 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:31.400727 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5103995-92d7-4376-86e0-5f34b4d054f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:31.400992 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5103995-92d7-4376-86e0-5f34b4d054f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:31.402102 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5103995-92d7-4376-86e0-5f34b4d054f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:31.403522 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5103995-92d7-4376-86e0-5f34b4d054f3 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:31.405261 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 522/1026] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:43:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:31.411454 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb68899-72e7-4683-9632-789fd520fd7d None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:31.439201 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:31.514462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb68899-72e7-4683-9632-789fd520fd7d None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:31.548723 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6672138-f56a-4974-ad1a-af3dae906661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:31.549360 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6672138-f56a-4974-ad1a-af3dae906661 None admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:31.549637 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6672138-f56a-4974-ad1a-af3dae906661 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:31.549904 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6672138-f56a-4974-ad1a-af3dae906661 None admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:31.550562 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6672138-f56a-4974-ad1a-af3dae906661 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:31.552026 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6672138-f56a-4974-ad1a-af3dae906661 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:31.580836 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 505/1027] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Sep 26 17:43:31 2022] POST /identity/v3/projects => generated 311 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:43:33.140257 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a28bc-12cc-4053-bc5a-6d2a1f31fff9 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:33.140811 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a28bc-12cc-4053-bc5a-6d2a1f31fff9 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:33.140811 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a28bc-12cc-4053-bc5a-6d2a1f31fff9 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:33.142336 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 523/1028] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:43:33.147963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd79c50-bc9a-4167-9961-5623e017a76a None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:33.148407 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd79c50-bc9a-4167-9961-5623e017a76a None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:33.148578 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd79c50-bc9a-4167-9961-5623e017a76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:33.166714 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-6fd79c50-bc9a-4167-9961-5623e017a76a None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:33.167909 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-6fd79c50-bc9a-4167-9961-5623e017a76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:33.243340 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 506/1029] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:43:33.373811 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000da65-2ebc-47c8-bd90-bf44cd7db1d5 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:33.374156 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000da65-2ebc-47c8-bd90-bf44cd7db1d5 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:33.374352 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000da65-2ebc-47c8-bd90-bf44cd7db1d5 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:33.375828 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 524/1030] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:43:33.385051 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6811f-b7f3-430e-b5c1-301584355adf None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:33.385051 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6811f-b7f3-430e-b5c1-301584355adf None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:33.385051 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6811f-b7f3-430e-b5c1-301584355adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:33.406301 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-4dd6811f-b7f3-430e-b5c1-301584355adf None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:33.407569 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-4dd6811f-b7f3-430e-b5c1-301584355adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:33.409780 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:33.477371 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 507/1031] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:43:33.550832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000da65-2ebc-47c8-bd90-bf44cd7db1d5 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:33.658196 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000da65-2ebc-47c8-bd90-bf44cd7db1d5 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:33.697933 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5214e6-480c-4d45-a25c-3708b9908206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:33.698569 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5214e6-480c-4d45-a25c-3708b9908206 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:33.698843 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5214e6-480c-4d45-a25c-3708b9908206 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:33.699109 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5214e6-480c-4d45-a25c-3708b9908206 None admin] PATH_INFO: `/v3/services/image` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:33.699689 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5214e6-480c-4d45-a25c-3708b9908206 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:33.701349 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5214e6-480c-4d45-a25c-3708b9908206 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:33.710418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-cf5214e6-480c-4d45-a25c-3708b9908206 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 17:43:33.710418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:33.710418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 17:43:33.710418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 17:43:33.710418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 17:43:33.710418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 17:43:33.710418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 17:43:33.710418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:43:33.710418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 17:43:33.710418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:33.710418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 17:43:33.710418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:33.710418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:33.710418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:33.710418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:33.710418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:33.710418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:33.711389 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:33.711389 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:33.711389 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:33.711389 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:33.711389 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:33.711389 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:33.711389 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 17:43:33.711389 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 17:43:33.711389 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 17:43:33.711389 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 17:43:33.711389 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:33.711389 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:33.711389 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:33.711389 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:33.711389 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:33.711389 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:33.712235 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:33.712235 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:33.712235 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:33.712235 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:33.712235 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:33.712235 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:33.712235 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:33.712235 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:33.712235 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:33.712235 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:33.712235 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 17:43:33.712235 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:43:33.712235 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 17:43:33.712235 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:33.716625 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 525/1032] 10.222.0.62 () {56 vars in 1105 bytes} [Mon Sep 26 17:43:33 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:33.717668 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd6811f-b7f3-430e-b5c1-301584355adf None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:33.752773 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5214e6-480c-4d45-a25c-3708b9908206 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:33.807260 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:33.827442 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd6811f-b7f3-430e-b5c1-301584355adf None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:33.857430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5214e6-480c-4d45-a25c-3708b9908206 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:33.860824 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768b264-dd85-46c1-852f-2b58b49c95be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:33.861457 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768b264-dd85-46c1-852f-2b58b49c95be None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:33.861728 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768b264-dd85-46c1-852f-2b58b49c95be None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:33.861991 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768b264-dd85-46c1-852f-2b58b49c95be None admin] PATH_INFO: `/v3/services` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:33.862607 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768b264-dd85-46c1-852f-2b58b49c95be None admin] RBAC: Adding query filter params (name=image) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:33.862902 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768b264-dd85-46c1-852f-2b58b49c95be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:33.864830 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768b264-dd85-46c1-852f-2b58b49c95be None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:33.869537 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 508/1033] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:43:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:33.870663 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb8aba-5a01-4286-8de4-184b71a62c85 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:33.870939 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb8aba-5a01-4286-8de4-184b71a62c85 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:33.871218 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb8aba-5a01-4286-8de4-184b71a62c85 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:33.872390 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 509/1034] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:43:33.875098 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb8aba-5a01-4286-8de4-184b71a62c85 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:33.877911 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:33.896196 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a49f4-6eb9-4a4e-9be8-5d3ce18814e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:33.896825 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a49f4-6eb9-4a4e-9be8-5d3ce18814e9 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:33.897145 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a49f4-6eb9-4a4e-9be8-5d3ce18814e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:33.897413 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a49f4-6eb9-4a4e-9be8-5d3ce18814e9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:33.907936 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106a49f4-6eb9-4a4e-9be8-5d3ce18814e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:43:33.913357 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-106a49f4-6eb9-4a4e-9be8-5d3ce18814e9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 17:43:33.913357 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:33.913357 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:33.913357 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:33.913357 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:33.913357 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:33.913357 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:33.913357 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:33.913357 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:33.913357 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:33.913357 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:33.913357 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:33.913357 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:43:33.913357 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:43:33.913357 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:43:33.913357 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:43:33.914413 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:43:33.914413 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:43:33.914413 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:43:33.914413 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:43:33.914413 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:33.914413 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:33.914413 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:33.914413 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:33.914413 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:33.914413 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:33.914413 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:33.914413 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:33.914413 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:33.914413 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:33.914413 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:33.914413 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:33.915255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:33.915255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:33.915255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:33.915255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:33.915255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:43:33.915255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:43:33.915255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:43:33.915255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:43:33.915255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:43:33.915255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:43:33.915255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 17:43:33.915255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:33.915255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 526/1035] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Sep 26 17:43:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:43:33.916040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a69162-2676-40d3-b286-e2a46d95c415 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:33.916040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a69162-2676-40d3-b286-e2a46d95c415 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:33.916040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a69162-2676-40d3-b286-e2a46d95c415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:33.933997 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-90a69162-2676-40d3-b286-e2a46d95c415 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:33.935177 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-90a69162-2676-40d3-b286-e2a46d95c415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:33.978923 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb8aba-5a01-4286-8de4-184b71a62c85 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:34.003874 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 527/1036] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:43:34.004799 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a69162-2676-40d3-b286-e2a46d95c415 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:34.032542 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bd637-a848-4da2-8a61-244e0e0691fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:34.033327 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bd637-a848-4da2-8a61-244e0e0691fa None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:34.034123 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bd637-a848-4da2-8a61-244e0e0691fa None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:34.034391 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bd637-a848-4da2-8a61-244e0e0691fa None admin] PATH_INFO: `/v3/services` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:34.035905 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5bd637-a848-4da2-8a61-244e0e0691fa None admin] RBAC: Adding query filter params (type=image) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:34.036213 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5bd637-a848-4da2-8a61-244e0e0691fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:34.037929 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5bd637-a848-4da2-8a61-244e0e0691fa None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:34.048887 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 510/1037] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:43:33 2022] GET /identity/v3/services?type=image => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:34.049106 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:34.050161 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bd637-a848-4da2-8a61-244e0e0691fa None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:34.109407 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a69162-2676-40d3-b286-e2a46d95c415 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:34.127484 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:34.146136 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5a279-63d7-49b2-b07f-423120b2f0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:34.146770 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5a279-63d7-49b2-b07f-423120b2f0da None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:34.147193 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5a279-63d7-49b2-b07f-423120b2f0da None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:34.147480 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5a279-63d7-49b2-b07f-423120b2f0da None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:34.148531 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5a279-63d7-49b2-b07f-423120b2f0da None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:34.148999 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5a279-63d7-49b2-b07f-423120b2f0da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:34.150424 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5a279-63d7-49b2-b07f-423120b2f0da None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:34.165107 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 528/1038] 10.222.0.62 () {56 vars in 1115 bytes} [Mon Sep 26 17:43:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:34.166816 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5a279-63d7-49b2-b07f-423120b2f0da None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:34.167816 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bd637-a848-4da2-8a61-244e0e0691fa None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:34.206713 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945c854-ccde-4c27-b664-e189530ea40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:34.208120 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945c854-ccde-4c27-b664-e189530ea40b None admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:34.208652 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945c854-ccde-4c27-b664-e189530ea40b None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:34.209126 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945c854-ccde-4c27-b664-e189530ea40b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:34.209961 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945c854-ccde-4c27-b664-e189530ea40b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:34.211675 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945c854-ccde-4c27-b664-e189530ea40b None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:34.235617 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 511/1039] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:43:34 2022] POST /identity/v3/endpoints => generated 327 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 17:43:34.273957 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945c854-ccde-4c27-b664-e189530ea40b None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:34.279590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5a279-63d7-49b2-b07f-423120b2f0da None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:34.281239 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:34.324298 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196a777-592b-4e15-ad99-3b70ee234173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:34.324935 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196a777-592b-4e15-ad99-3b70ee234173 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:34.325488 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196a777-592b-4e15-ad99-3b70ee234173 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:34.325754 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196a777-592b-4e15-ad99-3b70ee234173 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:34.338852 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196a777-592b-4e15-ad99-3b70ee234173 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:34.340322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196a777-592b-4e15-ad99-3b70ee234173 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:34.355556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-5196a777-592b-4e15-ad99-3b70ee234173 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:34.355556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:34.355556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:34.355556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:34.355556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:34.355556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:34.355556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:34.355556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:34.355556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:34.355556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:34.355556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:34.355556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:34.355556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:43:34.355556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:43:34.355556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:43:34.355556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:43:34.356610 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:34.356610 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:34.356610 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:34.356610 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:34.356610 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:34.356610 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:34.356610 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:34.356610 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:34.356610 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:34.356610 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:34.356610 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:34.356610 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:34.356610 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:34.356610 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:34.356610 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:34.356610 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:34.356610 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:43:34.358158 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:43:34.358158 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:34.358158 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:34.358158 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 529/1040] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:43:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:43:34.362662 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196a777-592b-4e15-ad99-3b70ee234173 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:34.403215 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945c854-ccde-4c27-b664-e189530ea40b None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:34.429711 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:34.444068 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933a528-cfed-46a6-96d4-23026b541f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:34.444767 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933a528-cfed-46a6-96d4-23026b541f9d None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:34.445099 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933a528-cfed-46a6-96d4-23026b541f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:34.445620 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933a528-cfed-46a6-96d4-23026b541f9d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:34.447140 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933a528-cfed-46a6-96d4-23026b541f9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:34.447915 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933a528-cfed-46a6-96d4-23026b541f9d None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:34.449544 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 512/1041] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:43:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:43:34.455517 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933a528-cfed-46a6-96d4-23026b541f9d None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:34.486024 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196a777-592b-4e15-ad99-3b70ee234173 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:34.523692 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3de2b6-c790-40bc-a369-acb44fbd546a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:34.524296 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3de2b6-c790-40bc-a369-acb44fbd546a None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:34.525080 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3de2b6-c790-40bc-a369-acb44fbd546a None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:34.525355 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3de2b6-c790-40bc-a369-acb44fbd546a None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:34.525998 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3de2b6-c790-40bc-a369-acb44fbd546a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:34.526292 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3de2b6-c790-40bc-a369-acb44fbd546a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:34.527660 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3de2b6-c790-40bc-a369-acb44fbd546a None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:34.540016 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 530/1042] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:43:34.546022 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3de2b6-c790-40bc-a369-acb44fbd546a None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:34.559391 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:34.565928 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933a528-cfed-46a6-96d4-23026b541f9d None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:34.604371 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4b253-0ed3-4175-bdb6-fc85112a3315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:34.604979 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4b253-0ed3-4175-bdb6-fc85112a3315 None admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:34.605366 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4b253-0ed3-4175-bdb6-fc85112a3315 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:34.605627 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4b253-0ed3-4175-bdb6-fc85112a3315 None admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:34.606206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4b253-0ed3-4175-bdb6-fc85112a3315 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:34.607676 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4b253-0ed3-4175-bdb6-fc85112a3315 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:34.630067 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 513/1043] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Sep 26 17:43:34 2022] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 17:43:34.662184 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3de2b6-c790-40bc-a369-acb44fbd546a None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:34.701802 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7b615-7855-4334-920d-388eab79a9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:34.702367 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7b615-7855-4334-920d-388eab79a9eb None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:34.702648 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7b615-7855-4334-920d-388eab79a9eb None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:34.702921 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7b615-7855-4334-920d-388eab79a9eb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:34.711831 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a7b615-7855-4334-920d-388eab79a9eb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:34.713333 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a7b615-7855-4334-920d-388eab79a9eb None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:34.726438 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-86a7b615-7855-4334-920d-388eab79a9eb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 17:43:34.726438 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:34.726438 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:34.726438 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:34.726438 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:34.726438 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:34.726438 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:34.726438 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:34.726438 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:34.726438 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:34.726438 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:34.726438 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:34.726438 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 17:43:34.726438 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 17:43:34.726438 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 17:43:34.726438 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 17:43:34.727524 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:34.727524 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:34.727524 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 17:43:34.727524 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:43:34.727524 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 17:43:34.727524 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:43:34.727524 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:34.727524 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:34.727524 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:34.727524 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:34.727524 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:34.727524 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:34.727524 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:34.727524 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:34.727524 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:34.727524 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:34.727524 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:34.727524 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:34.728497 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:34.728497 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:34.728497 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 17:43:34.728497 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 17:43:34.728497 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 17:43:34.728497 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 17:43:34.728497 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 17:43:34.728497 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 17:43:34.728497 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 17:43:34.728497 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:34.730001 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 531/1044] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Sep 26 17:43:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:43:34.733951 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4b253-0ed3-4175-bdb6-fc85112a3315 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:34.789460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:34.851445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4b253-0ed3-4175-bdb6-fc85112a3315 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:34.887295 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b88136-89d8-42d7-aceb-9e4d5d6fc614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:34.887904 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b88136-89d8-42d7-aceb-9e4d5d6fc614 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:34.888180 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b88136-89d8-42d7-aceb-9e4d5d6fc614 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:34.888449 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b88136-89d8-42d7-aceb-9e4d5d6fc614 None admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:34.889263 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b88136-89d8-42d7-aceb-9e4d5d6fc614 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:34.889571 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b88136-89d8-42d7-aceb-9e4d5d6fc614 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:34.891077 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b88136-89d8-42d7-aceb-9e4d5d6fc614 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:34.909222 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 514/1045] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Sep 26 17:43:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:43:34.914854 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7b615-7855-4334-920d-388eab79a9eb None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:34.986821 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:35.021026 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7b615-7855-4334-920d-388eab79a9eb None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:35.055834 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821e2be-4f14-40d2-8287-f11721049284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:35.056517 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821e2be-4f14-40d2-8287-f11721049284 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:35.056859 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821e2be-4f14-40d2-8287-f11721049284 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:35.057164 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821e2be-4f14-40d2-8287-f11721049284 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:35.127725 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821e2be-4f14-40d2-8287-f11721049284 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:35.129809 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821e2be-4f14-40d2-8287-f11721049284 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:35.199431 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:35.241173 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 532/1046] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:43:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 17:43:35.242951 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b88136-89d8-42d7-aceb-9e4d5d6fc614 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:35.344070 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b88136-89d8-42d7-aceb-9e4d5d6fc614 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:35.346432 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:35.383718 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef25d5c-dc5a-47ce-b659-37f36af6c0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:35.384391 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef25d5c-dc5a-47ce-b659-37f36af6c0e8 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:35.384631 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef25d5c-dc5a-47ce-b659-37f36af6c0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:35.384896 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef25d5c-dc5a-47ce-b659-37f36af6c0e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:35.401314 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef25d5c-dc5a-47ce-b659-37f36af6c0e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:35.402840 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef25d5c-dc5a-47ce-b659-37f36af6c0e8 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:35.419582 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-6ef25d5c-dc5a-47ce-b659-37f36af6c0e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:35.419582 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:35.419582 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:35.419582 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:35.419582 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:35.419582 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:35.419582 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:35.419582 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:35.419582 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:35.419582 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:35.419582 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:35.419582 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:35.419582 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:43:35.419582 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:43:35.419582 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:43:35.419582 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:43:35.420614 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:35.420614 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:35.420614 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:35.420614 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:35.420614 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:35.420614 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:35.420614 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:35.420614 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:35.420614 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:35.420614 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:35.420614 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:35.420614 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:35.420614 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:35.420614 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:35.420614 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:35.420614 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:35.420614 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:43:35.421541 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:43:35.421541 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:35.421541 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:35.422193 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 515/1047] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:43:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:43:35.426776 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821e2be-4f14-40d2-8287-f11721049284 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:35.529406 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821e2be-4f14-40d2-8287-f11721049284 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:35.563208 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855dc57-b4e0-43d6-be8d-0b285a344fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:35.563790 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855dc57-b4e0-43d6-be8d-0b285a344fdb None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:35.564051 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855dc57-b4e0-43d6-be8d-0b285a344fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:35.564378 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855dc57-b4e0-43d6-be8d-0b285a344fdb None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:35.565037 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0855dc57-b4e0-43d6-be8d-0b285a344fdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:35.565404 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0855dc57-b4e0-43d6-be8d-0b285a344fdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:35.567285 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0855dc57-b4e0-43d6-be8d-0b285a344fdb None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:35.579360 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 533/1048] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:35.585247 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef25d5c-dc5a-47ce-b659-37f36af6c0e8 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:35.688346 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef25d5c-dc5a-47ce-b659-37f36af6c0e8 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:35.721572 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8c186-f5f0-4e5f-ae8c-2814ca2bc0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:35.722190 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8c186-f5f0-4e5f-ae8c-2814ca2bc0f2 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:35.722464 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8c186-f5f0-4e5f-ae8c-2814ca2bc0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:35.722724 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8c186-f5f0-4e5f-ae8c-2814ca2bc0f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:35.729310 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8c186-f5f0-4e5f-ae8c-2814ca2bc0f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:35.730744 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8c186-f5f0-4e5f-ae8c-2814ca2bc0f2 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:35.742406 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-61e8c186-f5f0-4e5f-ae8c-2814ca2bc0f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:43:35.742406 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:35.742406 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:35.742406 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:35.742406 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:35.742406 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:35.742406 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:35.742406 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:35.742406 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:35.742406 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:35.742406 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:35.742406 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:35.742406 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 17:43:35.742406 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 17:43:35.742406 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 17:43:35.743297 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 17:43:35.743297 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:35.743297 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:35.743297 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:35.743297 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:35.743297 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:35.743297 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:35.743297 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:35.743297 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:35.743297 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:35.743297 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:35.743297 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:35.743297 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:35.743297 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:35.743297 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:35.743297 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:35.743297 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:35.749167 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 17:43:35.749167 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 17:43:35.749167 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 17:43:35.749167 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 17:43:35.749167 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 17:43:35.749167 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 17:43:35.749167 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:43:35.749167 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:35.749167 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 516/1049] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:43:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:43:35.751571 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855dc57-b4e0-43d6-be8d-0b285a344fdb None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:35.783628 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:35.854589 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855dc57-b4e0-43d6-be8d-0b285a344fdb None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:35.887264 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22faf36e-c42f-40b4-ba3b-6f65cbc4c50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:35.887868 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22faf36e-c42f-40b4-ba3b-6f65cbc4c50a None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:35.888148 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22faf36e-c42f-40b4-ba3b-6f65cbc4c50a None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:35.888421 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22faf36e-c42f-40b4-ba3b-6f65cbc4c50a None admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:35.889145 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22faf36e-c42f-40b4-ba3b-6f65cbc4c50a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:35.889457 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22faf36e-c42f-40b4-ba3b-6f65cbc4c50a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:35.890889 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22faf36e-c42f-40b4-ba3b-6f65cbc4c50a None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:35.908636 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 534/1050] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Sep 26 17:43:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:35.909987 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8c186-f5f0-4e5f-ae8c-2814ca2bc0f2 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:35.929938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:36.018393 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8c186-f5f0-4e5f-ae8c-2814ca2bc0f2 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:36.052881 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e369450-9f8c-4c0d-80f8-6130b4b7d46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:36.053417 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e369450-9f8c-4c0d-80f8-6130b4b7d46f None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:36.053636 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e369450-9f8c-4c0d-80f8-6130b4b7d46f None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:36.053946 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e369450-9f8c-4c0d-80f8-6130b4b7d46f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:36.054836 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e369450-9f8c-4c0d-80f8-6130b4b7d46f None admin] RBAC: Adding query filter params (role.id=5a55d35da255419c9b63146c84cfaf6f, scope.project.id=125361b23eb14b53aca5e0139919881e, user.id=1792e79b9c9a47e1923f19bfd2cd495b) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:36.055173 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e369450-9f8c-4c0d-80f8-6130b4b7d46f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:36.056915 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e369450-9f8c-4c0d-80f8-6130b4b7d46f None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:36.063065 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 517/1051] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:43:35 2022] GET /identity/v3/role_assignments?user.id=1792e79b9c9a47e1923f19bfd2cd495b&scope.project.id=125361b23eb14b53aca5e0139919881e&role.id=5a55d35da255419c9b63146c84cfaf6f => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:36.518640 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5aa8a-39c8-4359-bebe-d6d858d5d0b5 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:36.519149 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5aa8a-39c8-4359-bebe-d6d858d5d0b5 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:36.519255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5aa8a-39c8-4359-bebe-d6d858d5d0b5 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:36.521455 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 535/1052] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:43:36.526604 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac0ee8-79db-4210-8324-666c334b5dde None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:36.527004 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac0ee8-79db-4210-8324-666c334b5dde None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:36.527163 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac0ee8-79db-4210-8324-666c334b5dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:36.545755 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-84ac0ee8-79db-4210-8324-666c334b5dde None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:36.546939 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-84ac0ee8-79db-4210-8324-666c334b5dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:36.615845 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 518/1053] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:43:36.867231 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257144f-6864-49c6-b8cc-9243648f5c9d None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:36.867654 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257144f-6864-49c6-b8cc-9243648f5c9d None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:36.867775 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257144f-6864-49c6-b8cc-9243648f5c9d None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:36.869289 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 536/1054] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:43:36.874298 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a836539-32f8-4bb8-b6c5-471b30bcf138 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:36.874589 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a836539-32f8-4bb8-b6c5-471b30bcf138 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:36.874863 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a836539-32f8-4bb8-b6c5-471b30bcf138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:36.880754 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257144f-6864-49c6-b8cc-9243648f5c9d None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:36.893475 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-2a836539-32f8-4bb8-b6c5-471b30bcf138 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:36.894721 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-2a836539-32f8-4bb8-b6c5-471b30bcf138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:36.897592 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:36.967264 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 519/1055] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:43:36.979465 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:36.990868 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257144f-6864-49c6-b8cc-9243648f5c9d None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:37.024880 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035da7c-8acd-4dbc-b787-1b495c8bec49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:37.025518 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035da7c-8acd-4dbc-b787-1b495c8bec49 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:37.025797 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035da7c-8acd-4dbc-b787-1b495c8bec49 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:37.026068 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035da7c-8acd-4dbc-b787-1b495c8bec49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:37.092235 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9035da7c-8acd-4dbc-b787-1b495c8bec49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:37.093700 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9035da7c-8acd-4dbc-b787-1b495c8bec49 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:37.179722 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:37.191205 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 537/1056] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:43:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 26 17:43:37.197469 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a836539-32f8-4bb8-b6c5-471b30bcf138 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:37.238819 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035da7c-8acd-4dbc-b787-1b495c8bec49 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:37.300380 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a836539-32f8-4bb8-b6c5-471b30bcf138 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:37.343258 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55708680-4483-49a2-828a-53340849e891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:37.344420 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55708680-4483-49a2-828a-53340849e891 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:37.345183 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55708680-4483-49a2-828a-53340849e891 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:37.345869 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55708680-4483-49a2-828a-53340849e891 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:37.347432 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035da7c-8acd-4dbc-b787-1b495c8bec49 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:37.356285 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:37.360121 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55708680-4483-49a2-828a-53340849e891 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:37.362553 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55708680-4483-49a2-828a-53340849e891 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:37.378064 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-55708680-4483-49a2-828a-53340849e891 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:37.378064 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:37.378064 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:37.378064 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:37.378064 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:37.378064 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:37.378064 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:37.378064 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:37.378064 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:37.378064 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:37.378064 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:37.378064 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:37.378064 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:43:37.378064 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:43:37.378064 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:43:37.378064 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:43:37.379152 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:37.379152 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:37.379152 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:37.379152 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:37.379152 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:37.379152 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:37.379152 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:37.379152 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:37.379152 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:37.379152 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:37.379152 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:37.379152 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:37.379152 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:37.379152 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:37.379152 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:37.379152 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:37.379152 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:43:37.380053 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:43:37.380053 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:37.380053 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:37.384309 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 520/1057] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:43:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:37.385041 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55708680-4483-49a2-828a-53340849e891 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:37.389706 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad7d08-7a9c-4130-8a71-6770286e159e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:37.390344 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad7d08-7a9c-4130-8a71-6770286e159e None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:37.390619 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad7d08-7a9c-4130-8a71-6770286e159e None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:37.390883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad7d08-7a9c-4130-8a71-6770286e159e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:37.404643 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad7d08-7a9c-4130-8a71-6770286e159e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:43:37.409565 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-a1ad7d08-7a9c-4130-8a71-6770286e159e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:43:37.409565 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:37.409565 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:37.409565 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:37.409565 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:37.409565 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:37.409565 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:37.409565 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:37.409565 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:37.409565 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:37.409565 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:37.409565 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:37.409565 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:43:37.409565 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:43:37.409565 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:43:37.409565 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:43:37.410572 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:43:37.410572 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:43:37.410572 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:43:37.410572 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:43:37.410572 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:37.410572 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:37.410572 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:37.410572 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:37.410572 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:37.410572 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:37.410572 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:37.410572 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:37.410572 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:37.410572 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:37.410572 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:37.410572 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:37.412415 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:37.412415 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:37.412415 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:37.412415 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:37.412415 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:43:37.412415 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:43:37.412415 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:43:37.412415 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:43:37.412415 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:43:37.412415 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:43:37.412415 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:43:37.412415 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:37.412415 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 538/1058] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Sep 26 17:43:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:43:37.416608 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad7d08-7a9c-4130-8a71-6770286e159e None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:37.470816 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:37.502779 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55708680-4483-49a2-828a-53340849e891 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:37.525021 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad7d08-7a9c-4130-8a71-6770286e159e None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:37.536378 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5b301-7f4e-4864-81b9-cfff2cb6eebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:37.536979 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5b301-7f4e-4864-81b9-cfff2cb6eebf None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:37.537281 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5b301-7f4e-4864-81b9-cfff2cb6eebf None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:37.537553 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5b301-7f4e-4864-81b9-cfff2cb6eebf None admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:37.538189 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5b301-7f4e-4864-81b9-cfff2cb6eebf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:37.538485 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5b301-7f4e-4864-81b9-cfff2cb6eebf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:37.539853 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5b301-7f4e-4864-81b9-cfff2cb6eebf None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:37.551286 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 521/1059] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:37.562080 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa393bb-5799-498b-9cde-790dde4d09c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:37.562707 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa393bb-5799-498b-9cde-790dde4d09c3 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:37.562990 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa393bb-5799-498b-9cde-790dde4d09c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:37.563253 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa393bb-5799-498b-9cde-790dde4d09c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:37.563933 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa393bb-5799-498b-9cde-790dde4d09c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:37.564232 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa393bb-5799-498b-9cde-790dde4d09c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:37.565730 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa393bb-5799-498b-9cde-790dde4d09c3 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:37.577264 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 539/1060] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:43:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:43:37.583949 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5b301-7f4e-4864-81b9-cfff2cb6eebf None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:37.642872 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:37.696346 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5b301-7f4e-4864-81b9-cfff2cb6eebf None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:37.734434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689b557-c4f8-4e92-9ec9-80f76542f03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:37.734997 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689b557-c4f8-4e92-9ec9-80f76542f03a None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:37.735272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689b557-c4f8-4e92-9ec9-80f76542f03a None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:37.735539 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689b557-c4f8-4e92-9ec9-80f76542f03a None admin] PATH_INFO: `/v3/users/7c1596ebb30249afbfd939a762dbd8ea` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:37.751106 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689b557-c4f8-4e92-9ec9-80f76542f03a None admin] RBAC: Authorizing `identity:get_user(user_id=7c1596ebb30249afbfd939a762dbd8ea)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:37.752565 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689b557-c4f8-4e92-9ec9-80f76542f03a None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:37.754642 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 522/1061] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:43:37 2022] GET /identity/v3/users/7c1596ebb30249afbfd939a762dbd8ea => generated 285 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:37.760396 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa393bb-5799-498b-9cde-790dde4d09c3 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:37.868853 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa393bb-5799-498b-9cde-790dde4d09c3 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:37.882439 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:37.904346 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3119a3d-28e8-467c-9566-92ce8437b289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:37.904948 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3119a3d-28e8-467c-9566-92ce8437b289 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:37.905261 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3119a3d-28e8-467c-9566-92ce8437b289 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:37.905531 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3119a3d-28e8-467c-9566-92ce8437b289 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:37.971015 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3119a3d-28e8-467c-9566-92ce8437b289 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:37.972459 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3119a3d-28e8-467c-9566-92ce8437b289 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:38.068426 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 540/1062] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:43:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 17:43:38.074214 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689b557-c4f8-4e92-9ec9-80f76542f03a None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:38.182349 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689b557-c4f8-4e92-9ec9-80f76542f03a None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:38.193033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:38.218216 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7152bf-491c-44a5-94aa-5a2875290968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:38.218839 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7152bf-491c-44a5-94aa-5a2875290968 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:38.219128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7152bf-491c-44a5-94aa-5a2875290968 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:38.219384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7152bf-491c-44a5-94aa-5a2875290968 None admin] PATH_INFO: `/v3/projects/bb6a9eac08b9450183c6752752b191c5` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:38.220485 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7152bf-491c-44a5-94aa-5a2875290968 None admin] RBAC: Authorizing `identity:get_project(project_id=bb6a9eac08b9450183c6752752b191c5)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:38.222104 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7152bf-491c-44a5-94aa-5a2875290968 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:38.224371 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 523/1063] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:43:38 2022] GET /identity/v3/projects/bb6a9eac08b9450183c6752752b191c5 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:38.230439 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3119a3d-28e8-467c-9566-92ce8437b289 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:38.234016 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa44e0f-4cbf-436c-9c75-8df569f89466 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:38.234297 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa44e0f-4cbf-436c-9c75-8df569f89466 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:38.234567 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa44e0f-4cbf-436c-9c75-8df569f89466 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:38.236030 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 524/1064] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 17:43:38.240868 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5744f-2b6c-4116-bc63-c62c12414e6e None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:38.241185 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5744f-2b6c-4116-bc63-c62c12414e6e None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:38.241453 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5744f-2b6c-4116-bc63-c62c12414e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:38.245190 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:38.260149 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-d8f5744f-2b6c-4116-bc63-c62c12414e6e None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:38.261354 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-d8f5744f-2b6c-4116-bc63-c62c12414e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:38.330096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 525/1065] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 17:43:38.331503 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3119a3d-28e8-467c-9566-92ce8437b289 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:38.364478 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba0301-dd18-4521-a4f6-dfe0c6b3b26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:38.365117 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba0301-dd18-4521-a4f6-dfe0c6b3b26e None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:38.365397 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba0301-dd18-4521-a4f6-dfe0c6b3b26e None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:38.365660 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba0301-dd18-4521-a4f6-dfe0c6b3b26e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:38.366365 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba0301-dd18-4521-a4f6-dfe0c6b3b26e None admin] RBAC: Adding query filter params (role.id=be6ee971abf54b26be509c14823ece55, scope.project.id=bb6a9eac08b9450183c6752752b191c5, user.id=7c1596ebb30249afbfd939a762dbd8ea) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:38.366665 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba0301-dd18-4521-a4f6-dfe0c6b3b26e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:38.368067 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba0301-dd18-4521-a4f6-dfe0c6b3b26e None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:38.373200 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 541/1066] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:43:38 2022] GET /identity/v3/role_assignments?user.id=7c1596ebb30249afbfd939a762dbd8ea&scope.project.id=bb6a9eac08b9450183c6752752b191c5&role.id=be6ee971abf54b26be509c14823ece55 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:43:38.607040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f5744f-2b6c-4116-bc63-c62c12414e6e None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:38.705525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f5744f-2b6c-4116-bc63-c62c12414e6e None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:38.715155 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:38.741849 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893bdf7-d72b-4bde-84b7-950c7019fcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:38.742469 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893bdf7-d72b-4bde-84b7-950c7019fcc2 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:38.742741 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893bdf7-d72b-4bde-84b7-950c7019fcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:38.743010 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893bdf7-d72b-4bde-84b7-950c7019fcc2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:38.753109 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893bdf7-d72b-4bde-84b7-950c7019fcc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:43:38.758464 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-c893bdf7-d72b-4bde-84b7-950c7019fcc2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 17:43:38.758464 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:38.758464 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:38.758464 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:38.758464 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:38.758464 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:38.758464 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:38.758464 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:38.758464 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:38.758464 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:38.758464 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:38.758464 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:38.758464 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:43:38.758464 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:43:38.758464 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:43:38.758464 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:43:38.759572 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:43:38.759572 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:43:38.759572 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:43:38.759572 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:43:38.759572 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:38.759572 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:38.759572 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:38.759572 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:38.759572 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:38.759572 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:38.759572 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:38.759572 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:38.759572 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:38.759572 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:38.759572 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:38.759572 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:38.762155 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:38.762155 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:38.762155 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:38.762155 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:38.762155 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:43:38.762155 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:43:38.762155 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:43:38.762155 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:43:38.762155 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:43:38.762155 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:43:38.762155 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 17:43:38.762155 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:38.762155 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 526/1067] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Sep 26 17:43:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:38.765535 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba0301-dd18-4521-a4f6-dfe0c6b3b26e None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:38.846350 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:38.869451 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba0301-dd18-4521-a4f6-dfe0c6b3b26e None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:38.901967 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c93bb0-cf47-42bf-8d36-6b399288e191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:38.902565 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c93bb0-cf47-42bf-8d36-6b399288e191 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:38.902839 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c93bb0-cf47-42bf-8d36-6b399288e191 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:38.903103 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c93bb0-cf47-42bf-8d36-6b399288e191 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:38.903745 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c93bb0-cf47-42bf-8d36-6b399288e191 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:38.904042 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c93bb0-cf47-42bf-8d36-6b399288e191 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:38.905420 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c93bb0-cf47-42bf-8d36-6b399288e191 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:38.913343 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 542/1068] 10.222.0.62 () {56 vars in 1115 bytes} [Mon Sep 26 17:43:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:38.919122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893bdf7-d72b-4bde-84b7-950c7019fcc2 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:39.018866 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893bdf7-d72b-4bde-84b7-950c7019fcc2 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:39.052800 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa018822-1d64-40e3-b0d7-5100c65658fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:39.053655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa018822-1d64-40e3-b0d7-5100c65658fc None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:39.054118 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa018822-1d64-40e3-b0d7-5100c65658fc None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:39.054398 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa018822-1d64-40e3-b0d7-5100c65658fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:39.064996 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa018822-1d64-40e3-b0d7-5100c65658fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:39.066992 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa018822-1d64-40e3-b0d7-5100c65658fc None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:39.082720 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-aa018822-1d64-40e3-b0d7-5100c65658fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:39.082720 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:39.082720 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:39.082720 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:39.082720 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:39.082720 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:39.082720 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:39.082720 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:39.082720 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:39.082720 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:39.082720 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:39.082720 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:39.082720 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:43:39.082720 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:43:39.082720 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:43:39.082720 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:43:39.083843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:39.083843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:39.083843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:39.083843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:39.083843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:39.083843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:39.083843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:39.083843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:39.083843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:39.083843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:39.083843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:39.083843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:39.083843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:39.083843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:39.083843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:39.083843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:39.083843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:43:39.084841 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:43:39.084841 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:39.084841 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:39.084841 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 527/1069] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:39.089706 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c93bb0-cf47-42bf-8d36-6b399288e191 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:39.192751 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c93bb0-cf47-42bf-8d36-6b399288e191 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:39.225969 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94b714-838b-4c68-a82e-2269b6ae2a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:39.226601 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94b714-838b-4c68-a82e-2269b6ae2a40 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:39.226882 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94b714-838b-4c68-a82e-2269b6ae2a40 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:39.227157 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94b714-838b-4c68-a82e-2269b6ae2a40 None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:39.227813 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94b714-838b-4c68-a82e-2269b6ae2a40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:39.228117 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94b714-838b-4c68-a82e-2269b6ae2a40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:39.229564 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94b714-838b-4c68-a82e-2269b6ae2a40 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:39.237415 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:39.242820 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 543/1070] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:39.248232 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa018822-1d64-40e3-b0d7-5100c65658fc None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:39.270740 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:39.347876 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa018822-1d64-40e3-b0d7-5100c65658fc None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:39.385253 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc2b7c-c346-4d9a-afdc-b62bdd3bd90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:39.385876 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc2b7c-c346-4d9a-afdc-b62bdd3bd90a None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:39.386151 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc2b7c-c346-4d9a-afdc-b62bdd3bd90a None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:39.386419 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc2b7c-c346-4d9a-afdc-b62bdd3bd90a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:39.396769 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc2b7c-c346-4d9a-afdc-b62bdd3bd90a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:39.398254 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc2b7c-c346-4d9a-afdc-b62bdd3bd90a None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:39.409445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-14fc2b7c-c346-4d9a-afdc-b62bdd3bd90a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 17:43:39.409445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:39.409445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:39.409445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:39.409445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:39.409445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:39.409445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:39.409445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:39.409445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:39.409445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:39.409445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:39.409445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:39.409445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 17:43:39.409445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 17:43:39.409445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 17:43:39.409445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 17:43:39.410442 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:39.410442 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:39.410442 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 17:43:39.410442 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:43:39.410442 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 17:43:39.410442 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:43:39.410442 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:39.410442 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:39.410442 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:39.410442 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:39.410442 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:39.410442 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:39.410442 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:39.410442 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:39.410442 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:39.410442 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:39.410442 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:39.410442 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:39.411457 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:39.411457 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:39.411457 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 17:43:39.411457 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 17:43:39.411457 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 17:43:39.411457 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 17:43:39.411457 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 17:43:39.411457 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 17:43:39.411457 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 17:43:39.411457 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:39.411457 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 528/1071] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Sep 26 17:43:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:43:39.416345 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94b714-838b-4c68-a82e-2269b6ae2a40 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:39.518270 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94b714-838b-4c68-a82e-2269b6ae2a40 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:39.551477 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58bcf8-026d-4824-a4e3-3074586fe2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:39.552084 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58bcf8-026d-4824-a4e3-3074586fe2ee None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:39.552366 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58bcf8-026d-4824-a4e3-3074586fe2ee None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:39.552639 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58bcf8-026d-4824-a4e3-3074586fe2ee None admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:39.553400 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe58bcf8-026d-4824-a4e3-3074586fe2ee None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:39.553708 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe58bcf8-026d-4824-a4e3-3074586fe2ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:39.555166 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe58bcf8-026d-4824-a4e3-3074586fe2ee None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:39.572637 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 544/1072] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Sep 26 17:43:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:39.578576 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc2b7c-c346-4d9a-afdc-b62bdd3bd90a None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:39.658378 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:39.678079 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc2b7c-c346-4d9a-afdc-b62bdd3bd90a None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:39.711948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04889cd4-778b-4370-9785-253918955ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:39.712568 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04889cd4-778b-4370-9785-253918955ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:39.712847 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04889cd4-778b-4370-9785-253918955ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:39.713145 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04889cd4-778b-4370-9785-253918955ad6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:39.724583 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04889cd4-778b-4370-9785-253918955ad6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:39.726063 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04889cd4-778b-4370-9785-253918955ad6 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:39.739843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-04889cd4-778b-4370-9785-253918955ad6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:39.739843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:39.739843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:39.739843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:39.739843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:39.739843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:39.739843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:39.739843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:39.739843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:39.739843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:39.739843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:39.739843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:39.739843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:43:39.739843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:43:39.739843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:43:39.739843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:43:39.740952 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:39.740952 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:39.740952 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:39.740952 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:39.740952 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:39.740952 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:39.740952 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:39.740952 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:39.740952 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:39.740952 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:39.740952 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:39.740952 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:39.740952 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:39.740952 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:39.740952 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:39.740952 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:39.740952 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:43:39.741868 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:43:39.741868 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:39.741868 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:39.741868 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 529/1073] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:43:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:43:39.746695 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58bcf8-026d-4824-a4e3-3074586fe2ee None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:39.802193 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:39.845214 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58bcf8-026d-4824-a4e3-3074586fe2ee None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:39.877517 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5afb4-7247-48c1-a326-c25228d63836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:39.878122 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5afb4-7247-48c1-a326-c25228d63836 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:39.878402 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5afb4-7247-48c1-a326-c25228d63836 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:39.878672 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5afb4-7247-48c1-a326-c25228d63836 None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:39.879806 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5afb4-7247-48c1-a326-c25228d63836 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:39.880111 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5afb4-7247-48c1-a326-c25228d63836 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:39.881507 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5afb4-7247-48c1-a326-c25228d63836 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:39.892602 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 545/1074] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:39.898673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04889cd4-778b-4370-9785-253918955ad6 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:39.995861 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04889cd4-778b-4370-9785-253918955ad6 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:40.025305 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:40.030607 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff680ae-30f0-440b-833d-be5efa432605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:40.031232 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff680ae-30f0-440b-833d-be5efa432605 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:40.031517 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff680ae-30f0-440b-833d-be5efa432605 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:40.031792 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff680ae-30f0-440b-833d-be5efa432605 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:40.038572 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff680ae-30f0-440b-833d-be5efa432605 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:40.040005 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff680ae-30f0-440b-833d-be5efa432605 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:40.051057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-6ff680ae-30f0-440b-833d-be5efa432605 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:43:40.051057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:40.051057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:40.051057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:40.051057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:40.051057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:40.051057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:40.051057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:40.051057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:40.051057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:40.051057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:40.051057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:40.051057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 17:43:40.051057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 17:43:40.051057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 17:43:40.052124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 17:43:40.052124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:40.052124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:40.052124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:40.052124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:40.052124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:40.052124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:40.052124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:40.052124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:40.052124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:40.052124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:40.052124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:40.052124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:40.052124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:40.052124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:40.052124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:40.052124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:40.053116 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 17:43:40.053116 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 17:43:40.053116 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 17:43:40.053116 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 17:43:40.053116 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 17:43:40.053116 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 17:43:40.053116 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:43:40.053116 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:40.053116 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 530/1075] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:43:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:40.058297 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5afb4-7247-48c1-a326-c25228d63836 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:40.157455 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5afb4-7247-48c1-a326-c25228d63836 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:40.173163 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:40.192189 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7cc269-fd5b-4141-b350-b9e327179c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:40.192795 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cc269-fd5b-4141-b350-b9e327179c4f None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:40.193109 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cc269-fd5b-4141-b350-b9e327179c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:40.193385 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cc269-fd5b-4141-b350-b9e327179c4f None admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:40.194073 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7cc269-fd5b-4141-b350-b9e327179c4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:40.194380 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7cc269-fd5b-4141-b350-b9e327179c4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:40.195799 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7cc269-fd5b-4141-b350-b9e327179c4f None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:40.207678 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 546/1076] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Sep 26 17:43:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:40.213616 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff680ae-30f0-440b-833d-be5efa432605 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:40.312300 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff680ae-30f0-440b-833d-be5efa432605 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:40.347026 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbc229-d158-4df7-a941-fc175ff54dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:40.347681 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbc229-d158-4df7-a941-fc175ff54dff None admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:40.347963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbc229-d158-4df7-a941-fc175ff54dff None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:40.348236 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbc229-d158-4df7-a941-fc175ff54dff None admin] PATH_INFO: `/v3/projects/125361b23eb14b53aca5e0139919881e/users/1792e79b9c9a47e1923f19bfd2cd495b/roles/5a55d35da255419c9b63146c84cfaf6f` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:40.350400 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fbc229-d158-4df7-a941-fc175ff54dff None admin] RBAC: Authorizing `identity:create_grant(project_id=125361b23eb14b53aca5e0139919881e, user_id=1792e79b9c9a47e1923f19bfd2cd495b, role_id=5a55d35da255419c9b63146c84cfaf6f)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:40.351842 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fbc229-d158-4df7-a941-fc175ff54dff None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:40.365702 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 531/1077] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Sep 26 17:43:40 2022] PUT /identity/v3/projects/125361b23eb14b53aca5e0139919881e/users/1792e79b9c9a47e1923f19bfd2cd495b/roles/5a55d35da255419c9b63146c84cfaf6f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:43:40.507138 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca51e03-d4c9-431d-8f0c-a39bbb279b45 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:40.507692 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca51e03-d4c9-431d-8f0c-a39bbb279b45 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:40.507965 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca51e03-d4c9-431d-8f0c-a39bbb279b45 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:40.509381 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 547/1078] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:43:40.515064 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d16d32-80b1-4cf4-a386-3a4531f6bfad None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:40.515347 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d16d32-80b1-4cf4-a386-3a4531f6bfad None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:40.515614 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d16d32-80b1-4cf4-a386-3a4531f6bfad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:40.534139 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-74d16d32-80b1-4cf4-a386-3a4531f6bfad None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:40.535783 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-74d16d32-80b1-4cf4-a386-3a4531f6bfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:40.583511 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:40.604765 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 532/1079] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:43:40.876895 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca51e03-d4c9-431d-8f0c-a39bbb279b45 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:40.977305 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca51e03-d4c9-431d-8f0c-a39bbb279b45 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:41.011929 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29064de6-2c29-4835-892b-fa457c21b280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:41.012555 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29064de6-2c29-4835-892b-fa457c21b280 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:41.012834 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29064de6-2c29-4835-892b-fa457c21b280 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:41.013132 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29064de6-2c29-4835-892b-fa457c21b280 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:41.023074 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29064de6-2c29-4835-892b-fa457c21b280 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:43:41.027902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-29064de6-2c29-4835-892b-fa457c21b280 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:43:41.027902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:41.027902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:41.027902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:41.027902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:41.027902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:41.027902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:41.027902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:41.027902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:41.027902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:41.027902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:41.027902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:41.027902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:43:41.027902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:43:41.027902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:43:41.027902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:43:41.028962 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:43:41.028962 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:43:41.028962 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:43:41.028962 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:43:41.028962 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:41.028962 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:41.028962 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:41.028962 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:41.028962 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:41.028962 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:41.028962 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:41.028962 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:41.028962 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:41.028962 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:41.028962 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:41.028962 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:41.029919 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:41.029919 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:41.029919 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:41.029919 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:41.029919 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:43:41.029919 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:43:41.029919 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:43:41.029919 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:43:41.029919 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:43:41.029919 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:43:41.029919 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:43:41.029919 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:41.029919 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 548/1080] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Sep 26 17:43:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:41.035050 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d16d32-80b1-4cf4-a386-3a4531f6bfad None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:41.134373 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d16d32-80b1-4cf4-a386-3a4531f6bfad None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:41.168746 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75200cff-54de-4086-b307-1ac5e248cfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:41.169380 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75200cff-54de-4086-b307-1ac5e248cfc0 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:41.169661 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75200cff-54de-4086-b307-1ac5e248cfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:41.169932 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75200cff-54de-4086-b307-1ac5e248cfc0 None admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:41.170588 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75200cff-54de-4086-b307-1ac5e248cfc0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:41.170888 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75200cff-54de-4086-b307-1ac5e248cfc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:41.172263 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75200cff-54de-4086-b307-1ac5e248cfc0 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:41.180684 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 533/1081] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:43:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:41.186430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29064de6-2c29-4835-892b-fa457c21b280 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:41.221629 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:41.291671 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29064de6-2c29-4835-892b-fa457c21b280 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:41.324562 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01089fe0-b54f-42a3-add9-475194ca3ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:41.325471 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01089fe0-b54f-42a3-add9-475194ca3ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:41.325753 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01089fe0-b54f-42a3-add9-475194ca3ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:41.326025 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01089fe0-b54f-42a3-add9-475194ca3ef4 None admin] PATH_INFO: `/v3/users/7c1596ebb30249afbfd939a762dbd8ea` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:41.327143 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01089fe0-b54f-42a3-add9-475194ca3ef4 None admin] RBAC: Authorizing `identity:get_user(user_id=7c1596ebb30249afbfd939a762dbd8ea)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:41.328583 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01089fe0-b54f-42a3-add9-475194ca3ef4 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:41.330214 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 549/1082] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:43:41 2022] GET /identity/v3/users/7c1596ebb30249afbfd939a762dbd8ea => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:41.335933 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75200cff-54de-4086-b307-1ac5e248cfc0 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:41.382009 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:41.435975 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75200cff-54de-4086-b307-1ac5e248cfc0 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:41.468321 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6f1e3-9c88-4c14-9422-e5d3422377dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:41.468974 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6f1e3-9c88-4c14-9422-e5d3422377dc None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:41.469281 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6f1e3-9c88-4c14-9422-e5d3422377dc None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:41.469553 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6f1e3-9c88-4c14-9422-e5d3422377dc None admin] PATH_INFO: `/v3/projects/bb6a9eac08b9450183c6752752b191c5` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:41.470657 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf6f1e3-9c88-4c14-9422-e5d3422377dc None admin] RBAC: Authorizing `identity:get_project(project_id=bb6a9eac08b9450183c6752752b191c5)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:41.472092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf6f1e3-9c88-4c14-9422-e5d3422377dc None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:41.474316 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 534/1083] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:43:41 2022] GET /identity/v3/projects/bb6a9eac08b9450183c6752752b191c5 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:43:41.480252 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01089fe0-b54f-42a3-add9-475194ca3ef4 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:41.577906 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01089fe0-b54f-42a3-add9-475194ca3ef4 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:41.580220 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:41.611752 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c08a4-8391-4b48-b962-1c46aa2ddbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:41.612403 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c08a4-8391-4b48-b962-1c46aa2ddbd0 None admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:41.612679 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c08a4-8391-4b48-b962-1c46aa2ddbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:41.612946 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c08a4-8391-4b48-b962-1c46aa2ddbd0 None admin] PATH_INFO: `/v3/projects/bb6a9eac08b9450183c6752752b191c5/users/7c1596ebb30249afbfd939a762dbd8ea/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:41.614851 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c08a4-8391-4b48-b962-1c46aa2ddbd0 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb6a9eac08b9450183c6752752b191c5, user_id=7c1596ebb30249afbfd939a762dbd8ea, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:41.616258 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c08a4-8391-4b48-b962-1c46aa2ddbd0 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:41.628458 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 550/1084] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Sep 26 17:43:41 2022] PUT /identity/v3/projects/bb6a9eac08b9450183c6752752b191c5/users/7c1596ebb30249afbfd939a762dbd8ea/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:43:42.501926 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd769e9-ce6f-4fbd-94fd-cf6e9c0f93c0 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:42.502454 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd769e9-ce6f-4fbd-94fd-cf6e9c0f93c0 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:42.502454 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd769e9-ce6f-4fbd-94fd-cf6e9c0f93c0 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:42.504444 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 535/1085] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:43:42.509730 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15cf6b-8e3a-4eba-bb00-9ba9cff868fb None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:42.510147 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15cf6b-8e3a-4eba-bb00-9ba9cff868fb None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:42.510420 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15cf6b-8e3a-4eba-bb00-9ba9cff868fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:42.528780 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-9f15cf6b-8e3a-4eba-bb00-9ba9cff868fb None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:42.530022 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-9f15cf6b-8e3a-4eba-bb00-9ba9cff868fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:42.594633 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 551/1086] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:43:42.862311 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd769e9-ce6f-4fbd-94fd-cf6e9c0f93c0 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:42.963455 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd769e9-ce6f-4fbd-94fd-cf6e9c0f93c0 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:42.976326 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:42.998825 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c02a72-08e1-4e34-9b56-739a49e8599b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:42.999444 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c02a72-08e1-4e34-9b56-739a49e8599b None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:42.999722 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c02a72-08e1-4e34-9b56-739a49e8599b None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:42.999994 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c02a72-08e1-4e34-9b56-739a49e8599b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:43.010367 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c02a72-08e1-4e34-9b56-739a49e8599b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:43:43.015138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-59c02a72-08e1-4e34-9b56-739a49e8599b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 17:43:43.015138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:43.015138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:43.015138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:43.015138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:43.015138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:43.015138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:43.015138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:43.015138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:43.015138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:43.015138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:43.015138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:43.015138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:43:43.015138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:43:43.015138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:43:43.015138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:43:43.016132 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:43:43.016132 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:43:43.016132 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:43:43.016132 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:43:43.016132 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:43.016132 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:43.016132 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:43.016132 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:43.016132 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:43.016132 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:43.016132 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:43.016132 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:43.016132 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:43.016132 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:43.016132 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:43.016132 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:43.016968 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:43.016968 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:43.016968 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:43.016968 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:43.016968 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:43:43.016968 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:43:43.016968 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:43:43.016968 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:43:43.016968 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:43:43.016968 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:43:43.016968 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 17:43:43.016968 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:43.016968 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 536/1087] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Sep 26 17:43:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:43.022268 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15cf6b-8e3a-4eba-bb00-9ba9cff868fb None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:43.113869 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:43.121333 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15cf6b-8e3a-4eba-bb00-9ba9cff868fb None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:43.155188 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c73687-ad63-43e2-80be-6f96c562a46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:43.155786 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c73687-ad63-43e2-80be-6f96c562a46d None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:43.156064 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c73687-ad63-43e2-80be-6f96c562a46d None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:43.156336 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c73687-ad63-43e2-80be-6f96c562a46d None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:43.156998 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c73687-ad63-43e2-80be-6f96c562a46d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:43.157327 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c73687-ad63-43e2-80be-6f96c562a46d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:43.158691 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c73687-ad63-43e2-80be-6f96c562a46d None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:43.167439 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 552/1088] 10.222.0.62 () {56 vars in 1115 bytes} [Mon Sep 26 17:43:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:43.173663 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c02a72-08e1-4e34-9b56-739a49e8599b None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:43.273124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c02a72-08e1-4e34-9b56-739a49e8599b None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:43.305876 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc524f-b1d3-42fd-b112-293131a3ac45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:43.306494 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc524f-b1d3-42fd-b112-293131a3ac45 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:43.306770 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc524f-b1d3-42fd-b112-293131a3ac45 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:43.307039 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc524f-b1d3-42fd-b112-293131a3ac45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:43.317413 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc524f-b1d3-42fd-b112-293131a3ac45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:43.318840 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc524f-b1d3-42fd-b112-293131a3ac45 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:43.333396 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-07cc524f-b1d3-42fd-b112-293131a3ac45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:43.333396 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:43.333396 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:43.333396 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:43.333396 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:43.333396 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:43.333396 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:43.333396 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:43.333396 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:43.333396 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:43.333396 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:43.333396 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:43.333396 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:43:43.333396 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:43:43.333396 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:43:43.333396 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:43:43.334583 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:43.334583 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:43.334583 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:43.334583 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:43.334583 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:43.334583 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:43.334583 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:43.334583 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:43.334583 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:43.334583 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:43.334583 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:43.334583 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:43.334583 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:43.334583 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:43.334583 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:43.334583 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:43.334583 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:43:43.335698 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:43:43.335698 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:43.335698 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:43.337174 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 537/1089] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:43:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:43.340342 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c73687-ad63-43e2-80be-6f96c562a46d None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:43.443067 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c73687-ad63-43e2-80be-6f96c562a46d None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:43.478364 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d83f1-80ee-4e9e-89fb-c5bb77a33c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:43.478966 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d83f1-80ee-4e9e-89fb-c5bb77a33c46 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:43.479247 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d83f1-80ee-4e9e-89fb-c5bb77a33c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:43.479525 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d83f1-80ee-4e9e-89fb-c5bb77a33c46 None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:43.480163 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d83f1-80ee-4e9e-89fb-c5bb77a33c46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:43.480466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d83f1-80ee-4e9e-89fb-c5bb77a33c46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:43.481853 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d83f1-80ee-4e9e-89fb-c5bb77a33c46 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:43.493526 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 553/1090] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:43.499137 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc524f-b1d3-42fd-b112-293131a3ac45 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:43.526279 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:43.600400 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc524f-b1d3-42fd-b112-293131a3ac45 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:43.633620 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a68c7-541d-4230-9bfa-5f157ceb4462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:43.634173 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a68c7-541d-4230-9bfa-5f157ceb4462 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:43.634452 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a68c7-541d-4230-9bfa-5f157ceb4462 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:43.634725 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a68c7-541d-4230-9bfa-5f157ceb4462 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:43.642364 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a68c7-541d-4230-9bfa-5f157ceb4462 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:43.643846 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a68c7-541d-4230-9bfa-5f157ceb4462 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:43.657247 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-770a68c7-541d-4230-9bfa-5f157ceb4462 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 17:43:43.657247 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:43.657247 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:43.657247 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:43.657247 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:43.657247 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:43.657247 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:43.657247 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:43.657247 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:43.657247 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:43.657247 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:43.657247 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:43.657247 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 17:43:43.657247 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 17:43:43.657247 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 17:43:43.657247 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 17:43:43.658575 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:43.658575 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:43.658575 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 17:43:43.658575 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:43:43.658575 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 17:43:43.658575 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:43:43.658575 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:43.658575 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:43.658575 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:43.658575 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:43.658575 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:43.658575 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:43.658575 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:43.658575 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:43.658575 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:43.658575 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:43.658575 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:43.658575 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:43.659650 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:43.659650 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:43.659650 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 17:43:43.659650 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 17:43:43.659650 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 17:43:43.659650 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 17:43:43.659650 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 17:43:43.659650 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 17:43:43.659650 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 17:43:43.659650 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:43.659650 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 538/1091] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Sep 26 17:43:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:43:43.664156 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d83f1-80ee-4e9e-89fb-c5bb77a33c46 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:43.683383 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:43.764126 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d83f1-80ee-4e9e-89fb-c5bb77a33c46 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:43.771023 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f187d18-bbc5-4cb1-a670-9e1e2ec82152 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:43.771310 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f187d18-bbc5-4cb1-a670-9e1e2ec82152 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:43.771587 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f187d18-bbc5-4cb1-a670-9e1e2ec82152 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:43.772933 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 539/1092] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 17:43:43.777912 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec2564-12b6-4e1c-bbc9-447007f81aa3 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:43.778197 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec2564-12b6-4e1c-bbc9-447007f81aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:43.778469 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec2564-12b6-4e1c-bbc9-447007f81aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:43.798564 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-33ec2564-12b6-4e1c-bbc9-447007f81aa3 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:43.799468 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd934f-f206-4ddb-b80e-aa51775c975a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:43.799752 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-33ec2564-12b6-4e1c-bbc9-447007f81aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:43.800088 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd934f-f206-4ddb-b80e-aa51775c975a None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:43.800369 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd934f-f206-4ddb-b80e-aa51775c975a None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:43.801241 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd934f-f206-4ddb-b80e-aa51775c975a None admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:43.801968 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd934f-f206-4ddb-b80e-aa51775c975a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:43.802272 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd934f-f206-4ddb-b80e-aa51775c975a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:43.803696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd934f-f206-4ddb-b80e-aa51775c975a None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:43.820891 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 554/1093] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Sep 26 17:43:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:43.826559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd934f-f206-4ddb-b80e-aa51775c975a None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:43.874475 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 540/1094] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 17:43:43.899224 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:43.924271 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd934f-f206-4ddb-b80e-aa51775c975a None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:43.957475 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337bf260-e206-4a14-8335-4e14c2f301ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:43.958071 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bf260-e206-4a14-8335-4e14c2f301ab None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:43.958351 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bf260-e206-4a14-8335-4e14c2f301ab None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:43.958624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bf260-e206-4a14-8335-4e14c2f301ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:44.023255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337bf260-e206-4a14-8335-4e14c2f301ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:44.024658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337bf260-e206-4a14-8335-4e14c2f301ab None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:44.096564 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:44.122067 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 555/1095] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:43:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 26 17:43:44.127928 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec2564-12b6-4e1c-bbc9-447007f81aa3 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:44.140711 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337bf260-e206-4a14-8335-4e14c2f301ab None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:44.145532 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:44.231876 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec2564-12b6-4e1c-bbc9-447007f81aa3 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:44.240492 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337bf260-e206-4a14-8335-4e14c2f301ab None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:44.265863 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2424b-de3d-4b43-a893-8cd98d2fc064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:44.266726 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2424b-de3d-4b43-a893-8cd98d2fc064 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:44.266997 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2424b-de3d-4b43-a893-8cd98d2fc064 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:44.267264 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2424b-de3d-4b43-a893-8cd98d2fc064 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:44.274481 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90897d47-4fae-4d81-bdb6-da79e8fbebfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:44.275101 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90897d47-4fae-4d81-bdb6-da79e8fbebfb None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:44.275381 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90897d47-4fae-4d81-bdb6-da79e8fbebfb None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:44.275657 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90897d47-4fae-4d81-bdb6-da79e8fbebfb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:44.277462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2424b-de3d-4b43-a893-8cd98d2fc064 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:44.278905 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2424b-de3d-4b43-a893-8cd98d2fc064 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:44.285537 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90897d47-4fae-4d81-bdb6-da79e8fbebfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:43:44.290470 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-90897d47-4fae-4d81-bdb6-da79e8fbebfb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:43:44.290470 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:44.290470 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:44.290470 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:44.290470 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:44.290470 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:44.290470 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:44.290470 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:44.290470 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:44.290470 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:44.290470 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:44.290470 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:44.290470 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:43:44.290470 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:43:44.290470 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:43:44.290470 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:43:44.291427 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:43:44.291427 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:43:44.291427 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:43:44.291427 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:43:44.291427 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:44.291427 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:44.291427 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:44.291427 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:44.291427 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:44.291427 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:44.291427 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:44.291427 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:44.291427 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:44.291427 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:44.291427 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:44.291427 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:44.292504 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:44.292504 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:44.292504 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:44.292504 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:44.292504 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:43:44.292504 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:43:44.292504 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:43:44.292504 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:43:44.292504 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:43:44.292504 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:43:44.292504 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:43:44.292504 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:43:44.292504 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 556/1096] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Sep 26 17:43:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:43:44.293715 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-f1b2424b-de3d-4b43-a893-8cd98d2fc064 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:44.293715 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:44.293715 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:44.293715 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:44.293715 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:44.293715 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:44.293715 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:44.293715 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:44.293715 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:44.293715 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:44.293715 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:44.293715 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:44.293715 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:43:44.293715 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:43:44.293715 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:43:44.293715 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:43:44.294913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:44.294913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:44.294913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:44.294913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:44.294913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:44.294913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:44.294913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:44.294913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:44.294913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:44.294913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:44.294913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:44.294913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:44.294913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:44.294913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:44.294913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:44.294913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:44.294913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:43:44.296182 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:43:44.296182 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:43:44.296182 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:44.296182 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 541/1097] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:43:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:43:44.297603 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90897d47-4fae-4d81-bdb6-da79e8fbebfb None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:44.300134 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2424b-de3d-4b43-a893-8cd98d2fc064 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:44.331403 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:44.364272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:44.399690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90897d47-4fae-4d81-bdb6-da79e8fbebfb None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:44.401092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2424b-de3d-4b43-a893-8cd98d2fc064 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:44.434174 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e124e9a-9aac-4af5-a7e3-3d6007e96165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:44.434389 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc8815f-a4ec-4452-b8a3-bfedad04a28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:44.434774 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8815f-a4ec-4452-b8a3-bfedad04a28c None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:44.434886 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e124e9a-9aac-4af5-a7e3-3d6007e96165 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:44.435054 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e124e9a-9aac-4af5-a7e3-3d6007e96165 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:44.435152 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8815f-a4ec-4452-b8a3-bfedad04a28c None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:44.435323 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8815f-a4ec-4452-b8a3-bfedad04a28c None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:44.435427 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e124e9a-9aac-4af5-a7e3-3d6007e96165 None admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:44.435960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e124e9a-9aac-4af5-a7e3-3d6007e96165 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:44.436057 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc8815f-a4ec-4452-b8a3-bfedad04a28c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:44.436264 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e124e9a-9aac-4af5-a7e3-3d6007e96165 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:44.436354 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc8815f-a4ec-4452-b8a3-bfedad04a28c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:44.437676 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e124e9a-9aac-4af5-a7e3-3d6007e96165 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:44.437791 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc8815f-a4ec-4452-b8a3-bfedad04a28c None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:44.446432 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 557/1098] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:43:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:44.450378 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 542/1099] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:43:44.454336 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc8815f-a4ec-4452-b8a3-bfedad04a28c None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:44.455592 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e124e9a-9aac-4af5-a7e3-3d6007e96165 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:44.551271 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:44.552823 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e124e9a-9aac-4af5-a7e3-3d6007e96165 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:44.557746 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc8815f-a4ec-4452-b8a3-bfedad04a28c None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:44.580688 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:44.590018 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b2691-07e6-413c-aea9-a6ec78bd2ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:44.590647 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b2691-07e6-413c-aea9-a6ec78bd2ada None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:44.590930 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b2691-07e6-413c-aea9-a6ec78bd2ada None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:44.591205 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b2691-07e6-413c-aea9-a6ec78bd2ada None admin] PATH_INFO: `/v3/projects/service` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:44.592670 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04171ddf-3429-45c8-8527-50dba197e48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:44.593328 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04171ddf-3429-45c8-8527-50dba197e48d None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:44.593608 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04171ddf-3429-45c8-8527-50dba197e48d None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:44.593888 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04171ddf-3429-45c8-8527-50dba197e48d None admin] PATH_INFO: `/v3/users/7c1596ebb30249afbfd939a762dbd8ea` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:44.595016 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04171ddf-3429-45c8-8527-50dba197e48d None admin] RBAC: Authorizing `identity:get_user(user_id=7c1596ebb30249afbfd939a762dbd8ea)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:44.596474 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04171ddf-3429-45c8-8527-50dba197e48d None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:44.597875 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b2691-07e6-413c-aea9-a6ec78bd2ada None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:44.598171 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 558/1100] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:43:44 2022] GET /identity/v3/users/7c1596ebb30249afbfd939a762dbd8ea => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:44.599330 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b2691-07e6-413c-aea9-a6ec78bd2ada None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:44.603737 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04171ddf-3429-45c8-8527-50dba197e48d None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:44.610640 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-ea9b2691-07e6-413c-aea9-a6ec78bd2ada None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:43:44.610640 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:43:44.610640 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:43:44.610640 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:43:44.610640 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:43:44.610640 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:43:44.610640 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:43:44.610640 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:43:44.610640 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:43:44.610640 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:43:44.610640 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:43:44.610640 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:43:44.610640 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 17:43:44.610640 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 17:43:44.610640 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 17:43:44.611648 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 17:43:44.611648 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:43:44.611648 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:43:44.611648 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:43:44.611648 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:43:44.611648 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:43:44.611648 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:43:44.611648 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:43:44.611648 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:43:44.611648 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:43:44.611648 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:43:44.611648 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:43:44.611648 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:43:44.611648 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:43:44.611648 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:43:44.611648 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:43:44.611648 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:43:44.613461 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 17:43:44.613461 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 17:43:44.613461 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 17:43:44.613461 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 17:43:44.613461 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 17:43:44.613461 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 17:43:44.613461 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:43:44.613461 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:43:44.613461 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 543/1101] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:43:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:43:44.617910 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b2691-07e6-413c-aea9-a6ec78bd2ada None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:44.703566 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04171ddf-3429-45c8-8527-50dba197e48d None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:44.718861 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b2691-07e6-413c-aea9-a6ec78bd2ada None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:44.736710 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ade4d-5f9c-49c4-aeb3-26b6bf84c02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:44.737357 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ade4d-5f9c-49c4-aeb3-26b6bf84c02f None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:44.737646 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ade4d-5f9c-49c4-aeb3-26b6bf84c02f None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:44.738426 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ade4d-5f9c-49c4-aeb3-26b6bf84c02f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:44.752561 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc185631-1d4f-407c-a2ce-728c8b5d801c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:44.753193 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc185631-1d4f-407c-a2ce-728c8b5d801c None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:44.753525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc185631-1d4f-407c-a2ce-728c8b5d801c None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:44.753805 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc185631-1d4f-407c-a2ce-728c8b5d801c None admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:44.754496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc185631-1d4f-407c-a2ce-728c8b5d801c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:44.754803 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc185631-1d4f-407c-a2ce-728c8b5d801c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:44.756242 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc185631-1d4f-407c-a2ce-728c8b5d801c None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:44.769787 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:44.775082 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 544/1102] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Sep 26 17:43:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:43:44.775964 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc185631-1d4f-407c-a2ce-728c8b5d801c None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:44.812127 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ade4d-5f9c-49c4-aeb3-26b6bf84c02f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:44.813533 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ade4d-5f9c-49c4-aeb3-26b6bf84c02f None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:44.820699 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:44.873383 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc185631-1d4f-407c-a2ce-728c8b5d801c None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:44.907944 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb4413-5a09-423a-ba7f-92711a87c2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:44.908540 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb4413-5a09-423a-ba7f-92711a87c2e4 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:44.908816 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb4413-5a09-423a-ba7f-92711a87c2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:44.909108 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb4413-5a09-423a-ba7f-92711a87c2e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:44.909903 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfb4413-5a09-423a-ba7f-92711a87c2e4 None admin] RBAC: Adding query filter params (role.id=5a55d35da255419c9b63146c84cfaf6f, scope.project.id=125361b23eb14b53aca5e0139919881e, user.id=1792e79b9c9a47e1923f19bfd2cd495b) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:44.910209 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfb4413-5a09-423a-ba7f-92711a87c2e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:44.915842 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 559/1103] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:43:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 17:43:44.915980 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfb4413-5a09-423a-ba7f-92711a87c2e4 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:44.916540 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ade4d-5f9c-49c4-aeb3-26b6bf84c02f None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:44.921071 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 545/1104] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:43:44 2022] GET /identity/v3/role_assignments?user.id=1792e79b9c9a47e1923f19bfd2cd495b&scope.project.id=125361b23eb14b53aca5e0139919881e&role.id=5a55d35da255419c9b63146c84cfaf6f => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:44.982089 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:45.022611 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ade4d-5f9c-49c4-aeb3-26b6bf84c02f None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:45.059195 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8665963-e51a-47a8-b490-f2d0c55f9ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:45.059851 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8665963-e51a-47a8-b490-f2d0c55f9ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:45.060135 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8665963-e51a-47a8-b490-f2d0c55f9ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:45.060442 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8665963-e51a-47a8-b490-f2d0c55f9ae0 None admin] PATH_INFO: `/v3/projects/bb6a9eac08b9450183c6752752b191c5` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:45.061635 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8665963-e51a-47a8-b490-f2d0c55f9ae0 None admin] RBAC: Authorizing `identity:get_project(project_id=bb6a9eac08b9450183c6752752b191c5)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:45.063261 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8665963-e51a-47a8-b490-f2d0c55f9ae0 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:45.065221 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 560/1105] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:43:44 2022] GET /identity/v3/projects/bb6a9eac08b9450183c6752752b191c5 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:43:45.071362 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb4413-5a09-423a-ba7f-92711a87c2e4 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:45.176755 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb4413-5a09-423a-ba7f-92711a87c2e4 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:45.187656 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:45.211437 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0eb13-cd27-4558-ac69-4874688a2c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:45.212038 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0eb13-cd27-4558-ac69-4874688a2c5f None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:45.212584 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0eb13-cd27-4558-ac69-4874688a2c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:45.212861 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0eb13-cd27-4558-ac69-4874688a2c5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:45.213612 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0eb13-cd27-4558-ac69-4874688a2c5f None admin] RBAC: Adding query filter params (role.id=be6ee971abf54b26be509c14823ece55, scope.project.id=bb6a9eac08b9450183c6752752b191c5, user.id=7c1596ebb30249afbfd939a762dbd8ea) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:45.213914 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0eb13-cd27-4558-ac69-4874688a2c5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:45.215340 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0eb13-cd27-4558-ac69-4874688a2c5f None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:45.221279 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 546/1106] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:43:45 2022] GET /identity/v3/role_assignments?user.id=7c1596ebb30249afbfd939a762dbd8ea&scope.project.id=bb6a9eac08b9450183c6752752b191c5&role.id=be6ee971abf54b26be509c14823ece55 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:47.396108 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb2455-5d15-4854-8e51-a37b9195d159 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:47.396566 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb2455-5d15-4854-8e51-a37b9195d159 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:47.396654 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb2455-5d15-4854-8e51-a37b9195d159 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:47.398025 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 561/1107] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:43:47.403178 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbde791-b481-46d5-90d5-21310eeb9412 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:47.403610 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbde791-b481-46d5-90d5-21310eeb9412 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:47.403754 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbde791-b481-46d5-90d5-21310eeb9412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:47.422143 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-7fbde791-b481-46d5-90d5-21310eeb9412 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:47.423306 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-7fbde791-b481-46d5-90d5-21310eeb9412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:47.488585 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 547/1108] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:43:47.757445 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb2455-5d15-4854-8e51-a37b9195d159 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:47.854722 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb2455-5d15-4854-8e51-a37b9195d159 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:47.882346 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:47.887167 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d284074-c5f2-451c-b03c-ea416b0b8982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:47.887781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d284074-c5f2-451c-b03c-ea416b0b8982 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:47.888058 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d284074-c5f2-451c-b03c-ea416b0b8982 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:47.888326 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d284074-c5f2-451c-b03c-ea416b0b8982 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:47.889443 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d284074-c5f2-451c-b03c-ea416b0b8982 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:47.890864 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d284074-c5f2-451c-b03c-ea416b0b8982 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:47.892406 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 562/1109] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:43:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:47.898637 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbde791-b481-46d5-90d5-21310eeb9412 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:47.993237 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbde791-b481-46d5-90d5-21310eeb9412 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:47.995455 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:48.026646 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c7ce9-82c6-45fc-8a36-4647115e1557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:48.027161 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c7ce9-82c6-45fc-8a36-4647115e1557 None admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:48.027433 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c7ce9-82c6-45fc-8a36-4647115e1557 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:48.027699 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c7ce9-82c6-45fc-8a36-4647115e1557 None admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:48.028345 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c7ce9-82c6-45fc-8a36-4647115e1557 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:48.029789 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c7ce9-82c6-45fc-8a36-4647115e1557 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:48.053759 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 548/1110] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Sep 26 17:43:47 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:43:50.214191 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de07217-0111-48c3-857a-13c31f0d32f9 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:50.214756 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de07217-0111-48c3-857a-13c31f0d32f9 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:50.214756 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de07217-0111-48c3-857a-13c31f0d32f9 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:50.216060 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 563/1111] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:43:50.221397 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61cbabd-440a-4b2e-a8cc-9c9a97d50c89 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:50.221819 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61cbabd-440a-4b2e-a8cc-9c9a97d50c89 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:50.222566 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61cbabd-440a-4b2e-a8cc-9c9a97d50c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:50.245515 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-b61cbabd-440a-4b2e-a8cc-9c9a97d50c89 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:50.247241 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-b61cbabd-440a-4b2e-a8cc-9c9a97d50c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:50.325278 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 549/1112] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:43:50.608993 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de07217-0111-48c3-857a-13c31f0d32f9 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:50.711272 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de07217-0111-48c3-857a-13c31f0d32f9 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:50.743716 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84666c5d-76cd-4e84-893e-3689da4adf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:50.744333 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84666c5d-76cd-4e84-893e-3689da4adf73 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:50.744612 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84666c5d-76cd-4e84-893e-3689da4adf73 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:50.744883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84666c5d-76cd-4e84-893e-3689da4adf73 None admin] PATH_INFO: `/v3/roles/1d93df17fd9a4d92b8c9966cc9deacde` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:50.746286 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84666c5d-76cd-4e84-893e-3689da4adf73 None admin] RBAC: Authorizing `identity:get_role(role_id=1d93df17fd9a4d92b8c9966cc9deacde)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:50.747652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84666c5d-76cd-4e84-893e-3689da4adf73 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:50.748971 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 564/1113] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:43:50 2022] GET /identity/v3/roles/1d93df17fd9a4d92b8c9966cc9deacde => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:50.755332 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61cbabd-440a-4b2e-a8cc-9c9a97d50c89 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:50.842700 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:50.854482 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61cbabd-440a-4b2e-a8cc-9c9a97d50c89 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:50.888083 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1e1be-9d74-47ea-8b26-e492a47fbc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:50.888634 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1e1be-9d74-47ea-8b26-e492a47fbc28 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:50.888911 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1e1be-9d74-47ea-8b26-e492a47fbc28 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:50.889207 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1e1be-9d74-47ea-8b26-e492a47fbc28 None admin] PATH_INFO: `/v3/users/b6c8259f1a074630959446ad3c2f0230` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:50.901742 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa1e1be-9d74-47ea-8b26-e492a47fbc28 None admin] RBAC: Authorizing `identity:get_user(user_id=b6c8259f1a074630959446ad3c2f0230)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:50.903184 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa1e1be-9d74-47ea-8b26-e492a47fbc28 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:50.904769 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 550/1114] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:43:50 2022] GET /identity/v3/users/b6c8259f1a074630959446ad3c2f0230 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:50.910620 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84666c5d-76cd-4e84-893e-3689da4adf73 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:50.987212 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:51.018607 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84666c5d-76cd-4e84-893e-3689da4adf73 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:51.050902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0eb4e-ea64-490c-892f-d99bd573e39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:51.051491 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0eb4e-ea64-490c-892f-d99bd573e39b None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:51.051761 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0eb4e-ea64-490c-892f-d99bd573e39b None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:51.052025 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0eb4e-ea64-490c-892f-d99bd573e39b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:51.115336 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0eb4e-ea64-490c-892f-d99bd573e39b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:51.116759 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0eb4e-ea64-490c-892f-d99bd573e39b None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:51.178093 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:51.211217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 565/1115] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:43:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 26 17:43:51.217138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1e1be-9d74-47ea-8b26-e492a47fbc28 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:51.313092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1e1be-9d74-47ea-8b26-e492a47fbc28 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:51.346809 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb622663-ca50-4975-9de2-a74226fc6370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:51.347424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb622663-ca50-4975-9de2-a74226fc6370 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:51.347702 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb622663-ca50-4975-9de2-a74226fc6370 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:51.347973 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb622663-ca50-4975-9de2-a74226fc6370 None admin] PATH_INFO: `/v3/projects/bb6a9eac08b9450183c6752752b191c5` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:51.349107 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb622663-ca50-4975-9de2-a74226fc6370 None admin] RBAC: Authorizing `identity:get_project(project_id=bb6a9eac08b9450183c6752752b191c5)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:51.350541 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb622663-ca50-4975-9de2-a74226fc6370 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:51.352155 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 551/1116] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:43:51 2022] GET /identity/v3/projects/bb6a9eac08b9450183c6752752b191c5 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:51.358419 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0eb4e-ea64-490c-892f-d99bd573e39b None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:51.455893 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0eb4e-ea64-490c-892f-d99bd573e39b None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:51.488866 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ede30a-a2dc-4b9f-9df3-cea0d77cc182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:51.489487 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ede30a-a2dc-4b9f-9df3-cea0d77cc182 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:51.489767 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ede30a-a2dc-4b9f-9df3-cea0d77cc182 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:51.490037 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ede30a-a2dc-4b9f-9df3-cea0d77cc182 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:51.490754 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ede30a-a2dc-4b9f-9df3-cea0d77cc182 None admin] RBAC: Adding query filter params (role.id=1d93df17fd9a4d92b8c9966cc9deacde, scope.project.id=bb6a9eac08b9450183c6752752b191c5, user.id=b6c8259f1a074630959446ad3c2f0230) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:51.491063 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ede30a-a2dc-4b9f-9df3-cea0d77cc182 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:51.492485 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ede30a-a2dc-4b9f-9df3-cea0d77cc182 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:51.497692 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 566/1117] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:43:51 2022] GET /identity/v3/role_assignments?user.id=b6c8259f1a074630959446ad3c2f0230&scope.project.id=bb6a9eac08b9450183c6752752b191c5&role.id=1d93df17fd9a4d92b8c9966cc9deacde => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:53.592015 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008df52-7384-498e-bef9-a85fd0c0cadf None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:53.592558 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008df52-7384-498e-bef9-a85fd0c0cadf None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:53.592558 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008df52-7384-498e-bef9-a85fd0c0cadf None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:53.593937 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 552/1118] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:43:53.599143 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75aba48-7a79-4d82-ad27-be3025537976 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:53.599562 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75aba48-7a79-4d82-ad27-be3025537976 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:53.599686 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75aba48-7a79-4d82-ad27-be3025537976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:53.617894 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-d75aba48-7a79-4d82-ad27-be3025537976 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:53.619079 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-d75aba48-7a79-4d82-ad27-be3025537976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:53.645213 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:53.685823 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 567/1119] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:43:53.955609 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008df52-7384-498e-bef9-a85fd0c0cadf None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:53.974432 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:54.056572 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008df52-7384-498e-bef9-a85fd0c0cadf None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:54.090937 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d7ec7-5a02-41f0-b7f6-3339923f9563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:54.091557 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d7ec7-5a02-41f0-b7f6-3339923f9563 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:54.091835 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d7ec7-5a02-41f0-b7f6-3339923f9563 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:54.092103 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d7ec7-5a02-41f0-b7f6-3339923f9563 None admin] PATH_INFO: `/v3/roles/1d93df17fd9a4d92b8c9966cc9deacde` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:54.093494 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73d7ec7-5a02-41f0-b7f6-3339923f9563 None admin] RBAC: Authorizing `identity:get_role(role_id=1d93df17fd9a4d92b8c9966cc9deacde)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:54.094862 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73d7ec7-5a02-41f0-b7f6-3339923f9563 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:54.096179 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 553/1120] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:43:53 2022] GET /identity/v3/roles/1d93df17fd9a4d92b8c9966cc9deacde => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:54.102142 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75aba48-7a79-4d82-ad27-be3025537976 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:54.197630 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75aba48-7a79-4d82-ad27-be3025537976 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:54.231314 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b011a-868e-45e4-bdb1-78aa006181d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:54.231866 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b011a-868e-45e4-bdb1-78aa006181d6 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:54.232141 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b011a-868e-45e4-bdb1-78aa006181d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:54.232408 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b011a-868e-45e4-bdb1-78aa006181d6 None admin] PATH_INFO: `/v3/users/b6c8259f1a074630959446ad3c2f0230` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:54.233606 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b011a-868e-45e4-bdb1-78aa006181d6 None admin] RBAC: Authorizing `identity:get_user(user_id=b6c8259f1a074630959446ad3c2f0230)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:54.235039 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b011a-868e-45e4-bdb1-78aa006181d6 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:54.236597 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 568/1121] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:43:54 2022] GET /identity/v3/users/b6c8259f1a074630959446ad3c2f0230 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:54.242608 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d7ec7-5a02-41f0-b7f6-3339923f9563 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:54.325294 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:54.341805 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d7ec7-5a02-41f0-b7f6-3339923f9563 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:54.374881 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543adee7-5f6d-48cc-9caf-f8136cc6851d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:54.375497 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543adee7-5f6d-48cc-9caf-f8136cc6851d None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:54.375776 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543adee7-5f6d-48cc-9caf-f8136cc6851d None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:54.376046 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543adee7-5f6d-48cc-9caf-f8136cc6851d None admin] PATH_INFO: `/v3/projects/bb6a9eac08b9450183c6752752b191c5` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:54.377196 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543adee7-5f6d-48cc-9caf-f8136cc6851d None admin] RBAC: Authorizing `identity:get_project(project_id=bb6a9eac08b9450183c6752752b191c5)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:54.379210 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543adee7-5f6d-48cc-9caf-f8136cc6851d None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:54.380848 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 554/1122] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:43:54 2022] GET /identity/v3/projects/bb6a9eac08b9450183c6752752b191c5 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:54.386969 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b011a-868e-45e4-bdb1-78aa006181d6 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:54.417177 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:54.484976 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b011a-868e-45e4-bdb1-78aa006181d6 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:54.518043 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672ab9d-e679-4ec9-8bf7-52cf54fa7b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:54.518713 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672ab9d-e679-4ec9-8bf7-52cf54fa7b28 None admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:54.518990 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672ab9d-e679-4ec9-8bf7-52cf54fa7b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:54.519260 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672ab9d-e679-4ec9-8bf7-52cf54fa7b28 None admin] PATH_INFO: `/v3/projects/bb6a9eac08b9450183c6752752b191c5/users/b6c8259f1a074630959446ad3c2f0230/roles/1d93df17fd9a4d92b8c9966cc9deacde` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:54.521399 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3672ab9d-e679-4ec9-8bf7-52cf54fa7b28 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb6a9eac08b9450183c6752752b191c5, user_id=b6c8259f1a074630959446ad3c2f0230, role_id=1d93df17fd9a4d92b8c9966cc9deacde)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:54.522820 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3672ab9d-e679-4ec9-8bf7-52cf54fa7b28 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:54.535060 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 569/1123] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Sep 26 17:43:54 2022] PUT /identity/v3/projects/bb6a9eac08b9450183c6752752b191c5/users/b6c8259f1a074630959446ad3c2f0230/roles/1d93df17fd9a4d92b8c9966cc9deacde => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:43:56.654472 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc0673-1f3f-4f36-a74d-4c4cc4134f12 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:56.654992 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc0673-1f3f-4f36-a74d-4c4cc4134f12 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:56.654992 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc0673-1f3f-4f36-a74d-4c4cc4134f12 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:56.656851 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 555/1124] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:43:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:43:56.663742 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb594d-75c6-452d-a117-be87ce98f1ed None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:56.664164 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb594d-75c6-452d-a117-be87ce98f1ed None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:56.664293 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb594d-75c6-452d-a117-be87ce98f1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:56.682010 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-a9fb594d-75c6-452d-a117-be87ce98f1ed None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:43:56.683202 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-a9fb594d-75c6-452d-a117-be87ce98f1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:43:56.748098 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 570/1125] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:43:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:43:57.018835 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc0673-1f3f-4f36-a74d-4c4cc4134f12 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:57.117204 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc0673-1f3f-4f36-a74d-4c4cc4134f12 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:57.148775 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435c6fe-c8a9-446e-b4c9-22ba7ce6b6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:57.149411 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435c6fe-c8a9-446e-b4c9-22ba7ce6b6f1 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:57.149686 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435c6fe-c8a9-446e-b4c9-22ba7ce6b6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:57.149954 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435c6fe-c8a9-446e-b4c9-22ba7ce6b6f1 None admin] PATH_INFO: `/v3/roles/1d93df17fd9a4d92b8c9966cc9deacde` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:57.151316 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b435c6fe-c8a9-446e-b4c9-22ba7ce6b6f1 None admin] RBAC: Authorizing `identity:get_role(role_id=1d93df17fd9a4d92b8c9966cc9deacde)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:57.152670 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b435c6fe-c8a9-446e-b4c9-22ba7ce6b6f1 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:57.153992 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 556/1126] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:43:57 2022] GET /identity/v3/roles/1d93df17fd9a4d92b8c9966cc9deacde => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:57.160290 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb594d-75c6-452d-a117-be87ce98f1ed None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:57.181262 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:57.258371 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb594d-75c6-452d-a117-be87ce98f1ed None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:57.290774 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383fb82-d4b3-415a-b061-4dadb644eb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:57.291328 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383fb82-d4b3-415a-b061-4dadb644eb79 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:57.291605 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383fb82-d4b3-415a-b061-4dadb644eb79 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:57.291875 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383fb82-d4b3-415a-b061-4dadb644eb79 None admin] PATH_INFO: `/v3/users/b6c8259f1a074630959446ad3c2f0230` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:57.292981 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383fb82-d4b3-415a-b061-4dadb644eb79 None admin] RBAC: Authorizing `identity:get_user(user_id=b6c8259f1a074630959446ad3c2f0230)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:57.294429 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383fb82-d4b3-415a-b061-4dadb644eb79 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:57.295991 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 571/1127] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:43:57 2022] GET /identity/v3/users/b6c8259f1a074630959446ad3c2f0230 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:57.302384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435c6fe-c8a9-446e-b4c9-22ba7ce6b6f1 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:57.323899 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:57.400938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435c6fe-c8a9-446e-b4c9-22ba7ce6b6f1 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:57.434040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21673228-ae01-4b6a-adc5-e60a88aa606d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:57.434634 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21673228-ae01-4b6a-adc5-e60a88aa606d None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:57.434912 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21673228-ae01-4b6a-adc5-e60a88aa606d None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:57.435183 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21673228-ae01-4b6a-adc5-e60a88aa606d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:57.500251 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21673228-ae01-4b6a-adc5-e60a88aa606d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:57.501723 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21673228-ae01-4b6a-adc5-e60a88aa606d None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:57.521479 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:57.597555 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 557/1128] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:43:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 17:43:57.603642 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383fb82-d4b3-415a-b061-4dadb644eb79 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:57.688395 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:57.701373 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383fb82-d4b3-415a-b061-4dadb644eb79 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:57.734218 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd2621-b18c-4c30-b96a-d3da59acd326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:57.734834 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd2621-b18c-4c30-b96a-d3da59acd326 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:57.735113 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd2621-b18c-4c30-b96a-d3da59acd326 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:57.735385 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd2621-b18c-4c30-b96a-d3da59acd326 None admin] PATH_INFO: `/v3/projects/bb6a9eac08b9450183c6752752b191c5` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:57.736484 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd2621-b18c-4c30-b96a-d3da59acd326 None admin] RBAC: Authorizing `identity:get_project(project_id=bb6a9eac08b9450183c6752752b191c5)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:57.738043 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd2621-b18c-4c30-b96a-d3da59acd326 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:57.739646 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 572/1129] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:43:57 2022] GET /identity/v3/projects/bb6a9eac08b9450183c6752752b191c5 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:43:57.745789 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21673228-ae01-4b6a-adc5-e60a88aa606d None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:43:57.842455 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21673228-ae01-4b6a-adc5-e60a88aa606d None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:43:57.861733 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:43:57.875691 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf20dac-379c-49b5-aaeb-8639dbe0906f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:43:57.876281 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf20dac-379c-49b5-aaeb-8639dbe0906f None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:43:57.876556 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf20dac-379c-49b5-aaeb-8639dbe0906f None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:43:57.876821 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf20dac-379c-49b5-aaeb-8639dbe0906f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:43:57.878062 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf20dac-379c-49b5-aaeb-8639dbe0906f None admin] RBAC: Adding query filter params (role.id=1d93df17fd9a4d92b8c9966cc9deacde, scope.project.id=bb6a9eac08b9450183c6752752b191c5, user.id=b6c8259f1a074630959446ad3c2f0230) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:43:57.878365 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf20dac-379c-49b5-aaeb-8639dbe0906f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:43:57.879772 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf20dac-379c-49b5-aaeb-8639dbe0906f None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:43:57.885257 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 558/1130] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:43:57 2022] GET /identity/v3/role_assignments?user.id=b6c8259f1a074630959446ad3c2f0230&scope.project.id=bb6a9eac08b9450183c6752752b191c5&role.id=1d93df17fd9a4d92b8c9966cc9deacde => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:44:00.077093 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144581fe-fd92-4de6-8b1c-efcdbbf2f96b None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:00.077631 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144581fe-fd92-4de6-8b1c-efcdbbf2f96b None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:00.077631 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144581fe-fd92-4de6-8b1c-efcdbbf2f96b None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:00.078980 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 573/1131] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:44:00.084804 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28926793-7ce0-4077-9e38-11bbc7f4fddf None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:00.085286 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28926793-7ce0-4077-9e38-11bbc7f4fddf None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:00.085388 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28926793-7ce0-4077-9e38-11bbc7f4fddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:00.103582 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-28926793-7ce0-4077-9e38-11bbc7f4fddf None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:44:00.104784 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-28926793-7ce0-4077-9e38-11bbc7f4fddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:44:00.170553 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 559/1132] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:44:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:44:00.440856 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144581fe-fd92-4de6-8b1c-efcdbbf2f96b None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:00.539247 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144581fe-fd92-4de6-8b1c-efcdbbf2f96b None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:00.570886 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1a259-c10c-4df8-abc0-de6caa58d18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:00.571493 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1a259-c10c-4df8-abc0-de6caa58d18b None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:00.571768 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1a259-c10c-4df8-abc0-de6caa58d18b None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:00.572035 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1a259-c10c-4df8-abc0-de6caa58d18b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:00.573160 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1a259-c10c-4df8-abc0-de6caa58d18b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:44:00.574830 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1a259-c10c-4df8-abc0-de6caa58d18b None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:44:00.576362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 574/1133] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:44:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:44:00.582783 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28926793-7ce0-4077-9e38-11bbc7f4fddf None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:00.678618 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28926793-7ce0-4077-9e38-11bbc7f4fddf None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:00.691992 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:44:00.712831 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf321b3d-9b42-41e0-954b-d0ce242670d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:00.713457 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf321b3d-9b42-41e0-954b-d0ce242670d4 None admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:00.713734 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf321b3d-9b42-41e0-954b-d0ce242670d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:00.714001 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf321b3d-9b42-41e0-954b-d0ce242670d4 None admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:00.714639 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf321b3d-9b42-41e0-954b-d0ce242670d4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:44:00.716059 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf321b3d-9b42-41e0-954b-d0ce242670d4 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:44:00.741462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 560/1134] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Sep 26 17:44:00 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:44:02.894170 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91121b59-b1de-46a1-94b8-4ed1b9727be9 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:02.894702 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91121b59-b1de-46a1-94b8-4ed1b9727be9 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:02.894702 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91121b59-b1de-46a1-94b8-4ed1b9727be9 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:02.896021 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 575/1135] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:44:02.901359 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781ce4e-3a59-4624-9128-861a8cdc3448 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:02.901774 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781ce4e-3a59-4624-9128-861a8cdc3448 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:02.901908 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781ce4e-3a59-4624-9128-861a8cdc3448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:02.920300 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-f781ce4e-3a59-4624-9128-861a8cdc3448 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:44:02.921508 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-f781ce4e-3a59-4624-9128-861a8cdc3448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:44:02.985081 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 561/1136] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:44:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:44:03.255544 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91121b59-b1de-46a1-94b8-4ed1b9727be9 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:03.281484 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:44:03.354816 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91121b59-b1de-46a1-94b8-4ed1b9727be9 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:03.388433 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6893dd1c-5c45-4b33-9afc-aed25d2efda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:03.389087 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893dd1c-5c45-4b33-9afc-aed25d2efda6 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:03.389363 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893dd1c-5c45-4b33-9afc-aed25d2efda6 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:03.389628 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893dd1c-5c45-4b33-9afc-aed25d2efda6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:03.390734 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6893dd1c-5c45-4b33-9afc-aed25d2efda6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:44:03.392150 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6893dd1c-5c45-4b33-9afc-aed25d2efda6 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:44:03.394276 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 576/1137] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:44:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:44:03.399917 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781ce4e-3a59-4624-9128-861a8cdc3448 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:03.489606 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:44:03.495729 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781ce4e-3a59-4624-9128-861a8cdc3448 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:03.529445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b354f1-34d3-4c6a-8db1-9b78bfe7ad09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:03.529986 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b354f1-34d3-4c6a-8db1-9b78bfe7ad09 None admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:03.530311 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b354f1-34d3-4c6a-8db1-9b78bfe7ad09 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:03.530587 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b354f1-34d3-4c6a-8db1-9b78bfe7ad09 None admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:03.531241 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b354f1-34d3-4c6a-8db1-9b78bfe7ad09 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:44:03.532665 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b354f1-34d3-4c6a-8db1-9b78bfe7ad09 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:44:03.553498 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 562/1138] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Sep 26 17:44:03 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:44:05.702133 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebdf6c-f53d-4f03-930d-dc5f6491560f None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:05.702681 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebdf6c-f53d-4f03-930d-dc5f6491560f None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:05.702681 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebdf6c-f53d-4f03-930d-dc5f6491560f None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:05.703989 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 577/1139] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:44:05.709778 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72adaa97-9686-46b8-95ad-8e8d54314087 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:05.710178 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72adaa97-9686-46b8-95ad-8e8d54314087 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:05.710362 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72adaa97-9686-46b8-95ad-8e8d54314087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:05.728763 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-72adaa97-9686-46b8-95ad-8e8d54314087 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:44:05.729993 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-72adaa97-9686-46b8-95ad-8e8d54314087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:44:05.798064 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 563/1140] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:44:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:44:06.063790 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebdf6c-f53d-4f03-930d-dc5f6491560f None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:06.179368 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:44:06.193109 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebdf6c-f53d-4f03-930d-dc5f6491560f None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:06.230006 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b09e36-3032-43f2-bd35-314bb56f8a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:06.230627 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b09e36-3032-43f2-bd35-314bb56f8a45 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:06.230903 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b09e36-3032-43f2-bd35-314bb56f8a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:06.231174 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b09e36-3032-43f2-bd35-314bb56f8a45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:06.240875 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b09e36-3032-43f2-bd35-314bb56f8a45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:44:06.245628 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-a8b09e36-3032-43f2-bd35-314bb56f8a45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:44:06.245628 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:44:06.245628 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:44:06.245628 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:44:06.245628 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:44:06.245628 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:44:06.245628 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:44:06.245628 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:44:06.245628 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:44:06.245628 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:44:06.245628 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:44:06.245628 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:44:06.245628 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:44:06.245628 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:44:06.245628 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:44:06.245628 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:44:06.246696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:44:06.246696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:44:06.246696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:44:06.246696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:44:06.246696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:44:06.246696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:44:06.246696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:44:06.246696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:44:06.246696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:44:06.246696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:44:06.246696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:44:06.246696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:44:06.246696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:44:06.246696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:44:06.246696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:44:06.246696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:44:06.247893 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:44:06.247893 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:44:06.247893 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:44:06.247893 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:44:06.247893 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:44:06.247893 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:44:06.247893 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:44:06.247893 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:44:06.247893 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:44:06.247893 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:44:06.247893 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:44:06.247893 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:44:06.247893 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 578/1141] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Sep 26 17:44:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:44:06.253359 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72adaa97-9686-46b8-95ad-8e8d54314087 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:06.332379 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:44:06.350818 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72adaa97-9686-46b8-95ad-8e8d54314087 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:06.385939 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af2f68-d933-46f4-b7c2-8e0f773cdafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:06.386542 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af2f68-d933-46f4-b7c2-8e0f773cdafc None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:06.386817 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af2f68-d933-46f4-b7c2-8e0f773cdafc None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:06.387084 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af2f68-d933-46f4-b7c2-8e0f773cdafc None admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:06.387743 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af2f68-d933-46f4-b7c2-8e0f773cdafc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:44:06.388042 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af2f68-d933-46f4-b7c2-8e0f773cdafc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:44:06.389449 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af2f68-d933-46f4-b7c2-8e0f773cdafc None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:44:06.397507 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 564/1142] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:44:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:44:06.403600 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b09e36-3032-43f2-bd35-314bb56f8a45 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:06.501074 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b09e36-3032-43f2-bd35-314bb56f8a45 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:06.534199 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9242b-348b-4bc9-ad52-9ba39f496fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:06.534813 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9242b-348b-4bc9-ad52-9ba39f496fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:06.535085 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9242b-348b-4bc9-ad52-9ba39f496fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:06.535353 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9242b-348b-4bc9-ad52-9ba39f496fd7 None admin] PATH_INFO: `/v3/users/9980ef84da2c446f8ba48f2d4675a215` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:06.548400 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f9242b-348b-4bc9-ad52-9ba39f496fd7 None admin] RBAC: Authorizing `identity:get_user(user_id=9980ef84da2c446f8ba48f2d4675a215)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:44:06.550413 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f9242b-348b-4bc9-ad52-9ba39f496fd7 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:44:06.552028 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 579/1143] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:44:06 2022] GET /identity/v3/users/9980ef84da2c446f8ba48f2d4675a215 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:44:06.557891 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af2f68-d933-46f4-b7c2-8e0f773cdafc None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:06.654871 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af2f68-d933-46f4-b7c2-8e0f773cdafc None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:06.686883 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06f776-500d-43e4-9dc3-467e751c527d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:06.687477 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06f776-500d-43e4-9dc3-467e751c527d None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:06.687755 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06f776-500d-43e4-9dc3-467e751c527d None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:06.688026 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06f776-500d-43e4-9dc3-467e751c527d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:06.702522 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:44:06.754308 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab06f776-500d-43e4-9dc3-467e751c527d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:44:06.755749 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab06f776-500d-43e4-9dc3-467e751c527d None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:44:06.850166 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 565/1144] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:44:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 17:44:06.856093 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9242b-348b-4bc9-ad52-9ba39f496fd7 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:06.868614 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:44:06.954755 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9242b-348b-4bc9-ad52-9ba39f496fd7 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:06.987838 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b0519-b048-421b-a097-96096a17ba31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:06.988448 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b0519-b048-421b-a097-96096a17ba31 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:06.988721 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b0519-b048-421b-a097-96096a17ba31 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:06.988988 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b0519-b048-421b-a097-96096a17ba31 None admin] PATH_INFO: `/v3/projects/708949f1c01b4832b6f4df7870aebf9f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:06.990106 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b0519-b048-421b-a097-96096a17ba31 None admin] RBAC: Authorizing `identity:get_project(project_id=708949f1c01b4832b6f4df7870aebf9f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:44:06.991549 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b0519-b048-421b-a097-96096a17ba31 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:44:06.993173 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 580/1145] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:44:06 2022] GET /identity/v3/projects/708949f1c01b4832b6f4df7870aebf9f => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:44:06.999280 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06f776-500d-43e4-9dc3-467e751c527d None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:07.042730 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:44:07.095566 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06f776-500d-43e4-9dc3-467e751c527d None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:07.128115 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007b159-0417-4a9f-a4b6-684c2d671b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:07.128700 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007b159-0417-4a9f-a4b6-684c2d671b32 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:07.128972 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007b159-0417-4a9f-a4b6-684c2d671b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:07.129265 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007b159-0417-4a9f-a4b6-684c2d671b32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:07.129968 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c007b159-0417-4a9f-a4b6-684c2d671b32 None admin] RBAC: Adding query filter params (role.id=be6ee971abf54b26be509c14823ece55, scope.project.id=708949f1c01b4832b6f4df7870aebf9f, user.id=9980ef84da2c446f8ba48f2d4675a215) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:44:07.130268 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c007b159-0417-4a9f-a4b6-684c2d671b32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:44:07.131673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c007b159-0417-4a9f-a4b6-684c2d671b32 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:44:07.136792 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 566/1146] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:44:06 2022] GET /identity/v3/role_assignments?user.id=9980ef84da2c446f8ba48f2d4675a215&scope.project.id=708949f1c01b4832b6f4df7870aebf9f&role.id=be6ee971abf54b26be509c14823ece55 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:44:09.240068 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519512fd-7b16-4e49-adb2-df847ecbb488 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:09.240602 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519512fd-7b16-4e49-adb2-df847ecbb488 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:09.240602 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519512fd-7b16-4e49-adb2-df847ecbb488 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:09.241993 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 581/1147] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:44:09.247202 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316b077-0c03-49df-a071-2b83f4fe4646 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:09.247626 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316b077-0c03-49df-a071-2b83f4fe4646 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:09.247726 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316b077-0c03-49df-a071-2b83f4fe4646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:09.266152 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-f316b077-0c03-49df-a071-2b83f4fe4646 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:44:09.267915 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-f316b077-0c03-49df-a071-2b83f4fe4646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:44:09.333411 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 567/1148] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:44:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:44:09.601445 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519512fd-7b16-4e49-adb2-df847ecbb488 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:09.676469 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:44:09.698589 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519512fd-7b16-4e49-adb2-df847ecbb488 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:09.731524 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8cbb5-f6df-4b33-b115-9d9b55f74d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:09.732143 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8cbb5-f6df-4b33-b115-9d9b55f74d1b None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:09.732426 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8cbb5-f6df-4b33-b115-9d9b55f74d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:09.732700 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8cbb5-f6df-4b33-b115-9d9b55f74d1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:09.743073 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8cbb5-f6df-4b33-b115-9d9b55f74d1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:44:09.747861 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-a6d8cbb5-f6df-4b33-b115-9d9b55f74d1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:44:09.747861 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:44:09.747861 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:44:09.747861 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:44:09.747861 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:44:09.747861 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:44:09.747861 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:44:09.747861 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:44:09.747861 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:44:09.747861 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:44:09.747861 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:44:09.747861 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:44:09.747861 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:44:09.747861 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:44:09.747861 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:44:09.747861 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:44:09.748986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:44:09.748986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:44:09.748986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:44:09.748986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:44:09.748986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:44:09.748986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:44:09.748986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:44:09.748986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:44:09.748986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:44:09.748986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:44:09.748986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:44:09.748986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:44:09.748986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:44:09.748986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:44:09.748986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:44:09.748986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:44:09.750306 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:44:09.750306 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:44:09.750306 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:44:09.750306 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:44:09.750306 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:44:09.750306 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:44:09.750306 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:44:09.750306 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:44:09.750306 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:44:09.750306 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:44:09.750306 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:44:09.750306 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:44:09.750306 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 582/1149] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Sep 26 17:44:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:44:09.755030 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316b077-0c03-49df-a071-2b83f4fe4646 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:09.793691 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:44:09.854215 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316b077-0c03-49df-a071-2b83f4fe4646 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:09.899024 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3966d8f-9812-42ca-bf43-2086473cfde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:09.899638 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3966d8f-9812-42ca-bf43-2086473cfde8 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:09.899914 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3966d8f-9812-42ca-bf43-2086473cfde8 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:09.900179 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3966d8f-9812-42ca-bf43-2086473cfde8 None admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:09.900832 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3966d8f-9812-42ca-bf43-2086473cfde8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:44:09.901159 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3966d8f-9812-42ca-bf43-2086473cfde8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:44:09.902532 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3966d8f-9812-42ca-bf43-2086473cfde8 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:44:09.911170 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 568/1150] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:44:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:44:09.917031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8cbb5-f6df-4b33-b115-9d9b55f74d1b None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:10.012404 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8cbb5-f6df-4b33-b115-9d9b55f74d1b None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:10.044341 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be60aa-4504-4842-be7b-865803f047e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:10.044954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be60aa-4504-4842-be7b-865803f047e6 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:10.045249 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be60aa-4504-4842-be7b-865803f047e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:10.045516 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be60aa-4504-4842-be7b-865803f047e6 None admin] PATH_INFO: `/v3/users/9980ef84da2c446f8ba48f2d4675a215` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:10.046599 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be60aa-4504-4842-be7b-865803f047e6 None admin] RBAC: Authorizing `identity:get_user(user_id=9980ef84da2c446f8ba48f2d4675a215)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:44:10.048005 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be60aa-4504-4842-be7b-865803f047e6 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:44:10.049662 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 583/1151] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:44:09 2022] GET /identity/v3/users/9980ef84da2c446f8ba48f2d4675a215 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:44:10.055411 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3966d8f-9812-42ca-bf43-2086473cfde8 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:10.150732 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:44:10.153907 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3966d8f-9812-42ca-bf43-2086473cfde8 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:10.186924 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1c4fd-b2ab-4d4a-8352-8ce55ce56269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:10.187541 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1c4fd-b2ab-4d4a-8352-8ce55ce56269 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:10.187815 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1c4fd-b2ab-4d4a-8352-8ce55ce56269 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:10.188083 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1c4fd-b2ab-4d4a-8352-8ce55ce56269 None admin] PATH_INFO: `/v3/projects/708949f1c01b4832b6f4df7870aebf9f` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:10.189864 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1c4fd-b2ab-4d4a-8352-8ce55ce56269 None admin] RBAC: Authorizing `identity:get_project(project_id=708949f1c01b4832b6f4df7870aebf9f)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:44:10.191296 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1c4fd-b2ab-4d4a-8352-8ce55ce56269 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:44:10.192908 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 569/1152] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:44:10 2022] GET /identity/v3/projects/708949f1c01b4832b6f4df7870aebf9f => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:44:10.199475 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be60aa-4504-4842-be7b-865803f047e6 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:10.208511 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:44:10.296115 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be60aa-4504-4842-be7b-865803f047e6 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:10.329284 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256953a6-b553-4b92-ae61-233cae90e4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:10.329935 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256953a6-b553-4b92-ae61-233cae90e4ab None admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:10.330211 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256953a6-b553-4b92-ae61-233cae90e4ab None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:10.330478 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256953a6-b553-4b92-ae61-233cae90e4ab None admin] PATH_INFO: `/v3/projects/708949f1c01b4832b6f4df7870aebf9f/users/9980ef84da2c446f8ba48f2d4675a215/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:10.332347 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256953a6-b553-4b92-ae61-233cae90e4ab None admin] RBAC: Authorizing `identity:create_grant(project_id=708949f1c01b4832b6f4df7870aebf9f, user_id=9980ef84da2c446f8ba48f2d4675a215, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:44:10.333799 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256953a6-b553-4b92-ae61-233cae90e4ab None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:44:10.346517 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 584/1153] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Sep 26 17:44:10 2022] PUT /identity/v3/projects/708949f1c01b4832b6f4df7870aebf9f/users/9980ef84da2c446f8ba48f2d4675a215/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:44:12.458233 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fac1ce-987e-46c3-aced-626bd5e5bee4 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:12.458766 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fac1ce-987e-46c3-aced-626bd5e5bee4 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:12.458766 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fac1ce-987e-46c3-aced-626bd5e5bee4 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:12.460087 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 570/1154] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:44:12.465234 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42dd1e-6b93-4f50-89b7-ad5ed1ffe1cb None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:12.465667 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42dd1e-6b93-4f50-89b7-ad5ed1ffe1cb None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:12.465768 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42dd1e-6b93-4f50-89b7-ad5ed1ffe1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:12.484182 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-ff42dd1e-6b93-4f50-89b7-ad5ed1ffe1cb None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:44:12.485405 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-ff42dd1e-6b93-4f50-89b7-ad5ed1ffe1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:44:12.544831 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:44:12.552910 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 585/1155] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:44:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:44:12.820535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fac1ce-987e-46c3-aced-626bd5e5bee4 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:12.920268 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fac1ce-987e-46c3-aced-626bd5e5bee4 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:12.953000 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168cd54-50a4-4139-8973-45b8a778e39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:12.953629 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168cd54-50a4-4139-8973-45b8a778e39d None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:12.953902 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168cd54-50a4-4139-8973-45b8a778e39d None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:12.954168 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168cd54-50a4-4139-8973-45b8a778e39d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:12.964415 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f168cd54-50a4-4139-8973-45b8a778e39d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:44:12.969159 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-f168cd54-50a4-4139-8973-45b8a778e39d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:44:12.969159 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:44:12.969159 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:44:12.969159 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:44:12.969159 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:44:12.969159 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:44:12.969159 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:44:12.969159 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:44:12.969159 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:44:12.969159 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:44:12.969159 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:44:12.969159 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:44:12.969159 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:44:12.969159 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:44:12.969159 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:44:12.969159 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:44:12.970741 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:44:12.970741 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:44:12.970741 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:44:12.970741 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:44:12.970741 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:44:12.970741 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:44:12.970741 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:44:12.970741 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:44:12.970741 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:44:12.970741 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:44:12.970741 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:44:12.970741 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:44:12.970741 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:44:12.970741 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:44:12.970741 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:44:12.970741 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:44:12.971707 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:44:12.971707 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:44:12.971707 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:44:12.971707 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:44:12.971707 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:44:12.971707 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:44:12.971707 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:44:12.971707 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:44:12.971707 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:44:12.971707 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:44:12.971707 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:44:12.971707 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:44:12.971707 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 571/1156] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Sep 26 17:44:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:44:12.976969 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42dd1e-6b93-4f50-89b7-ad5ed1ffe1cb None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:13.074184 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42dd1e-6b93-4f50-89b7-ad5ed1ffe1cb None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:13.106779 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349a50a-e45f-4924-b544-4d6cddf0cca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:13.107372 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349a50a-e45f-4924-b544-4d6cddf0cca4 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:13.107650 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349a50a-e45f-4924-b544-4d6cddf0cca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:13.107909 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349a50a-e45f-4924-b544-4d6cddf0cca4 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:13.108553 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349a50a-e45f-4924-b544-4d6cddf0cca4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:44:13.108850 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349a50a-e45f-4924-b544-4d6cddf0cca4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:44:13.110226 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349a50a-e45f-4924-b544-4d6cddf0cca4 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:44:13.117848 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 586/1157] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:44:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:44:13.124329 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168cd54-50a4-4139-8973-45b8a778e39d None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:13.152352 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:44:13.223699 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168cd54-50a4-4139-8973-45b8a778e39d None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:13.255782 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5df262-6ed9-4311-bb6e-7db69a2a0e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:13.256399 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5df262-6ed9-4311-bb6e-7db69a2a0e02 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:13.256676 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5df262-6ed9-4311-bb6e-7db69a2a0e02 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:13.256948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5df262-6ed9-4311-bb6e-7db69a2a0e02 None admin] PATH_INFO: `/v3/users/9980ef84da2c446f8ba48f2d4675a215` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:13.258093 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5df262-6ed9-4311-bb6e-7db69a2a0e02 None admin] RBAC: Authorizing `identity:get_user(user_id=9980ef84da2c446f8ba48f2d4675a215)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:44:13.259520 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5df262-6ed9-4311-bb6e-7db69a2a0e02 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:44:13.261109 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 572/1158] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:44:13 2022] GET /identity/v3/users/9980ef84da2c446f8ba48f2d4675a215 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:44:13.267499 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349a50a-e45f-4924-b544-4d6cddf0cca4 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:13.323950 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:44:13.364576 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349a50a-e45f-4924-b544-4d6cddf0cca4 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:13.397413 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632af345-2351-42d7-99f1-bb9898833233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:13.398008 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632af345-2351-42d7-99f1-bb9898833233 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:13.398283 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632af345-2351-42d7-99f1-bb9898833233 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:13.398545 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632af345-2351-42d7-99f1-bb9898833233 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:13.463031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632af345-2351-42d7-99f1-bb9898833233 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:44:13.464459 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632af345-2351-42d7-99f1-bb9898833233 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:44:13.517670 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:44:13.559214 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 587/1159] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:44:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 17:44:13.565369 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5df262-6ed9-4311-bb6e-7db69a2a0e02 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:13.656726 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:44:13.663148 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5df262-6ed9-4311-bb6e-7db69a2a0e02 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:13.695759 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc61b4d-6b6a-4528-88ab-5efcec5c4f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:13.696376 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc61b4d-6b6a-4528-88ab-5efcec5c4f3c None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:13.696654 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc61b4d-6b6a-4528-88ab-5efcec5c4f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:13.696927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc61b4d-6b6a-4528-88ab-5efcec5c4f3c None admin] PATH_INFO: `/v3/projects/708949f1c01b4832b6f4df7870aebf9f` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:13.698064 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc61b4d-6b6a-4528-88ab-5efcec5c4f3c None admin] RBAC: Authorizing `identity:get_project(project_id=708949f1c01b4832b6f4df7870aebf9f)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:44:13.699767 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc61b4d-6b6a-4528-88ab-5efcec5c4f3c None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:44:13.701429 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 573/1160] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:44:13 2022] GET /identity/v3/projects/708949f1c01b4832b6f4df7870aebf9f => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:44:13.710528 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632af345-2351-42d7-99f1-bb9898833233 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:13.806096 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632af345-2351-42d7-99f1-bb9898833233 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:13.839802 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1961bd0d-7cac-478a-8862-318cf68a3744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:13.840395 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961bd0d-7cac-478a-8862-318cf68a3744 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:13.840673 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961bd0d-7cac-478a-8862-318cf68a3744 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:13.840942 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961bd0d-7cac-478a-8862-318cf68a3744 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:13.841695 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1961bd0d-7cac-478a-8862-318cf68a3744 None admin] RBAC: Adding query filter params (role.id=be6ee971abf54b26be509c14823ece55, scope.project.id=708949f1c01b4832b6f4df7870aebf9f, user.id=9980ef84da2c446f8ba48f2d4675a215) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:44:13.841994 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1961bd0d-7cac-478a-8862-318cf68a3744 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:44:13.843410 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1961bd0d-7cac-478a-8862-318cf68a3744 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:44:13.848970 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 588/1161] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:44:13 2022] GET /identity/v3/role_assignments?user.id=9980ef84da2c446f8ba48f2d4675a215&scope.project.id=708949f1c01b4832b6f4df7870aebf9f&role.id=be6ee971abf54b26be509c14823ece55 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:44:16.034593 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d04474-9341-4645-90a7-c189ac817d42 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:16.035138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d04474-9341-4645-90a7-c189ac817d42 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:16.035138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d04474-9341-4645-90a7-c189ac817d42 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:16.036491 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 574/1162] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:44:16.041678 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a03c7a-e729-4476-b9e0-db230815bc92 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:16.042070 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a03c7a-e729-4476-b9e0-db230815bc92 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:16.042224 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a03c7a-e729-4476-b9e0-db230815bc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:16.059928 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-43a03c7a-e729-4476-b9e0-db230815bc92 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:44:16.061140 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-43a03c7a-e729-4476-b9e0-db230815bc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:44:16.077627 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:44:16.127133 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 589/1163] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:44:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:44:16.392928 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d04474-9341-4645-90a7-c189ac817d42 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:16.493558 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d04474-9341-4645-90a7-c189ac817d42 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:16.526568 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095baa2-6b30-401d-b9e1-55796c78e936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:16.527160 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095baa2-6b30-401d-b9e1-55796c78e936 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:16.527437 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095baa2-6b30-401d-b9e1-55796c78e936 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:16.527707 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095baa2-6b30-401d-b9e1-55796c78e936 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:16.557441 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:44:16.594555 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095baa2-6b30-401d-b9e1-55796c78e936 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:44:16.596266 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095baa2-6b30-401d-b9e1-55796c78e936 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:44:16.691317 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 575/1164] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:44:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 17:44:16.697353 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a03c7a-e729-4476-b9e0-db230815bc92 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:16.791664 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a03c7a-e729-4476-b9e0-db230815bc92 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:16.824234 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1486640a-d771-4337-8d19-56a07734913f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:16.824850 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1486640a-d771-4337-8d19-56a07734913f None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:16.825159 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1486640a-d771-4337-8d19-56a07734913f None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:16.825521 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1486640a-d771-4337-8d19-56a07734913f None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:16.832557 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1486640a-d771-4337-8d19-56a07734913f None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:44:16.834018 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1486640a-d771-4337-8d19-56a07734913f None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:44:16.845212 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-1486640a-d771-4337-8d19-56a07734913f None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 26 17:44:16.845212 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:44:16.845212 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 26 17:44:16.845212 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 26 17:44:16.845212 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 17:44:16.845212 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 17:44:16.845212 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 17:44:16.845212 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 17:44:16.845212 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 26 17:44:16.845212 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:44:16.845212 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 17:44:16.845212 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:44:16.845212 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:44:16.845212 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:44:16.845212 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:44:16.845212 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:44:16.845212 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:44:16.846425 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:44:16.846425 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:44:16.846425 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:44:16.846425 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:44:16.846425 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:44:16.846425 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:44:16.846425 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:44:16.846425 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:44:16.846425 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:44:16.846425 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:44:16.846425 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:44:16.846425 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:44:16.846425 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:44:16.846425 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:44:16.846425 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:44:16.846425 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:44:16.847456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:44:16.847456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:44:16.847456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:44:16.847456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:44:16.847456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:44:16.847456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:44:16.847456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:44:16.847456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:44:16.847456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:44:16.847456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:44:16.847456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 26 17:44:16.847456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:44:16.847456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 26 17:44:16.847456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:44:16.847456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 590/1165] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Sep 26 17:44:16 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:44:16.852265 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095baa2-6b30-401d-b9e1-55796c78e936 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:16.911722 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:44:16.949614 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095baa2-6b30-401d-b9e1-55796c78e936 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:16.981746 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32d300-8d48-48d7-beb2-30c2b90e9ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:16.982404 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32d300-8d48-48d7-beb2-30c2b90e9ea8 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:16.982680 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32d300-8d48-48d7-beb2-30c2b90e9ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:16.982950 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32d300-8d48-48d7-beb2-30c2b90e9ea8 None admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:16.983578 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be32d300-8d48-48d7-beb2-30c2b90e9ea8 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:44:16.983876 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be32d300-8d48-48d7-beb2-30c2b90e9ea8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:44:16.985266 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be32d300-8d48-48d7-beb2-30c2b90e9ea8 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:44:16.992943 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 576/1166] 10.222.0.62 () {56 vars in 1115 bytes} [Mon Sep 26 17:44:16 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:44:19.186659 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16891f-8edd-4aa6-831d-35dc75eb0c8a None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:19.187178 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16891f-8edd-4aa6-831d-35dc75eb0c8a None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:19.187178 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16891f-8edd-4aa6-831d-35dc75eb0c8a None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:19.188574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 591/1167] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 17:44:19.193906 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac390bc1-ed07-424e-93bb-c6f18e38265b None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:19.194283 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac390bc1-ed07-424e-93bb-c6f18e38265b None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:19.194461 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac390bc1-ed07-424e-93bb-c6f18e38265b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:19.212849 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-ac390bc1-ed07-424e-93bb-c6f18e38265b None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:44:19.214059 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-ac390bc1-ed07-424e-93bb-c6f18e38265b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:44:19.277964 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 577/1168] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:44:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:44:19.543153 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16891f-8edd-4aa6-831d-35dc75eb0c8a None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:19.558092 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:44:19.644459 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16891f-8edd-4aa6-831d-35dc75eb0c8a None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:19.677000 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3817c9-15d3-4dbd-a3b2-3fd0ad05672e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:19.677620 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3817c9-15d3-4dbd-a3b2-3fd0ad05672e None admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:19.677900 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3817c9-15d3-4dbd-a3b2-3fd0ad05672e None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:19.678172 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3817c9-15d3-4dbd-a3b2-3fd0ad05672e None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:19.678831 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3817c9-15d3-4dbd-a3b2-3fd0ad05672e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:44:19.680194 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3817c9-15d3-4dbd-a3b2-3fd0ad05672e None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:44:19.696061 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 592/1169] 10.222.0.62 () {60 vars in 1138 bytes} [Mon Sep 26 17:44:19 2022] POST /identity/v3/domains => generated 267 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:44:21.856637 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcc8be-d65b-48b0-83fd-f00d7913c1b6 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:21.857593 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcc8be-d65b-48b0-83fd-f00d7913c1b6 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:21.857593 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcc8be-d65b-48b0-83fd-f00d7913c1b6 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:21.858552 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 578/1170] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:44:21.864475 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711bb4b-5337-454e-93b5-4f10a9af4da6 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:21.864873 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711bb4b-5337-454e-93b5-4f10a9af4da6 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:21.865032 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711bb4b-5337-454e-93b5-4f10a9af4da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:21.882731 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-b711bb4b-5337-454e-93b5-4f10a9af4da6 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:44:21.883967 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-b711bb4b-5337-454e-93b5-4f10a9af4da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:44:21.947948 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 593/1171] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:44:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:44:22.215360 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffcc8be-d65b-48b0-83fd-f00d7913c1b6 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:22.273986 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:44:22.315898 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffcc8be-d65b-48b0-83fd-f00d7913c1b6 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:22.349573 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be6797-d713-476a-ae7a-ff05dd47694a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:22.350190 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be6797-d713-476a-ae7a-ff05dd47694a None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:22.350470 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be6797-d713-476a-ae7a-ff05dd47694a None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:22.350741 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be6797-d713-476a-ae7a-ff05dd47694a None admin] PATH_INFO: `/v3/domains/f065d4c0777545ef85be17aeabb7f154` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:22.360801 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be6797-d713-476a-ae7a-ff05dd47694a None admin] RBAC: Authorizing `identity:get_domain(domain_id=f065d4c0777545ef85be17aeabb7f154)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:44:22.362283 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be6797-d713-476a-ae7a-ff05dd47694a None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:44:22.363867 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 579/1172] 10.222.0.62 () {56 vars in 1183 bytes} [Mon Sep 26 17:44:22 2022] GET /identity/v3/domains/f065d4c0777545ef85be17aeabb7f154 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:44:22.369775 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711bb4b-5337-454e-93b5-4f10a9af4da6 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:22.371926 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:44:22.465793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711bb4b-5337-454e-93b5-4f10a9af4da6 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:22.497772 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c57da-af34-4c55-bbd9-6e5efc759a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:22.498362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c57da-af34-4c55-bbd9-6e5efc759a1b None admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:22.498636 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c57da-af34-4c55-bbd9-6e5efc759a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:22.498899 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c57da-af34-4c55-bbd9-6e5efc759a1b None admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:22.499546 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c57da-af34-4c55-bbd9-6e5efc759a1b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:44:22.501495 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c57da-af34-4c55-bbd9-6e5efc759a1b None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:44:22.528105 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 594/1173] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Sep 26 17:44:22 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:44:24.664342 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818656d-e7e0-4c34-9506-b0383bba92d2 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:24.664881 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818656d-e7e0-4c34-9506-b0383bba92d2 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:24.664881 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818656d-e7e0-4c34-9506-b0383bba92d2 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:24.666210 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 580/1174] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:44:24.671559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509eed83-a4e0-41c7-b049-7d017ca01e8e None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:24.671935 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509eed83-a4e0-41c7-b049-7d017ca01e8e None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:24.672093 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509eed83-a4e0-41c7-b049-7d017ca01e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:24.689815 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-509eed83-a4e0-41c7-b049-7d017ca01e8e None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:44:24.690979 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-509eed83-a4e0-41c7-b049-7d017ca01e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:44:24.738683 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:44:24.756750 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 595/1175] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:44:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:44:25.023500 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818656d-e7e0-4c34-9506-b0383bba92d2 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:25.125364 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818656d-e7e0-4c34-9506-b0383bba92d2 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:25.142020 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:44:25.159236 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111d034-fe93-4190-93eb-53b4ee585046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:25.159848 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111d034-fe93-4190-93eb-53b4ee585046 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:25.160124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111d034-fe93-4190-93eb-53b4ee585046 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:25.160394 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111d034-fe93-4190-93eb-53b4ee585046 None admin] PATH_INFO: `/v3/domains/f065d4c0777545ef85be17aeabb7f154` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:25.161498 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2111d034-fe93-4190-93eb-53b4ee585046 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f065d4c0777545ef85be17aeabb7f154)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:44:25.162921 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2111d034-fe93-4190-93eb-53b4ee585046 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:44:25.164475 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 581/1176] 10.222.0.62 () {56 vars in 1183 bytes} [Mon Sep 26 17:44:25 2022] GET /identity/v3/domains/f065d4c0777545ef85be17aeabb7f154 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:44:25.170324 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509eed83-a4e0-41c7-b049-7d017ca01e8e None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:25.264645 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509eed83-a4e0-41c7-b049-7d017ca01e8e None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:25.297531 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec68cb-b7bc-4b73-a7e0-76500eb3fead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:25.298056 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec68cb-b7bc-4b73-a7e0-76500eb3fead None admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:25.298332 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec68cb-b7bc-4b73-a7e0-76500eb3fead None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:25.298602 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec68cb-b7bc-4b73-a7e0-76500eb3fead None admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:25.299249 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec68cb-b7bc-4b73-a7e0-76500eb3fead None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:44:25.300666 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec68cb-b7bc-4b73-a7e0-76500eb3fead None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:44:25.321267 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 596/1177] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Sep 26 17:44:25 2022] POST /identity/v3/users => generated 311 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 17:44:27.480851 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff90e9-a930-41f2-898b-837ed82d865a None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:27.481422 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff90e9-a930-41f2-898b-837ed82d865a None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:27.481422 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff90e9-a930-41f2-898b-837ed82d865a None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:27.482740 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 582/1178] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:44:27.487899 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736291b-784f-4189-b3d9-d63882bc0098 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:27.488315 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736291b-784f-4189-b3d9-d63882bc0098 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:27.488447 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736291b-784f-4189-b3d9-d63882bc0098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:27.508119 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-a736291b-784f-4189-b3d9-d63882bc0098 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:44:27.509354 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-a736291b-784f-4189-b3d9-d63882bc0098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:44:27.543479 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:44:27.576122 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 597/1179] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:44:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:44:27.843701 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff90e9-a930-41f2-898b-837ed82d865a None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:27.942543 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff90e9-a930-41f2-898b-837ed82d865a None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:27.975040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24df6b3-3eb9-43d2-bae6-84504376f5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:27.975654 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24df6b3-3eb9-43d2-bae6-84504376f5a1 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:27.975929 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24df6b3-3eb9-43d2-bae6-84504376f5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:27.976195 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24df6b3-3eb9-43d2-bae6-84504376f5a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:27.986602 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24df6b3-3eb9-43d2-bae6-84504376f5a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:44:27.991313 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-e24df6b3-3eb9-43d2-bae6-84504376f5a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:44:27.991313 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:44:27.991313 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:44:27.991313 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:44:27.991313 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:44:27.991313 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:44:27.991313 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:44:27.991313 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:44:27.991313 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:44:27.991313 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:44:27.991313 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:44:27.991313 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:44:27.991313 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:44:27.991313 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:44:27.991313 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:44:27.991313 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:44:27.992426 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:44:27.992426 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:44:27.992426 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:44:27.992426 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:44:27.992426 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:44:27.992426 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:44:27.992426 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:44:27.992426 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:44:27.992426 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:44:27.992426 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:44:27.992426 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:44:27.992426 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:44:27.992426 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:44:27.992426 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:44:27.992426 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:44:27.992426 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:44:27.993690 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:44:27.993690 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:44:27.993690 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:44:27.993690 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:44:27.993690 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:44:27.993690 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:44:27.993690 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:44:27.993690 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:44:27.993690 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:44:27.993690 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:44:27.993690 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:44:27.993690 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:44:27.993690 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 583/1180] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Sep 26 17:44:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:44:27.998394 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736291b-784f-4189-b3d9-d63882bc0098 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:28.096332 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736291b-784f-4189-b3d9-d63882bc0098 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:28.128085 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55f72a-f3ad-4ce6-99f7-28ffc7c89e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:28.128682 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55f72a-f3ad-4ce6-99f7-28ffc7c89e53 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:28.128961 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55f72a-f3ad-4ce6-99f7-28ffc7c89e53 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:28.129259 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55f72a-f3ad-4ce6-99f7-28ffc7c89e53 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:28.129913 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55f72a-f3ad-4ce6-99f7-28ffc7c89e53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:44:28.130214 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55f72a-f3ad-4ce6-99f7-28ffc7c89e53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:44:28.131567 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55f72a-f3ad-4ce6-99f7-28ffc7c89e53 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:44:28.139446 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 598/1181] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:44:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:44:28.145927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24df6b3-3eb9-43d2-bae6-84504376f5a1 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:28.191685 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:44:28.244857 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24df6b3-3eb9-43d2-bae6-84504376f5a1 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:28.277283 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7db782-fc1e-4f9d-8304-5238f928b7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:28.277908 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7db782-fc1e-4f9d-8304-5238f928b7c1 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:28.278181 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7db782-fc1e-4f9d-8304-5238f928b7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:28.278451 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7db782-fc1e-4f9d-8304-5238f928b7c1 None admin] PATH_INFO: `/v3/users/c0ccff4e4d97478884a88d742e1bf5fc` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:28.291754 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7db782-fc1e-4f9d-8304-5238f928b7c1 None admin] RBAC: Authorizing `identity:get_user(user_id=c0ccff4e4d97478884a88d742e1bf5fc)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:44:28.293213 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7db782-fc1e-4f9d-8304-5238f928b7c1 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:44:28.294815 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 584/1182] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:44:28 2022] GET /identity/v3/users/c0ccff4e4d97478884a88d742e1bf5fc => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:44:28.300614 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55f72a-f3ad-4ce6-99f7-28ffc7c89e53 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:28.331669 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:44:28.398546 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55f72a-f3ad-4ce6-99f7-28ffc7c89e53 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:28.430466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63450e03-3e57-4a27-89de-3ab35f70ab62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:28.431062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63450e03-3e57-4a27-89de-3ab35f70ab62 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:28.431335 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63450e03-3e57-4a27-89de-3ab35f70ab62 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:28.431600 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63450e03-3e57-4a27-89de-3ab35f70ab62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:28.496344 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63450e03-3e57-4a27-89de-3ab35f70ab62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:44:28.497822 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63450e03-3e57-4a27-89de-3ab35f70ab62 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:44:28.526828 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:44:28.595037 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 599/1183] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:44:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 17:44:28.601189 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7db782-fc1e-4f9d-8304-5238f928b7c1 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:28.697453 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7db782-fc1e-4f9d-8304-5238f928b7c1 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:28.699982 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:44:28.731742 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78024900-a66e-4f9f-ba46-8e55e2173c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:28.732349 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78024900-a66e-4f9f-ba46-8e55e2173c35 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:28.732625 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78024900-a66e-4f9f-ba46-8e55e2173c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:28.732893 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78024900-a66e-4f9f-ba46-8e55e2173c35 None admin] PATH_INFO: `/v3/projects/7d05b5e0126641fea01593097c533204` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:28.734014 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78024900-a66e-4f9f-ba46-8e55e2173c35 None admin] RBAC: Authorizing `identity:get_project(project_id=7d05b5e0126641fea01593097c533204)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:44:28.735477 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78024900-a66e-4f9f-ba46-8e55e2173c35 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:44:28.737112 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 585/1184] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:44:28 2022] GET /identity/v3/projects/7d05b5e0126641fea01593097c533204 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:44:28.743203 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63450e03-3e57-4a27-89de-3ab35f70ab62 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:28.840848 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63450e03-3e57-4a27-89de-3ab35f70ab62 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:28.869297 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:44:28.874443 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bc81f-b03e-448d-8a5f-262510fdf1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:28.875039 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bc81f-b03e-448d-8a5f-262510fdf1d9 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:28.875858 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bc81f-b03e-448d-8a5f-262510fdf1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:28.876131 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bc81f-b03e-448d-8a5f-262510fdf1d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:28.876838 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bc81f-b03e-448d-8a5f-262510fdf1d9 None admin] RBAC: Adding query filter params (role.id=be6ee971abf54b26be509c14823ece55, scope.project.id=7d05b5e0126641fea01593097c533204, user.id=c0ccff4e4d97478884a88d742e1bf5fc) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:44:28.877174 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bc81f-b03e-448d-8a5f-262510fdf1d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:44:28.878595 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bc81f-b03e-448d-8a5f-262510fdf1d9 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:44:28.883828 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 600/1185] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:44:28 2022] GET /identity/v3/role_assignments?user.id=c0ccff4e4d97478884a88d742e1bf5fc&scope.project.id=7d05b5e0126641fea01593097c533204&role.id=be6ee971abf54b26be509c14823ece55 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:44:30.975273 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad36d5-0263-4edb-bf76-54fcf9fab4a0 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:30.975865 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad36d5-0263-4edb-bf76-54fcf9fab4a0 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:30.975865 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad36d5-0263-4edb-bf76-54fcf9fab4a0 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:30.977178 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 586/1186] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:44:30.982422 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695dd7d-6111-471a-98df-568655028a8c None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:30.982793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695dd7d-6111-471a-98df-568655028a8c None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:30.982965 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695dd7d-6111-471a-98df-568655028a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:31.001569 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-8695dd7d-6111-471a-98df-568655028a8c None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:44:31.002756 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-8695dd7d-6111-471a-98df-568655028a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:44:31.069129 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 601/1187] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:44:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:44:31.342576 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad36d5-0263-4edb-bf76-54fcf9fab4a0 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:31.442121 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad36d5-0263-4edb-bf76-54fcf9fab4a0 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:31.474556 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65588c14-61a5-4e69-8d54-6c25d9807990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:31.475163 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65588c14-61a5-4e69-8d54-6c25d9807990 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:31.475435 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65588c14-61a5-4e69-8d54-6c25d9807990 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:31.475700 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65588c14-61a5-4e69-8d54-6c25d9807990 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:31.485964 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65588c14-61a5-4e69-8d54-6c25d9807990 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:44:31.490662 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-65588c14-61a5-4e69-8d54-6c25d9807990 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:44:31.490662 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:44:31.490662 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:44:31.490662 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:44:31.490662 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:44:31.490662 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:44:31.490662 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:44:31.490662 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:44:31.490662 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:44:31.490662 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:44:31.490662 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:44:31.490662 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:44:31.490662 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:44:31.490662 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:44:31.490662 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:44:31.490662 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:44:31.491761 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:44:31.491761 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:44:31.491761 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:44:31.491761 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:44:31.491761 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:44:31.491761 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:44:31.491761 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:44:31.491761 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:44:31.491761 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:44:31.491761 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:44:31.491761 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:44:31.491761 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:44:31.491761 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:44:31.491761 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:44:31.491761 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:44:31.491761 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:44:31.492632 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:44:31.492632 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:44:31.492632 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:44:31.492632 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:44:31.492632 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:44:31.492632 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:44:31.492632 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:44:31.492632 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:44:31.492632 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:44:31.492632 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:44:31.492632 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:44:31.492632 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:44:31.492632 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 587/1188] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Sep 26 17:44:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:44:31.497810 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695dd7d-6111-471a-98df-568655028a8c None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:31.591383 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695dd7d-6111-471a-98df-568655028a8c None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:31.617705 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:44:31.631061 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87117515-e253-4d11-8228-6df1bf3fce08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:31.631663 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87117515-e253-4d11-8228-6df1bf3fce08 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:31.631938 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87117515-e253-4d11-8228-6df1bf3fce08 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:31.632202 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87117515-e253-4d11-8228-6df1bf3fce08 None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:31.632852 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87117515-e253-4d11-8228-6df1bf3fce08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:44:31.633184 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87117515-e253-4d11-8228-6df1bf3fce08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:44:31.634533 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87117515-e253-4d11-8228-6df1bf3fce08 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:44:31.643102 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 602/1189] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:44:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:44:31.649139 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65588c14-61a5-4e69-8d54-6c25d9807990 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:31.679706 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:44:31.747727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65588c14-61a5-4e69-8d54-6c25d9807990 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:31.782037 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91748e23-235b-44fc-b111-faea77bf9f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:31.782645 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91748e23-235b-44fc-b111-faea77bf9f6c None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:31.782920 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91748e23-235b-44fc-b111-faea77bf9f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:31.783186 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91748e23-235b-44fc-b111-faea77bf9f6c None admin] PATH_INFO: `/v3/users/c0ccff4e4d97478884a88d742e1bf5fc` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:31.784284 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91748e23-235b-44fc-b111-faea77bf9f6c None admin] RBAC: Authorizing `identity:get_user(user_id=c0ccff4e4d97478884a88d742e1bf5fc)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:44:31.785732 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91748e23-235b-44fc-b111-faea77bf9f6c None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:44:31.787296 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 588/1190] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:44:31 2022] GET /identity/v3/users/c0ccff4e4d97478884a88d742e1bf5fc => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:44:31.793147 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87117515-e253-4d11-8228-6df1bf3fce08 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:31.888982 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87117515-e253-4d11-8228-6df1bf3fce08 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:31.920403 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f521b0e-0430-418e-b968-193010355587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:31.921045 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f521b0e-0430-418e-b968-193010355587 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:31.921310 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f521b0e-0430-418e-b968-193010355587 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:31.921580 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f521b0e-0430-418e-b968-193010355587 None admin] PATH_INFO: `/v3/projects/7d05b5e0126641fea01593097c533204` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:31.923177 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f521b0e-0430-418e-b968-193010355587 None admin] RBAC: Authorizing `identity:get_project(project_id=7d05b5e0126641fea01593097c533204)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:44:31.924580 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f521b0e-0430-418e-b968-193010355587 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:44:31.926199 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 603/1191] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:44:31 2022] GET /identity/v3/projects/7d05b5e0126641fea01593097c533204 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:44:31.932139 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91748e23-235b-44fc-b111-faea77bf9f6c None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:32.025893 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:44:32.028963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91748e23-235b-44fc-b111-faea77bf9f6c None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:32.062133 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3c1c5-9ebe-4b6d-873f-b0b2555d0d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:32.063372 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3c1c5-9ebe-4b6d-873f-b0b2555d0d8f None admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:32.063643 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3c1c5-9ebe-4b6d-873f-b0b2555d0d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:32.063908 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3c1c5-9ebe-4b6d-873f-b0b2555d0d8f None admin] PATH_INFO: `/v3/projects/7d05b5e0126641fea01593097c533204/users/c0ccff4e4d97478884a88d742e1bf5fc/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:32.065803 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3c1c5-9ebe-4b6d-873f-b0b2555d0d8f None admin] RBAC: Authorizing `identity:create_grant(project_id=7d05b5e0126641fea01593097c533204, user_id=c0ccff4e4d97478884a88d742e1bf5fc, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:44:32.067221 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3c1c5-9ebe-4b6d-873f-b0b2555d0d8f None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:44:32.080213 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 589/1192] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Sep 26 17:44:31 2022] PUT /identity/v3/projects/7d05b5e0126641fea01593097c533204/users/c0ccff4e4d97478884a88d742e1bf5fc/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:44:34.236216 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48107381-9dad-4f01-a8d4-bef035c66f73 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:34.236747 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48107381-9dad-4f01-a8d4-bef035c66f73 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:34.236839 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48107381-9dad-4f01-a8d4-bef035c66f73 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:34.238153 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 604/1193] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:44:34.243312 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb2f49-bd7f-40b7-be45-a370c055f5c6 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:34.243707 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb2f49-bd7f-40b7-be45-a370c055f5c6 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:34.243864 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb2f49-bd7f-40b7-be45-a370c055f5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:34.262553 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-adcb2f49-bd7f-40b7-be45-a370c055f5c6 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:44:34.263744 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-adcb2f49-bd7f-40b7-be45-a370c055f5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:44:34.334982 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 590/1194] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:44:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:44:34.601895 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48107381-9dad-4f01-a8d4-bef035c66f73 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:34.660316 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:44:34.704917 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48107381-9dad-4f01-a8d4-bef035c66f73 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:34.736720 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cd046-bbaf-4968-9629-f3dd19c7543e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:34.737370 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cd046-bbaf-4968-9629-f3dd19c7543e None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:34.737649 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cd046-bbaf-4968-9629-f3dd19c7543e None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:34.737916 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cd046-bbaf-4968-9629-f3dd19c7543e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:34.747692 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cd046-bbaf-4968-9629-f3dd19c7543e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:44:34.752944 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-749cd046-bbaf-4968-9629-f3dd19c7543e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:44:34.752944 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:44:34.752944 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:44:34.752944 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:44:34.752944 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:44:34.752944 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:44:34.752944 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:44:34.752944 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:44:34.752944 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:44:34.752944 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:44:34.752944 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:44:34.752944 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:44:34.752944 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:44:34.752944 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:44:34.752944 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:44:34.752944 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:44:34.754040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:44:34.754040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:44:34.754040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:44:34.754040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:44:34.754040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:44:34.754040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:44:34.754040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:44:34.754040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:44:34.754040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:44:34.754040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:44:34.754040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:44:34.754040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:44:34.754040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:44:34.754040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:44:34.754040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:44:34.754040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:44:34.754916 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:44:34.754916 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:44:34.754916 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:44:34.754916 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:44:34.754916 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:44:34.754916 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:44:34.754916 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:44:34.754916 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:44:34.754916 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:44:34.754916 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:44:34.754916 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:44:34.754916 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:44:34.754916 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 605/1195] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Sep 26 17:44:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:44:34.760138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb2f49-bd7f-40b7-be45-a370c055f5c6 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:34.845739 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:44:34.856148 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb2f49-bd7f-40b7-be45-a370c055f5c6 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:34.889783 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697010d5-137a-4a9a-affa-8894c57d3662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:34.890412 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697010d5-137a-4a9a-affa-8894c57d3662 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:34.890689 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697010d5-137a-4a9a-affa-8894c57d3662 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:34.890959 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697010d5-137a-4a9a-affa-8894c57d3662 None admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:34.891612 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697010d5-137a-4a9a-affa-8894c57d3662 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:44:34.891910 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697010d5-137a-4a9a-affa-8894c57d3662 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:44:34.893296 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697010d5-137a-4a9a-affa-8894c57d3662 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:44:34.901029 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 591/1196] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:44:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:44:34.906946 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cd046-bbaf-4968-9629-f3dd19c7543e None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:35.005348 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cd046-bbaf-4968-9629-f3dd19c7543e None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:35.020940 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:44:35.038511 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301ad48-d9ae-4546-8e02-aac674ed9105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:35.039133 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301ad48-d9ae-4546-8e02-aac674ed9105 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:35.039411 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301ad48-d9ae-4546-8e02-aac674ed9105 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:35.039681 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301ad48-d9ae-4546-8e02-aac674ed9105 None admin] PATH_INFO: `/v3/users/c0ccff4e4d97478884a88d742e1bf5fc` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:35.040782 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301ad48-d9ae-4546-8e02-aac674ed9105 None admin] RBAC: Authorizing `identity:get_user(user_id=c0ccff4e4d97478884a88d742e1bf5fc)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:44:35.042237 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301ad48-d9ae-4546-8e02-aac674ed9105 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:44:35.043879 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 606/1197] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Sep 26 17:44:34 2022] GET /identity/v3/users/c0ccff4e4d97478884a88d742e1bf5fc => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:44:35.050397 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697010d5-137a-4a9a-affa-8894c57d3662 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:35.148812 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697010d5-137a-4a9a-affa-8894c57d3662 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:35.182347 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d156602-1d4b-4bb8-9ef8-e4d2fa7f9486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:35.182941 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d156602-1d4b-4bb8-9ef8-e4d2fa7f9486 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:35.183216 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d156602-1d4b-4bb8-9ef8-e4d2fa7f9486 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:35.183642 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d156602-1d4b-4bb8-9ef8-e4d2fa7f9486 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:35.204684 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:44:35.250162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d156602-1d4b-4bb8-9ef8-e4d2fa7f9486 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:44:35.251597 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d156602-1d4b-4bb8-9ef8-e4d2fa7f9486 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:44:35.345413 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 592/1198] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:44:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 17:44:35.351337 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301ad48-d9ae-4546-8e02-aac674ed9105 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:35.447930 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301ad48-d9ae-4546-8e02-aac674ed9105 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:35.480437 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684eba1-41c9-4a0a-b6ed-b1f07b8d6dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:35.481082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684eba1-41c9-4a0a-b6ed-b1f07b8d6dba None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:35.481359 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684eba1-41c9-4a0a-b6ed-b1f07b8d6dba None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:35.481627 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684eba1-41c9-4a0a-b6ed-b1f07b8d6dba None admin] PATH_INFO: `/v3/projects/7d05b5e0126641fea01593097c533204` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:35.482721 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684eba1-41c9-4a0a-b6ed-b1f07b8d6dba None admin] RBAC: Authorizing `identity:get_project(project_id=7d05b5e0126641fea01593097c533204)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:44:35.484137 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684eba1-41c9-4a0a-b6ed-b1f07b8d6dba None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:44:35.485789 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 607/1199] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Sep 26 17:44:35 2022] GET /identity/v3/projects/7d05b5e0126641fea01593097c533204 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:44:35.491975 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d156602-1d4b-4bb8-9ef8-e4d2fa7f9486 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:44:35.543154 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:44:35.589327 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d156602-1d4b-4bb8-9ef8-e4d2fa7f9486 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:44:35.622201 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a783f-326e-49a5-bb6c-7d512c6f28eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:44:35.622791 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a783f-326e-49a5-bb6c-7d512c6f28eb None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:44:35.623075 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a783f-326e-49a5-bb6c-7d512c6f28eb None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:44:35.623340 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a783f-326e-49a5-bb6c-7d512c6f28eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:44:35.624048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7a783f-326e-49a5-bb6c-7d512c6f28eb None admin] RBAC: Adding query filter params (role.id=be6ee971abf54b26be509c14823ece55, scope.project.id=7d05b5e0126641fea01593097c533204, user.id=c0ccff4e4d97478884a88d742e1bf5fc) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:44:35.624353 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7a783f-326e-49a5-bb6c-7d512c6f28eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:44:35.626415 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7a783f-326e-49a5-bb6c-7d512c6f28eb None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:44:35.632019 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 593/1200] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:44:35 2022] GET /identity/v3/role_assignments?user.id=c0ccff4e4d97478884a88d742e1bf5fc&scope.project.id=7d05b5e0126641fea01593097c533204&role.id=be6ee971abf54b26be509c14823ece55 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:44:45.476229 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=74 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:44:45.629453 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=42 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:31.519427 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab22fd-7d99-4eb4-b020-dd32e3903c4d None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:31.520043 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab22fd-7d99-4eb4-b020-dd32e3903c4d None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:31.520043 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab22fd-7d99-4eb4-b020-dd32e3903c4d None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:31.522023 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 608/1201] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:45:31.528311 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93321024-fb39-4e3f-8ae9-9598b6e35d0c None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:31.528980 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93321024-fb39-4e3f-8ae9-9598b6e35d0c None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:31.529344 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93321024-fb39-4e3f-8ae9-9598b6e35d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:31.553583 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-93321024-fb39-4e3f-8ae9-9598b6e35d0c None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:45:31.554867 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-93321024-fb39-4e3f-8ae9-9598b6e35d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:45:31.645685 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 594/1202] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:45:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 17:45:31.985297 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab22fd-7d99-4eb4-b020-dd32e3903c4d None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:32.112581 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab22fd-7d99-4eb4-b020-dd32e3903c4d None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:32.156245 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee436bec-91d4-4cab-957a-36bc99087c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:32.157034 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee436bec-91d4-4cab-957a-36bc99087c3d None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:32.157334 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee436bec-91d4-4cab-957a-36bc99087c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:32.157737 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee436bec-91d4-4cab-957a-36bc99087c3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:32.170128 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee436bec-91d4-4cab-957a-36bc99087c3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:32.171900 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee436bec-91d4-4cab-957a-36bc99087c3d None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:32.192128 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-ee436bec-91d4-4cab-957a-36bc99087c3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:45:32.192128 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:45:32.192128 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:45:32.192128 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:45:32.192128 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:45:32.192128 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:45:32.192128 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:45:32.192128 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:45:32.192128 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:45:32.192128 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:45:32.192128 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:45:32.192128 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:45:32.192128 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:45:32.192128 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:45:32.192128 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:45:32.192128 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:45:32.199181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:45:32.199181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:45:32.199181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:45:32.199181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:45:32.199181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:45:32.199181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:45:32.199181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:45:32.199181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:45:32.199181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:45:32.199181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:45:32.199181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:45:32.199181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:45:32.199181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:45:32.199181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:45:32.199181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:45:32.199181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:45:32.199181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:45:32.200149 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:45:32.200149 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:45:32.200149 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:45:32.200149 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 609/1203] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:45:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:45:32.206620 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93321024-fb39-4e3f-8ae9-9598b6e35d0c None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:32.338617 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93321024-fb39-4e3f-8ae9-9598b6e35d0c None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:32.375898 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:32.388123 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89420e-feaf-4798-b7b4-df26952cad67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:32.388774 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89420e-feaf-4798-b7b4-df26952cad67 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:32.389085 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89420e-feaf-4798-b7b4-df26952cad67 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:32.389389 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89420e-feaf-4798-b7b4-df26952cad67 None admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:32.390015 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89420e-feaf-4798-b7b4-df26952cad67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:45:32.390335 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89420e-feaf-4798-b7b4-df26952cad67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:32.391703 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89420e-feaf-4798-b7b4-df26952cad67 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:32.406841 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 595/1204] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:45:32.418122 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee436bec-91d4-4cab-957a-36bc99087c3d None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:32.485769 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:32.555127 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee436bec-91d4-4cab-957a-36bc99087c3d None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:32.607112 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0e2f9-dbc7-4251-8c41-6f66df87eb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:32.607709 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0e2f9-dbc7-4251-8c41-6f66df87eb6b None admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:32.608011 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0e2f9-dbc7-4251-8c41-6f66df87eb6b None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:32.608312 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0e2f9-dbc7-4251-8c41-6f66df87eb6b None admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:32.609001 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff0e2f9-dbc7-4251-8c41-6f66df87eb6b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:32.610489 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff0e2f9-dbc7-4251-8c41-6f66df87eb6b None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:32.638909 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 610/1205] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Sep 26 17:45:32 2022] POST /identity/v3/users => generated 251 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:45:35.118945 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a0308-2f63-4e3b-a496-b31ed690405e None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:35.119487 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a0308-2f63-4e3b-a496-b31ed690405e None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:35.119597 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a0308-2f63-4e3b-a496-b31ed690405e None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:35.121320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 596/1206] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:45:35.127538 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b6ba4-82ed-47ac-b797-c63bd4ea2388 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:35.128013 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b6ba4-82ed-47ac-b797-c63bd4ea2388 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:35.128211 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b6ba4-82ed-47ac-b797-c63bd4ea2388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:35.148466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-2c8b6ba4-82ed-47ac-b797-c63bd4ea2388 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:45:35.149939 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-2c8b6ba4-82ed-47ac-b797-c63bd4ea2388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:45:35.234543 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 611/1207] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:45:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:45:35.510856 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a0308-2f63-4e3b-a496-b31ed690405e None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:35.640169 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a0308-2f63-4e3b-a496-b31ed690405e None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:35.682575 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e33cf-5370-4bd6-af46-65902bc6ac51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:35.683207 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e33cf-5370-4bd6-af46-65902bc6ac51 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:35.683484 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e33cf-5370-4bd6-af46-65902bc6ac51 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:35.683750 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e33cf-5370-4bd6-af46-65902bc6ac51 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:35.697274 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33e33cf-5370-4bd6-af46-65902bc6ac51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:45:35.702054 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-a33e33cf-5370-4bd6-af46-65902bc6ac51 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:45:35.702054 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:45:35.702054 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:45:35.702054 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:45:35.702054 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:45:35.702054 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:45:35.702054 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:45:35.702054 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:45:35.702054 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:45:35.702054 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:45:35.702054 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:45:35.702054 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:45:35.702054 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:45:35.702054 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:45:35.702054 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:45:35.702054 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:45:35.703201 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:45:35.703201 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:45:35.703201 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:45:35.703201 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:45:35.703201 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:45:35.703201 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:45:35.703201 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:45:35.703201 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:45:35.703201 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:45:35.703201 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:45:35.703201 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:45:35.703201 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:45:35.703201 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:45:35.703201 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:45:35.703201 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:45:35.703201 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:45:35.704094 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:45:35.704094 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:45:35.704094 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:45:35.704094 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:45:35.704094 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:45:35.704094 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:45:35.704094 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:45:35.704094 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:45:35.704094 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:45:35.704094 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:45:35.704094 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:45:35.704094 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:45:35.704094 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 597/1208] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Sep 26 17:45:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:45:35.709967 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b6ba4-82ed-47ac-b797-c63bd4ea2388 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:35.755744 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:35.825326 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b6ba4-82ed-47ac-b797-c63bd4ea2388 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:35.867756 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a502c23-0031-4992-81e9-270caaa7965e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:35.868424 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a502c23-0031-4992-81e9-270caaa7965e None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:35.868717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a502c23-0031-4992-81e9-270caaa7965e None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:35.869619 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a502c23-0031-4992-81e9-270caaa7965e None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:35.870378 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a502c23-0031-4992-81e9-270caaa7965e None admin] RBAC: Adding query filter params (name=service) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:45:35.870743 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a502c23-0031-4992-81e9-270caaa7965e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:35.872263 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a502c23-0031-4992-81e9-270caaa7965e None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:35.881659 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 612/1209] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Sep 26 17:45:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:45:35.887215 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e33cf-5370-4bd6-af46-65902bc6ac51 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:35.949414 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:36.007559 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e33cf-5370-4bd6-af46-65902bc6ac51 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:36.046570 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98319b-2bd9-49f0-a0bd-2450de8815eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:36.047412 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98319b-2bd9-49f0-a0bd-2450de8815eb None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:36.047786 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98319b-2bd9-49f0-a0bd-2450de8815eb None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:36.048158 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98319b-2bd9-49f0-a0bd-2450de8815eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:36.065705 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98319b-2bd9-49f0-a0bd-2450de8815eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:36.068135 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98319b-2bd9-49f0-a0bd-2450de8815eb None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:36.094616 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-7f98319b-2bd9-49f0-a0bd-2450de8815eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:45:36.094616 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:45:36.094616 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:45:36.094616 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:45:36.094616 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:45:36.094616 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:45:36.094616 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:45:36.094616 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:45:36.094616 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:45:36.094616 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:45:36.094616 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:45:36.094616 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:45:36.094616 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:45:36.094616 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:45:36.094616 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:45:36.094616 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:45:36.103972 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:45:36.103972 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:45:36.103972 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:45:36.103972 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:45:36.103972 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:45:36.103972 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:45:36.103972 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:45:36.103972 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:45:36.103972 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:45:36.103972 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:45:36.103972 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:45:36.103972 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:45:36.103972 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:45:36.103972 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:45:36.103972 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:45:36.103972 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:45:36.103972 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:45:36.105273 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:45:36.105273 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:45:36.105273 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:45:36.105273 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 598/1210] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:45:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:45:36.105565 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a502c23-0031-4992-81e9-270caaa7965e None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:36.244132 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:36.246740 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a502c23-0031-4992-81e9-270caaa7965e None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:36.282373 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147a52c-04ac-48ca-9a8f-2aecd3018b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:36.282994 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147a52c-04ac-48ca-9a8f-2aecd3018b7e None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:36.283269 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147a52c-04ac-48ca-9a8f-2aecd3018b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:36.283544 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147a52c-04ac-48ca-9a8f-2aecd3018b7e None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:36.284176 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147a52c-04ac-48ca-9a8f-2aecd3018b7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:45:36.284488 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147a52c-04ac-48ca-9a8f-2aecd3018b7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:36.285918 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147a52c-04ac-48ca-9a8f-2aecd3018b7e None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:36.299358 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 613/1211] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:45:36.305032 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98319b-2bd9-49f0-a0bd-2450de8815eb None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:36.433919 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98319b-2bd9-49f0-a0bd-2450de8815eb None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:36.436807 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:36.484928 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29acaed-2730-472c-837b-7962241f7b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:36.485872 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29acaed-2730-472c-837b-7962241f7b91 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:36.486161 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29acaed-2730-472c-837b-7962241f7b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:36.486436 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29acaed-2730-472c-837b-7962241f7b91 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:36.496106 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29acaed-2730-472c-837b-7962241f7b91 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:36.497535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29acaed-2730-472c-837b-7962241f7b91 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:36.509026 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-b29acaed-2730-472c-837b-7962241f7b91 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 26 17:45:36.509026 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:45:36.509026 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:45:36.509026 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:45:36.509026 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:45:36.509026 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:45:36.509026 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:45:36.509026 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:45:36.509026 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:45:36.509026 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:45:36.509026 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:45:36.509026 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:45:36.509026 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 17:45:36.509026 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 17:45:36.509026 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 17:45:36.509026 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 17:45:36.510236 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:45:36.510236 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:45:36.510236 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 17:45:36.510236 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:45:36.510236 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 17:45:36.510236 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:45:36.510236 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:45:36.510236 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:45:36.510236 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:45:36.510236 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:45:36.510236 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:45:36.510236 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:45:36.510236 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:45:36.510236 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:45:36.510236 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:45:36.510236 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:45:36.510236 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:45:36.510236 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:45:36.511424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:45:36.511424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:45:36.511424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 17:45:36.511424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 17:45:36.511424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 17:45:36.511424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 17:45:36.511424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 17:45:36.511424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 17:45:36.511424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 26 17:45:36.511424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:45:36.513177 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 599/1212] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:45:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:45:36.516178 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147a52c-04ac-48ca-9a8f-2aecd3018b7e None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:36.627001 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147a52c-04ac-48ca-9a8f-2aecd3018b7e None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:36.661233 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed53ab9-f5b8-4530-bd46-54bce4ea0e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:36.661844 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed53ab9-f5b8-4530-bd46-54bce4ea0e2c None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:36.662124 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed53ab9-f5b8-4530-bd46-54bce4ea0e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:36.662668 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed53ab9-f5b8-4530-bd46-54bce4ea0e2c None admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:36.663135 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed53ab9-f5b8-4530-bd46-54bce4ea0e2c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:45:36.663432 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed53ab9-f5b8-4530-bd46-54bce4ea0e2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:36.664868 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed53ab9-f5b8-4530-bd46-54bce4ea0e2c None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:36.684577 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 614/1213] 10.222.0.62 () {56 vars in 1143 bytes} [Mon Sep 26 17:45:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:45:36.690316 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29acaed-2730-472c-837b-7962241f7b91 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:36.811301 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29acaed-2730-472c-837b-7962241f7b91 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:36.850587 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2290c-69b2-4c3a-bf91-8d1f72376326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:36.851821 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2290c-69b2-4c3a-bf91-8d1f72376326 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:36.852147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2290c-69b2-4c3a-bf91-8d1f72376326 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:36.852416 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2290c-69b2-4c3a-bf91-8d1f72376326 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:36.888286 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:36.933403 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2290c-69b2-4c3a-bf91-8d1f72376326 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:36.935000 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2290c-69b2-4c3a-bf91-8d1f72376326 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:37.053449 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 600/1214] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:45:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 17:45:37.054868 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed53ab9-f5b8-4530-bd46-54bce4ea0e2c None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:37.081905 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:37.187700 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed53ab9-f5b8-4530-bd46-54bce4ea0e2c None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:37.227119 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28249221-5983-4ceb-a52a-7848ec1fed14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:37.228011 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28249221-5983-4ceb-a52a-7848ec1fed14 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:37.228900 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28249221-5983-4ceb-a52a-7848ec1fed14 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:37.229259 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28249221-5983-4ceb-a52a-7848ec1fed14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:37.245420 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28249221-5983-4ceb-a52a-7848ec1fed14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:37.246876 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28249221-5983-4ceb-a52a-7848ec1fed14 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:37.264327 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-28249221-5983-4ceb-a52a-7848ec1fed14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:45:37.264327 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:45:37.264327 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:45:37.264327 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:45:37.264327 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:45:37.264327 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:45:37.264327 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:45:37.264327 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:45:37.264327 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:45:37.264327 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:45:37.264327 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:45:37.264327 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:45:37.264327 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:45:37.264327 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:45:37.264327 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:45:37.264327 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:45:37.265621 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:45:37.265621 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:45:37.265621 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:45:37.265621 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:45:37.265621 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:45:37.265621 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:45:37.265621 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:45:37.265621 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:45:37.265621 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:45:37.265621 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:45:37.265621 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:45:37.265621 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:45:37.265621 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:45:37.265621 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:45:37.265621 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:45:37.265621 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:45:37.265621 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:45:37.266735 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:45:37.266735 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:45:37.266735 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:45:37.266735 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 615/1215] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:45:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:45:37.272986 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2290c-69b2-4c3a-bf91-8d1f72376326 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:37.343419 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:37.387038 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2290c-69b2-4c3a-bf91-8d1f72376326 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:37.424866 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f3c55-301e-4d17-966a-5073307cf60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:37.425506 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f3c55-301e-4d17-966a-5073307cf60d None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:37.425784 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f3c55-301e-4d17-966a-5073307cf60d None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:37.426052 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f3c55-301e-4d17-966a-5073307cf60d None admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:37.426722 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f3c55-301e-4d17-966a-5073307cf60d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:45:37.427024 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f3c55-301e-4d17-966a-5073307cf60d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:37.428476 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f3c55-301e-4d17-966a-5073307cf60d None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:37.440670 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 601/1216] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:45:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:45:37.447596 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28249221-5983-4ceb-a52a-7848ec1fed14 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:37.527738 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:37.568055 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28249221-5983-4ceb-a52a-7848ec1fed14 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:37.606230 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711bfc55-19cd-4a72-8119-b8de53e821ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:37.606913 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bfc55-19cd-4a72-8119-b8de53e821ce None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:37.607190 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bfc55-19cd-4a72-8119-b8de53e821ce None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:37.607646 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bfc55-19cd-4a72-8119-b8de53e821ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:37.615044 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711bfc55-19cd-4a72-8119-b8de53e821ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:37.616610 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711bfc55-19cd-4a72-8119-b8de53e821ce None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:37.630624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-711bfc55-19cd-4a72-8119-b8de53e821ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:45:37.630624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:45:37.630624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:45:37.630624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:45:37.630624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:45:37.630624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:45:37.630624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:45:37.630624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:45:37.630624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:45:37.630624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:45:37.630624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:45:37.630624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:45:37.630624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 17:45:37.630624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 17:45:37.630624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 17:45:37.631782 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 17:45:37.631782 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:45:37.631782 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:45:37.631782 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:45:37.631782 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:45:37.631782 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:45:37.631782 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:45:37.631782 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:45:37.631782 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:45:37.631782 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:45:37.631782 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:45:37.631782 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:45:37.631782 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:45:37.631782 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:45:37.631782 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:45:37.631782 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:45:37.631782 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:45:37.632824 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 17:45:37.632824 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 17:45:37.632824 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 17:45:37.632824 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 17:45:37.632824 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 17:45:37.632824 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 17:45:37.632824 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:45:37.632824 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:45:37.632824 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 616/1217] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:45:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:45:37.638938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f3c55-301e-4d17-966a-5073307cf60d None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:37.747437 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f3c55-301e-4d17-966a-5073307cf60d None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:37.770339 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:37.783510 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790940a0-437e-4d68-81ba-7c7206623831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:37.784116 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790940a0-437e-4d68-81ba-7c7206623831 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:37.784397 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790940a0-437e-4d68-81ba-7c7206623831 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:37.784704 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790940a0-437e-4d68-81ba-7c7206623831 None admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:37.785411 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790940a0-437e-4d68-81ba-7c7206623831 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:45:37.785713 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790940a0-437e-4d68-81ba-7c7206623831 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:37.787142 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790940a0-437e-4d68-81ba-7c7206623831 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:37.800881 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 602/1218] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Sep 26 17:45:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:45:37.807694 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711bfc55-19cd-4a72-8119-b8de53e821ce None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:37.916208 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711bfc55-19cd-4a72-8119-b8de53e821ce None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:37.946462 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:37.954483 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3de5a8-836f-475a-a710-7d3c8619c73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:37.955344 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3de5a8-836f-475a-a710-7d3c8619c73f None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:37.955691 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3de5a8-836f-475a-a710-7d3c8619c73f None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:37.956098 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3de5a8-836f-475a-a710-7d3c8619c73f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:37.956993 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3de5a8-836f-475a-a710-7d3c8619c73f None admin] RBAC: Adding query filter params (role.id=4685fd1f2f284d4498281231160a5f27, scope.project.id=125361b23eb14b53aca5e0139919881e, user.id=f5043d835c08458c9f3911a4741bdaa8) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:45:37.957343 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3de5a8-836f-475a-a710-7d3c8619c73f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:37.959138 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3de5a8-836f-475a-a710-7d3c8619c73f None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:37.966449 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 617/1219] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:45:37 2022] GET /identity/v3/role_assignments?user.id=f5043d835c08458c9f3911a4741bdaa8&scope.project.id=125361b23eb14b53aca5e0139919881e&role.id=4685fd1f2f284d4498281231160a5f27 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:45:40.527094 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee6e1b-90f5-413a-9fd0-8f2c32dab72c None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:40.527667 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee6e1b-90f5-413a-9fd0-8f2c32dab72c None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:40.527667 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee6e1b-90f5-413a-9fd0-8f2c32dab72c None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:40.529146 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 603/1220] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:45:40.534312 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef91635-dcae-4b5a-9852-8ab9030f1dee None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:40.534761 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef91635-dcae-4b5a-9852-8ab9030f1dee None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:40.534935 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef91635-dcae-4b5a-9852-8ab9030f1dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:40.554102 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-fef91635-dcae-4b5a-9852-8ab9030f1dee None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:45:40.555349 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-fef91635-dcae-4b5a-9852-8ab9030f1dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:45:40.631005 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 618/1221] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:45:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:45:40.923908 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee6e1b-90f5-413a-9fd0-8f2c32dab72c None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:41.033182 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee6e1b-90f5-413a-9fd0-8f2c32dab72c None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:41.067809 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da55df-e051-434f-8040-509f9348b091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:41.068703 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da55df-e051-434f-8040-509f9348b091 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:41.069169 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da55df-e051-434f-8040-509f9348b091 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:41.069319 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da55df-e051-434f-8040-509f9348b091 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:41.082072 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da55df-e051-434f-8040-509f9348b091 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:45:41.087825 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-d0da55df-e051-434f-8040-509f9348b091 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:45:41.087825 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:45:41.087825 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:45:41.087825 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:45:41.087825 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:45:41.087825 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:45:41.087825 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:45:41.087825 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:45:41.087825 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:45:41.087825 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:45:41.087825 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:45:41.087825 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:45:41.087825 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:45:41.087825 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:45:41.087825 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:45:41.087825 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:45:41.089169 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:45:41.089169 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:45:41.089169 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:45:41.089169 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:45:41.089169 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:45:41.089169 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:45:41.089169 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:45:41.089169 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:45:41.089169 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:45:41.089169 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:45:41.089169 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:45:41.089169 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:45:41.089169 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:45:41.089169 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:45:41.089169 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:45:41.089169 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:45:41.090427 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:45:41.090427 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:45:41.090427 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:45:41.090427 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:45:41.090427 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:45:41.090427 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:45:41.090427 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:45:41.090427 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:45:41.090427 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:45:41.090427 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:45:41.090427 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:45:41.090427 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:45:41.090427 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 604/1222] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Sep 26 17:45:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:45:41.095737 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef91635-dcae-4b5a-9852-8ab9030f1dee None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:41.205850 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef91635-dcae-4b5a-9852-8ab9030f1dee None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:41.230645 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:41.242199 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bba86-eeed-4f78-875d-fc327d5b2b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:41.242808 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bba86-eeed-4f78-875d-fc327d5b2b1f None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:41.243107 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bba86-eeed-4f78-875d-fc327d5b2b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:41.243362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bba86-eeed-4f78-875d-fc327d5b2b1f None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:41.244048 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95bba86-eeed-4f78-875d-fc327d5b2b1f None admin] RBAC: Adding query filter params (name=service) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:45:41.244352 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95bba86-eeed-4f78-875d-fc327d5b2b1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:41.245758 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95bba86-eeed-4f78-875d-fc327d5b2b1f None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:41.254039 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 619/1223] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Sep 26 17:45:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:45:41.261443 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da55df-e051-434f-8040-509f9348b091 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:41.314795 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:41.387669 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da55df-e051-434f-8040-509f9348b091 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:41.426018 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469bdf0-46b3-4e65-8e84-87bd9e184ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:41.426645 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469bdf0-46b3-4e65-8e84-87bd9e184ea8 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:41.426925 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469bdf0-46b3-4e65-8e84-87bd9e184ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:41.427200 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469bdf0-46b3-4e65-8e84-87bd9e184ea8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:41.440193 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d469bdf0-46b3-4e65-8e84-87bd9e184ea8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:41.441780 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d469bdf0-46b3-4e65-8e84-87bd9e184ea8 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:41.457238 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-d469bdf0-46b3-4e65-8e84-87bd9e184ea8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:45:41.457238 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:45:41.457238 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:45:41.457238 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:45:41.457238 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:45:41.457238 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:45:41.457238 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:45:41.457238 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:45:41.457238 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:45:41.457238 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:45:41.457238 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:45:41.457238 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:45:41.457238 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:45:41.457238 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:45:41.457238 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:45:41.457238 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:45:41.458784 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:45:41.458784 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:45:41.458784 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:45:41.458784 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:45:41.458784 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:45:41.458784 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:45:41.458784 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:45:41.458784 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:45:41.458784 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:45:41.458784 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:45:41.458784 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:45:41.458784 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:45:41.458784 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:45:41.458784 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:45:41.458784 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:45:41.458784 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:45:41.458784 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:45:41.459881 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:45:41.459881 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:45:41.459881 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:45:41.459881 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 605/1224] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:45:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:45:41.464791 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bba86-eeed-4f78-875d-fc327d5b2b1f None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:41.576304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bba86-eeed-4f78-875d-fc327d5b2b1f None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:41.616694 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a3458-b7b6-44fc-9cca-13175b19ed76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:41.617743 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a3458-b7b6-44fc-9cca-13175b19ed76 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:41.618030 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a3458-b7b6-44fc-9cca-13175b19ed76 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:41.618306 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a3458-b7b6-44fc-9cca-13175b19ed76 None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:41.619674 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a3458-b7b6-44fc-9cca-13175b19ed76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:45:41.620037 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a3458-b7b6-44fc-9cca-13175b19ed76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:41.621813 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a3458-b7b6-44fc-9cca-13175b19ed76 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:41.636079 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 620/1225] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:45:41.642757 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469bdf0-46b3-4e65-8e84-87bd9e184ea8 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:41.755977 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:41.764226 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469bdf0-46b3-4e65-8e84-87bd9e184ea8 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:41.798546 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd899bc8-c3a9-4fca-ac7a-3c0dac644c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:41.799173 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd899bc8-c3a9-4fca-ac7a-3c0dac644c4b None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:41.799451 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd899bc8-c3a9-4fca-ac7a-3c0dac644c4b None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:41.799721 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd899bc8-c3a9-4fca-ac7a-3c0dac644c4b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:41.809878 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd899bc8-c3a9-4fca-ac7a-3c0dac644c4b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:41.811674 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd899bc8-c3a9-4fca-ac7a-3c0dac644c4b None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:41.827045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-fd899bc8-c3a9-4fca-ac7a-3c0dac644c4b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 26 17:45:41.827045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:45:41.827045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:45:41.827045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:45:41.827045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:45:41.827045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:45:41.827045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:45:41.827045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:45:41.827045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:45:41.827045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:45:41.827045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:45:41.827045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:45:41.827045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 17:45:41.827045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 17:45:41.827045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 17:45:41.827045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 17:45:41.828397 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:45:41.828397 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:45:41.828397 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 17:45:41.828397 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:45:41.828397 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 17:45:41.828397 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:45:41.828397 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:45:41.828397 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:45:41.828397 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:45:41.828397 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:45:41.828397 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:45:41.828397 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:45:41.828397 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:45:41.828397 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:45:41.828397 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:45:41.828397 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:45:41.828397 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:45:41.828397 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:45:41.829771 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:45:41.829771 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:45:41.829771 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 17:45:41.829771 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 17:45:41.829771 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 17:45:41.829771 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 17:45:41.829771 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 17:45:41.829771 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 17:45:41.829771 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 26 17:45:41.829771 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:45:41.834407 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 606/1226] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:45:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:45:41.836050 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a3458-b7b6-44fc-9cca-13175b19ed76 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:41.887290 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:41.944501 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a3458-b7b6-44fc-9cca-13175b19ed76 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:41.982871 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfefd13-d49c-4a00-b5c6-0720233e0218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:41.983688 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfefd13-d49c-4a00-b5c6-0720233e0218 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:41.984043 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfefd13-d49c-4a00-b5c6-0720233e0218 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:41.984386 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfefd13-d49c-4a00-b5c6-0720233e0218 None admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:41.985232 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfefd13-d49c-4a00-b5c6-0720233e0218 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:45:41.985737 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfefd13-d49c-4a00-b5c6-0720233e0218 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:41.987521 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfefd13-d49c-4a00-b5c6-0720233e0218 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:42.011359 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 621/1227] 10.222.0.62 () {56 vars in 1143 bytes} [Mon Sep 26 17:45:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:45:42.017832 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd899bc8-c3a9-4fca-ac7a-3c0dac644c4b None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:42.143770 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd899bc8-c3a9-4fca-ac7a-3c0dac644c4b None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:42.180435 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72a7a0-7b32-455c-9e9e-2d9e48c9a9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:42.181242 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72a7a0-7b32-455c-9e9e-2d9e48c9a9a8 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:42.181550 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72a7a0-7b32-455c-9e9e-2d9e48c9a9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:42.181821 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72a7a0-7b32-455c-9e9e-2d9e48c9a9a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:42.193766 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72a7a0-7b32-455c-9e9e-2d9e48c9a9a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:42.195208 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72a7a0-7b32-455c-9e9e-2d9e48c9a9a8 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:42.209655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-4f72a7a0-7b32-455c-9e9e-2d9e48c9a9a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:45:42.209655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:45:42.209655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:45:42.209655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:45:42.209655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:45:42.209655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:45:42.209655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:45:42.209655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:45:42.209655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:45:42.209655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:45:42.209655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:45:42.209655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:45:42.209655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:45:42.209655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:45:42.209655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:45:42.209655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:45:42.216128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:45:42.216128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:45:42.216128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:45:42.216128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:45:42.216128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:45:42.216128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:45:42.216128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:45:42.216128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:45:42.216128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:45:42.216128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:45:42.216128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:45:42.216128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:45:42.216128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:45:42.216128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:45:42.216128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:45:42.216128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:45:42.216128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:45:42.217308 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:45:42.217308 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:45:42.217308 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:45:42.217308 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 607/1228] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:45:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:45:42.218199 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfefd13-d49c-4a00-b5c6-0720233e0218 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:42.319864 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfefd13-d49c-4a00-b5c6-0720233e0218 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:42.322788 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:42.355356 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b10a87-03ad-4d32-9140-367f5d3a22f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:42.355976 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b10a87-03ad-4d32-9140-367f5d3a22f2 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:42.356242 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b10a87-03ad-4d32-9140-367f5d3a22f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:42.356506 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b10a87-03ad-4d32-9140-367f5d3a22f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:42.357194 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b10a87-03ad-4d32-9140-367f5d3a22f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:45:42.357494 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b10a87-03ad-4d32-9140-367f5d3a22f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:42.358850 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b10a87-03ad-4d32-9140-367f5d3a22f2 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:42.371416 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 622/1229] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:45:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:45:42.377147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72a7a0-7b32-455c-9e9e-2d9e48c9a9a8 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:42.388281 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:42.486498 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72a7a0-7b32-455c-9e9e-2d9e48c9a9a8 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:42.524169 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f752a-bcec-4e13-8ec4-31abea6d635a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:42.525631 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f752a-bcec-4e13-8ec4-31abea6d635a None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:42.525999 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f752a-bcec-4e13-8ec4-31abea6d635a None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:42.526359 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f752a-bcec-4e13-8ec4-31abea6d635a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:42.534731 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f752a-bcec-4e13-8ec4-31abea6d635a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:42.537613 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f752a-bcec-4e13-8ec4-31abea6d635a None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:42.550185 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-373f752a-bcec-4e13-8ec4-31abea6d635a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:45:42.550185 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:45:42.550185 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:45:42.550185 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:45:42.550185 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:45:42.550185 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:45:42.550185 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:45:42.550185 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:45:42.550185 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:45:42.550185 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:45:42.550185 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:45:42.550185 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:45:42.550185 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 17:45:42.550185 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 17:45:42.550185 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 17:45:42.551459 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 17:45:42.551459 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:45:42.551459 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:45:42.551459 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:45:42.551459 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:45:42.551459 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:45:42.551459 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:45:42.551459 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:45:42.551459 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:45:42.551459 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:45:42.551459 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:45:42.551459 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:45:42.551459 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:45:42.551459 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:45:42.551459 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:45:42.551459 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:45:42.551459 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:45:42.552364 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 17:45:42.552364 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 17:45:42.552364 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 17:45:42.552364 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 17:45:42.552364 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 17:45:42.552364 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 17:45:42.552364 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:45:42.552364 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:45:42.552364 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 608/1230] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:45:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:45:42.557989 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b10a87-03ad-4d32-9140-367f5d3a22f2 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:42.674788 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b10a87-03ad-4d32-9140-367f5d3a22f2 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:42.709857 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d9cb1-097b-4d14-95ec-43f20cef6e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:42.710569 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d9cb1-097b-4d14-95ec-43f20cef6e51 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:42.710921 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d9cb1-097b-4d14-95ec-43f20cef6e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:42.711379 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d9cb1-097b-4d14-95ec-43f20cef6e51 None admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:42.712754 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d9cb1-097b-4d14-95ec-43f20cef6e51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:45:42.713227 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d9cb1-097b-4d14-95ec-43f20cef6e51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:42.715311 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d9cb1-097b-4d14-95ec-43f20cef6e51 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:42.727472 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 623/1231] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Sep 26 17:45:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:45:42.733657 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f752a-bcec-4e13-8ec4-31abea6d635a None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:42.806380 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:42.845526 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f752a-bcec-4e13-8ec4-31abea6d635a None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:42.880786 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4e78e-10de-47bb-a23c-1a8169c341d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:42.881479 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4e78e-10de-47bb-a23c-1a8169c341d1 None admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:42.881759 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4e78e-10de-47bb-a23c-1a8169c341d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:42.882033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4e78e-10de-47bb-a23c-1a8169c341d1 None admin] PATH_INFO: `/v3/projects/125361b23eb14b53aca5e0139919881e/users/f5043d835c08458c9f3911a4741bdaa8/roles/4685fd1f2f284d4498281231160a5f27` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:42.898109 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4e78e-10de-47bb-a23c-1a8169c341d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=125361b23eb14b53aca5e0139919881e, user_id=f5043d835c08458c9f3911a4741bdaa8, role_id=4685fd1f2f284d4498281231160a5f27)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:42.900139 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4e78e-10de-47bb-a23c-1a8169c341d1 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:42.914338 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 609/1232] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Sep 26 17:45:42 2022] PUT /identity/v3/projects/125361b23eb14b53aca5e0139919881e/users/f5043d835c08458c9f3911a4741bdaa8/roles/4685fd1f2f284d4498281231160a5f27 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:45:45.213664 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e95ab-e81f-434b-8e1c-e3fd58d76087 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:45.214545 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e95ab-e81f-434b-8e1c-e3fd58d76087 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:45.214545 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e95ab-e81f-434b-8e1c-e3fd58d76087 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:45.216049 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 624/1233] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:45:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:45:45.221621 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e206d69-179a-406c-ba0a-82afde3dd80e None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:45.222060 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e206d69-179a-406c-ba0a-82afde3dd80e None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:45.222159 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e206d69-179a-406c-ba0a-82afde3dd80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:45.241261 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-3e206d69-179a-406c-ba0a-82afde3dd80e None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:45:45.242474 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-3e206d69-179a-406c-ba0a-82afde3dd80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:45:45.317234 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 610/1234] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:45:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 17:45:45.595251 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e95ab-e81f-434b-8e1c-e3fd58d76087 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:45.625152 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:45.733392 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e95ab-e81f-434b-8e1c-e3fd58d76087 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:45.770716 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d51f9-c8df-4cb1-9089-082bd94113b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:45.771349 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d51f9-c8df-4cb1-9089-082bd94113b5 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:45.771628 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d51f9-c8df-4cb1-9089-082bd94113b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:45.771905 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d51f9-c8df-4cb1-9089-082bd94113b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:45.783568 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d51f9-c8df-4cb1-9089-082bd94113b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:45:45.788438 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-d87d51f9-c8df-4cb1-9089-082bd94113b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:45:45.788438 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:45:45.788438 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:45:45.788438 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:45:45.788438 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:45:45.788438 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:45:45.788438 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:45:45.788438 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:45:45.788438 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:45:45.788438 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:45:45.788438 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:45:45.788438 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:45:45.788438 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:45:45.788438 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:45:45.788438 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:45:45.788438 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:45:45.790536 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:45:45.790536 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:45:45.790536 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:45:45.790536 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:45:45.790536 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:45:45.790536 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:45:45.790536 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:45:45.790536 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:45:45.790536 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:45:45.790536 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:45:45.790536 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:45:45.790536 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:45:45.790536 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:45:45.790536 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:45:45.790536 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:45:45.790536 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:45:45.791402 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:45:45.791402 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:45:45.791402 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:45:45.791402 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:45:45.791402 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:45:45.791402 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:45:45.791402 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:45:45.791402 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:45:45.791402 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:45:45.791402 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:45:45.791402 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 17:45:45.791402 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:45:45.791402 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 625/1235] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Sep 26 17:45:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:45:45.796196 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e206d69-179a-406c-ba0a-82afde3dd80e None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:45.847231 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:45.904681 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e206d69-179a-406c-ba0a-82afde3dd80e None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:45.938954 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ce6c4-812f-4d4a-9f4b-c84107b70dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:45.939552 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ce6c4-812f-4d4a-9f4b-c84107b70dad None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:45.939829 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ce6c4-812f-4d4a-9f4b-c84107b70dad None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:45.940101 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ce6c4-812f-4d4a-9f4b-c84107b70dad None admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:45.940754 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ce6c4-812f-4d4a-9f4b-c84107b70dad None admin] RBAC: Adding query filter params (name=service) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:45:45.941078 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ce6c4-812f-4d4a-9f4b-c84107b70dad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:45.942451 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ce6c4-812f-4d4a-9f4b-c84107b70dad None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:45.950425 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 611/1236] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Sep 26 17:45:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:45:45.956592 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d51f9-c8df-4cb1-9089-082bd94113b5 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:46.051307 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:46.071123 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d51f9-c8df-4cb1-9089-082bd94113b5 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:46.111449 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9df1a3-1554-4978-83d0-b02ce5ff2fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:46.112005 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9df1a3-1554-4978-83d0-b02ce5ff2fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:46.112288 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9df1a3-1554-4978-83d0-b02ce5ff2fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:46.112611 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9df1a3-1554-4978-83d0-b02ce5ff2fc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:46.125164 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9df1a3-1554-4978-83d0-b02ce5ff2fc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:46.126972 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9df1a3-1554-4978-83d0-b02ce5ff2fc1 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:46.142424 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-ab9df1a3-1554-4978-83d0-b02ce5ff2fc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:45:46.142424 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:45:46.142424 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:45:46.142424 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:45:46.142424 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:45:46.142424 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:45:46.142424 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:45:46.142424 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:45:46.142424 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:45:46.142424 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:45:46.142424 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:45:46.142424 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:45:46.142424 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:45:46.142424 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:45:46.142424 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:45:46.142424 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:45:46.143979 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:45:46.143979 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:45:46.143979 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:45:46.143979 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:45:46.143979 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:45:46.143979 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:45:46.143979 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:45:46.143979 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:45:46.143979 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:45:46.143979 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:45:46.143979 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:45:46.143979 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:45:46.143979 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:45:46.143979 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:45:46.143979 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:45:46.143979 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:45:46.143979 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:45:46.144914 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:45:46.144914 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:45:46.144914 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:45:46.144914 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 626/1237] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:45:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:45:46.150579 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ce6c4-812f-4d4a-9f4b-c84107b70dad None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:46.264708 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ce6c4-812f-4d4a-9f4b-c84107b70dad None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:46.275482 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:46.303375 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b45a69-339e-45db-8289-46d7e7461569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:46.304156 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b45a69-339e-45db-8289-46d7e7461569 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:46.304427 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b45a69-339e-45db-8289-46d7e7461569 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:46.304694 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b45a69-339e-45db-8289-46d7e7461569 None admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:46.305560 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b45a69-339e-45db-8289-46d7e7461569 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:45:46.305991 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b45a69-339e-45db-8289-46d7e7461569 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:46.307716 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b45a69-339e-45db-8289-46d7e7461569 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:46.327152 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 612/1238] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:45:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:45:46.328538 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9df1a3-1554-4978-83d0-b02ce5ff2fc1 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:46.441120 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9df1a3-1554-4978-83d0-b02ce5ff2fc1 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:46.482146 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049f67e-4948-4d24-9956-e6281274f49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:46.482996 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049f67e-4948-4d24-9956-e6281274f49e None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:46.483274 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049f67e-4948-4d24-9956-e6281274f49e None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:46.483544 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049f67e-4948-4d24-9956-e6281274f49e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:46.486856 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:46.492779 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c049f67e-4948-4d24-9956-e6281274f49e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:46.495188 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c049f67e-4948-4d24-9956-e6281274f49e None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:46.506920 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-c049f67e-4948-4d24-9956-e6281274f49e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 26 17:45:46.506920 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:45:46.506920 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:45:46.506920 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:45:46.506920 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:45:46.506920 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:45:46.506920 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:45:46.506920 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:45:46.506920 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:45:46.506920 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:45:46.506920 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:45:46.506920 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:45:46.506920 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 17:45:46.506920 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 17:45:46.506920 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 17:45:46.506920 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 17:45:46.508078 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:45:46.508078 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:45:46.508078 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 17:45:46.508078 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:45:46.508078 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 17:45:46.508078 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:45:46.508078 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:45:46.508078 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:45:46.508078 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:45:46.508078 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:45:46.508078 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:45:46.508078 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:45:46.508078 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:45:46.508078 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:45:46.508078 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:45:46.508078 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:45:46.508078 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:45:46.508078 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:45:46.509361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:45:46.509361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:45:46.509361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 17:45:46.509361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 17:45:46.509361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 17:45:46.509361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 17:45:46.509361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 17:45:46.509361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 17:45:46.509361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 26 17:45:46.509361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:45:46.513211 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 627/1239] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:45:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:45:46.514335 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b45a69-339e-45db-8289-46d7e7461569 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:46.627566 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b45a69-339e-45db-8289-46d7e7461569 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:46.666984 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b1b46-3fa0-4f44-b4a6-70edf0a02275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:46.667510 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b1b46-3fa0-4f44-b4a6-70edf0a02275 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:46.667785 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b1b46-3fa0-4f44-b4a6-70edf0a02275 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:46.668052 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b1b46-3fa0-4f44-b4a6-70edf0a02275 None admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:46.668778 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b1b46-3fa0-4f44-b4a6-70edf0a02275 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:45:46.669112 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b1b46-3fa0-4f44-b4a6-70edf0a02275 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:46.670537 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b1b46-3fa0-4f44-b4a6-70edf0a02275 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:46.690494 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 613/1240] 10.222.0.62 () {56 vars in 1143 bytes} [Mon Sep 26 17:45:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:45:46.697063 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049f67e-4948-4d24-9956-e6281274f49e None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:46.801075 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049f67e-4948-4d24-9956-e6281274f49e None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:46.838860 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061cb6c-28fb-478e-9ff2-453f32b90ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:46.839463 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061cb6c-28fb-478e-9ff2-453f32b90ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:46.839738 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061cb6c-28fb-478e-9ff2-453f32b90ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:46.840005 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061cb6c-28fb-478e-9ff2-453f32b90ce9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:46.910453 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:46.919328 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061cb6c-28fb-478e-9ff2-453f32b90ce9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:46.920827 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061cb6c-28fb-478e-9ff2-453f32b90ce9 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:47.034206 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 628/1241] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:45:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 17:45:47.041397 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b1b46-3fa0-4f44-b4a6-70edf0a02275 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:47.079253 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:47.175853 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b1b46-3fa0-4f44-b4a6-70edf0a02275 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:47.216391 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0f8bb-c78d-4b37-beca-20c67039529a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:47.217278 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0f8bb-c78d-4b37-beca-20c67039529a None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:47.217688 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0f8bb-c78d-4b37-beca-20c67039529a None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:47.217958 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0f8bb-c78d-4b37-beca-20c67039529a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:47.230042 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0f8bb-c78d-4b37-beca-20c67039529a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:47.231662 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0f8bb-c78d-4b37-beca-20c67039529a None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:47.249951 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-61f0f8bb-c78d-4b37-beca-20c67039529a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:45:47.249951 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:45:47.249951 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:45:47.249951 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:45:47.249951 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:45:47.249951 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:45:47.249951 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:45:47.249951 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:45:47.249951 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:45:47.249951 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:45:47.249951 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:45:47.249951 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:45:47.249951 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:45:47.249951 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:45:47.249951 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:45:47.249951 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:45:47.251045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:45:47.251045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:45:47.251045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:45:47.251045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:45:47.251045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:45:47.251045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:45:47.251045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:45:47.251045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:45:47.251045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:45:47.251045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:45:47.251045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:45:47.251045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:45:47.251045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:45:47.251045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:45:47.251045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:45:47.251045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:45:47.251045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:45:47.251939 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:45:47.251939 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:45:47.251939 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:45:47.256301 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 614/1242] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:45:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:45:47.257255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061cb6c-28fb-478e-9ff2-453f32b90ce9 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:47.376358 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:47.383082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061cb6c-28fb-478e-9ff2-453f32b90ce9 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:47.425638 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5cb3b-72f9-4d0f-bf8b-b2e4d86873d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:47.426320 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5cb3b-72f9-4d0f-bf8b-b2e4d86873d6 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:47.426543 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5cb3b-72f9-4d0f-bf8b-b2e4d86873d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:47.426823 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5cb3b-72f9-4d0f-bf8b-b2e4d86873d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:47.427452 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5cb3b-72f9-4d0f-bf8b-b2e4d86873d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:45:47.427752 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5cb3b-72f9-4d0f-bf8b-b2e4d86873d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:47.429336 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5cb3b-72f9-4d0f-bf8b-b2e4d86873d6 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:47.443256 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 629/1243] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:45:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:45:47.450264 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0f8bb-c78d-4b37-beca-20c67039529a None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:47.537598 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:47.561465 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0f8bb-c78d-4b37-beca-20c67039529a None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:47.601359 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89cdcf-9e8e-4c26-b5b3-4e52afac7388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:47.603734 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89cdcf-9e8e-4c26-b5b3-4e52afac7388 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:47.603734 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89cdcf-9e8e-4c26-b5b3-4e52afac7388 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:47.603734 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89cdcf-9e8e-4c26-b5b3-4e52afac7388 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:47.613683 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89cdcf-9e8e-4c26-b5b3-4e52afac7388 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:47.615667 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89cdcf-9e8e-4c26-b5b3-4e52afac7388 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:47.631163 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-4f89cdcf-9e8e-4c26-b5b3-4e52afac7388 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:45:47.631163 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:45:47.631163 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:45:47.631163 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:45:47.631163 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:45:47.631163 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:45:47.631163 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:45:47.631163 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:45:47.631163 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:45:47.631163 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:45:47.631163 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:45:47.631163 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:45:47.631163 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 17:45:47.631163 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 17:45:47.631163 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 17:45:47.638523 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 17:45:47.638523 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:45:47.638523 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:45:47.638523 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:45:47.638523 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:45:47.638523 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:45:47.638523 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:45:47.638523 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:45:47.638523 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:45:47.638523 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:45:47.638523 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:45:47.638523 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:45:47.638523 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:45:47.638523 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:45:47.638523 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:45:47.638523 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:45:47.638523 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:45:47.639636 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 17:45:47.639636 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 17:45:47.639636 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 17:45:47.639636 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 17:45:47.639636 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 17:45:47.639636 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 17:45:47.639636 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:45:47.639636 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:45:47.639636 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 615/1244] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:45:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:45:47.640235 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5cb3b-72f9-4d0f-bf8b-b2e4d86873d6 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:47.751623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5cb3b-72f9-4d0f-bf8b-b2e4d86873d6 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:47.788900 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98574f4e-73fc-4e79-afc7-b4caa809940c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:47.789730 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98574f4e-73fc-4e79-afc7-b4caa809940c None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:47.789846 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98574f4e-73fc-4e79-afc7-b4caa809940c None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:47.790073 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98574f4e-73fc-4e79-afc7-b4caa809940c None admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:47.790767 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98574f4e-73fc-4e79-afc7-b4caa809940c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:45:47.791067 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98574f4e-73fc-4e79-afc7-b4caa809940c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:47.792491 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98574f4e-73fc-4e79-afc7-b4caa809940c None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:47.805960 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 630/1245] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Sep 26 17:45:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:45:47.812176 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89cdcf-9e8e-4c26-b5b3-4e52afac7388 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:47.921554 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89cdcf-9e8e-4c26-b5b3-4e52afac7388 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:47.957619 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715cfbc6-5695-4de0-afee-e58bcefda396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:47.958646 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715cfbc6-5695-4de0-afee-e58bcefda396 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:47.958646 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715cfbc6-5695-4de0-afee-e58bcefda396 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:47.958912 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715cfbc6-5695-4de0-afee-e58bcefda396 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:47.959664 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715cfbc6-5695-4de0-afee-e58bcefda396 None admin] RBAC: Adding query filter params (role.id=4685fd1f2f284d4498281231160a5f27, scope.project.id=125361b23eb14b53aca5e0139919881e, user.id=f5043d835c08458c9f3911a4741bdaa8) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:45:47.959991 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715cfbc6-5695-4de0-afee-e58bcefda396 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:47.961695 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715cfbc6-5695-4de0-afee-e58bcefda396 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:47.967555 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 616/1246] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:45:47 2022] GET /identity/v3/role_assignments?user.id=f5043d835c08458c9f3911a4741bdaa8&scope.project.id=125361b23eb14b53aca5e0139919881e&role.id=4685fd1f2f284d4498281231160a5f27 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:45:50.322181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d662eb-714a-4535-97e1-ac4f3c568ce8 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:50.323076 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d662eb-714a-4535-97e1-ac4f3c568ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:50.323076 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d662eb-714a-4535-97e1-ac4f3c568ce8 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:50.324065 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 631/1247] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:45:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:45:50.329558 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac3b40-3ea0-452a-8f1f-d90d1306d8eb None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:50.330010 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac3b40-3ea0-452a-8f1f-d90d1306d8eb None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:50.330155 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac3b40-3ea0-452a-8f1f-d90d1306d8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:50.337458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:50.353748 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-93ac3b40-3ea0-452a-8f1f-d90d1306d8eb None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:45:50.355683 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-93ac3b40-3ea0-452a-8f1f-d90d1306d8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:45:50.436534 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 617/1248] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:45:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 17:45:50.718300 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d662eb-714a-4535-97e1-ac4f3c568ce8 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:50.736931 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:50.828616 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d662eb-714a-4535-97e1-ac4f3c568ce8 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:50.864808 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f3782-8f5d-452d-bdf0-e07e3c753cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:50.865472 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f3782-8f5d-452d-bdf0-e07e3c753cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:50.865753 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f3782-8f5d-452d-bdf0-e07e3c753cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:50.866020 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f3782-8f5d-452d-bdf0-e07e3c753cf5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:50.877143 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f3782-8f5d-452d-bdf0-e07e3c753cf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:45:50.882747 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-836f3782-8f5d-452d-bdf0-e07e3c753cf5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:45:50.882747 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:45:50.882747 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:45:50.882747 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:45:50.882747 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:45:50.882747 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:45:50.882747 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:45:50.882747 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:45:50.882747 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:45:50.882747 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:45:50.882747 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:45:50.882747 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:45:50.882747 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:45:50.882747 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:45:50.882747 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:45:50.882747 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:45:50.884335 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:45:50.884335 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:45:50.884335 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:45:50.884335 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:45:50.884335 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:45:50.884335 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:45:50.884335 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:45:50.884335 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:45:50.884335 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:45:50.884335 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:45:50.884335 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:45:50.884335 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:45:50.884335 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:45:50.884335 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:45:50.884335 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:45:50.884335 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:45:50.885223 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:45:50.885223 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:45:50.885223 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:45:50.885223 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:45:50.885223 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:45:50.885223 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:45:50.885223 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:45:50.885223 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:45:50.885223 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:45:50.885223 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:45:50.885223 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:45:50.885223 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:45:50.885223 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 632/1249] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Sep 26 17:45:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:45:50.893194 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac3b40-3ea0-452a-8f1f-d90d1306d8eb None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:51.007262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac3b40-3ea0-452a-8f1f-d90d1306d8eb None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:51.040134 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:51.045793 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1734e-9aa8-46ec-bdb3-d46c2bc57fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:51.046434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1734e-9aa8-46ec-bdb3-d46c2bc57fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:51.046720 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1734e-9aa8-46ec-bdb3-d46c2bc57fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:51.046983 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1734e-9aa8-46ec-bdb3-d46c2bc57fb8 None admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:51.047642 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1734e-9aa8-46ec-bdb3-d46c2bc57fb8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:45:51.047944 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1734e-9aa8-46ec-bdb3-d46c2bc57fb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:51.049455 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1734e-9aa8-46ec-bdb3-d46c2bc57fb8 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:51.058136 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 618/1250] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:45:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:45:51.064138 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f3782-8f5d-452d-bdf0-e07e3c753cf5 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:51.154984 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:51.180064 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f3782-8f5d-452d-bdf0-e07e3c753cf5 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:51.215979 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ede072-288a-4358-9d72-eb1dcace76b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:51.216605 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ede072-288a-4358-9d72-eb1dcace76b3 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:51.216880 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ede072-288a-4358-9d72-eb1dcace76b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:51.217186 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ede072-288a-4358-9d72-eb1dcace76b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:51.228740 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ede072-288a-4358-9d72-eb1dcace76b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:51.230232 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ede072-288a-4358-9d72-eb1dcace76b3 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:51.248062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-34ede072-288a-4358-9d72-eb1dcace76b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:45:51.248062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:45:51.248062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:45:51.248062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:45:51.248062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:45:51.248062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:45:51.248062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:45:51.248062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:45:51.248062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:45:51.248062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:45:51.248062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:45:51.248062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:45:51.248062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:45:51.248062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:45:51.248062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:45:51.248062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:45:51.249181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:45:51.249181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:45:51.249181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:45:51.249181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:45:51.249181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:45:51.249181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:45:51.249181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:45:51.249181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:45:51.249181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:45:51.249181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:45:51.249181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:45:51.249181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:45:51.249181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:45:51.249181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:45:51.249181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:45:51.249181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:45:51.249181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:45:51.250108 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:45:51.250108 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:45:51.250108 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:45:51.250108 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 633/1251] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:45:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:45:51.256357 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1734e-9aa8-46ec-bdb3-d46c2bc57fb8 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:51.366648 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1734e-9aa8-46ec-bdb3-d46c2bc57fb8 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:51.415902 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cafba-39b2-45ed-a3a6-bd6b9f946e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:51.416512 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cafba-39b2-45ed-a3a6-bd6b9f946e15 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:51.416790 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cafba-39b2-45ed-a3a6-bd6b9f946e15 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:51.417097 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cafba-39b2-45ed-a3a6-bd6b9f946e15 None admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:51.417746 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93cafba-39b2-45ed-a3a6-bd6b9f946e15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:45:51.418076 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93cafba-39b2-45ed-a3a6-bd6b9f946e15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:51.419431 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93cafba-39b2-45ed-a3a6-bd6b9f946e15 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:51.432432 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 619/1252] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:45:51.439310 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ede072-288a-4358-9d72-eb1dcace76b3 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:51.547288 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ede072-288a-4358-9d72-eb1dcace76b3 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:51.575428 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:51.584369 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b7e2e-398b-4c97-a0ec-d7c49df5b1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:51.585097 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b7e2e-398b-4c97-a0ec-d7c49df5b1c3 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:51.585377 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b7e2e-398b-4c97-a0ec-d7c49df5b1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:51.585646 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b7e2e-398b-4c97-a0ec-d7c49df5b1c3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:51.595490 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b7e2e-398b-4c97-a0ec-d7c49df5b1c3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:51.596941 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b7e2e-398b-4c97-a0ec-d7c49df5b1c3 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:51.609116 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-456b7e2e-398b-4c97-a0ec-d7c49df5b1c3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 26 17:45:51.609116 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:45:51.609116 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:45:51.609116 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:45:51.609116 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:45:51.609116 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:45:51.609116 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:45:51.609116 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:45:51.609116 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:45:51.609116 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:45:51.609116 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:45:51.609116 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:45:51.609116 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 17:45:51.609116 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 17:45:51.609116 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 17:45:51.609116 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 17:45:51.610240 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:45:51.610240 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:45:51.610240 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 17:45:51.610240 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:45:51.610240 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 17:45:51.610240 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:45:51.610240 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:45:51.610240 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:45:51.610240 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:45:51.610240 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:45:51.610240 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:45:51.610240 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:45:51.610240 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:45:51.610240 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:45:51.610240 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:45:51.610240 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:45:51.610240 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:45:51.610240 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:45:51.611184 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:45:51.611184 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:45:51.611184 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 17:45:51.611184 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 17:45:51.611184 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 17:45:51.611184 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 17:45:51.611184 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 17:45:51.611184 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 17:45:51.611184 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 26 17:45:51.611184 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:45:51.611184 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 634/1253] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:45:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:45:51.616388 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cafba-39b2-45ed-a3a6-bd6b9f946e15 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:51.675902 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:51.722589 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cafba-39b2-45ed-a3a6-bd6b9f946e15 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:51.759138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc506ae-c5f5-496f-b0dd-8e41115e8d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:51.759754 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc506ae-c5f5-496f-b0dd-8e41115e8d48 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:51.760028 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc506ae-c5f5-496f-b0dd-8e41115e8d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:51.760297 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc506ae-c5f5-496f-b0dd-8e41115e8d48 None admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:51.761064 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc506ae-c5f5-496f-b0dd-8e41115e8d48 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:45:51.761370 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc506ae-c5f5-496f-b0dd-8e41115e8d48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:51.762836 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc506ae-c5f5-496f-b0dd-8e41115e8d48 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:51.787383 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 620/1254] 10.222.0.62 () {56 vars in 1143 bytes} [Mon Sep 26 17:45:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:45:51.788669 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b7e2e-398b-4c97-a0ec-d7c49df5b1c3 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:51.890722 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b7e2e-398b-4c97-a0ec-d7c49df5b1c3 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:51.924907 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5340d-ddd1-4118-aed0-c0171e392ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:51.925555 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5340d-ddd1-4118-aed0-c0171e392ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:51.925832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5340d-ddd1-4118-aed0-c0171e392ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:51.926152 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5340d-ddd1-4118-aed0-c0171e392ba4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:51.983384 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:51.999870 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d5340d-ddd1-4118-aed0-c0171e392ba4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:52.001358 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d5340d-ddd1-4118-aed0-c0171e392ba4 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:52.111415 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 635/1255] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:45:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 17:45:52.118119 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc506ae-c5f5-496f-b0dd-8e41115e8d48 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:52.221826 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc506ae-c5f5-496f-b0dd-8e41115e8d48 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:52.235221 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:52.256306 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4ed34-7ba2-4f47-b119-9f11e4476da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:52.256926 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4ed34-7ba2-4f47-b119-9f11e4476da7 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:52.257233 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4ed34-7ba2-4f47-b119-9f11e4476da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:52.257505 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4ed34-7ba2-4f47-b119-9f11e4476da7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:52.271933 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e4ed34-7ba2-4f47-b119-9f11e4476da7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:52.274759 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e4ed34-7ba2-4f47-b119-9f11e4476da7 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:52.296116 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-b3e4ed34-7ba2-4f47-b119-9f11e4476da7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:45:52.296116 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:45:52.296116 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:45:52.296116 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:45:52.296116 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:45:52.296116 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:45:52.296116 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:45:52.296116 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:45:52.296116 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:45:52.296116 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:45:52.296116 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:45:52.296116 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:45:52.296116 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:45:52.296116 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:45:52.296116 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:45:52.296116 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:45:52.297162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:45:52.297162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:45:52.297162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:45:52.297162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:45:52.297162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:45:52.297162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:45:52.297162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:45:52.297162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:45:52.297162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:45:52.297162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:45:52.297162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:45:52.297162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:45:52.297162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:45:52.297162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:45:52.297162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:45:52.297162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:45:52.297162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:45:52.298154 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:45:52.298154 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:45:52.298154 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:45:52.298154 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 621/1256] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:45:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:45:52.303490 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5340d-ddd1-4118-aed0-c0171e392ba4 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:52.391095 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:52.404398 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5340d-ddd1-4118-aed0-c0171e392ba4 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:52.436800 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801040c-f304-402a-a89c-8fcb8d729ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:52.437426 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801040c-f304-402a-a89c-8fcb8d729ebb None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:52.437707 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801040c-f304-402a-a89c-8fcb8d729ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:52.437979 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801040c-f304-402a-a89c-8fcb8d729ebb None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:52.438611 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801040c-f304-402a-a89c-8fcb8d729ebb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:45:52.438913 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801040c-f304-402a-a89c-8fcb8d729ebb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:52.440272 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801040c-f304-402a-a89c-8fcb8d729ebb None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:52.451845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 636/1257] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:45:52.457565 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4ed34-7ba2-4f47-b119-9f11e4476da7 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:52.554462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4ed34-7ba2-4f47-b119-9f11e4476da7 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:52.587754 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b1bcb-e22d-43fd-8b65-43c3753186b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:52.588364 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b1bcb-e22d-43fd-8b65-43c3753186b3 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:52.588641 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b1bcb-e22d-43fd-8b65-43c3753186b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:52.588910 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b1bcb-e22d-43fd-8b65-43c3753186b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:52.596473 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b1bcb-e22d-43fd-8b65-43c3753186b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:52.597947 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b1bcb-e22d-43fd-8b65-43c3753186b3 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:52.609179 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-421b1bcb-e22d-43fd-8b65-43c3753186b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:45:52.609179 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:45:52.609179 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:45:52.609179 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:45:52.609179 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:45:52.609179 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:45:52.609179 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:45:52.609179 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:45:52.609179 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:45:52.609179 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:45:52.609179 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:45:52.609179 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:45:52.609179 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 17:45:52.609179 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 17:45:52.609179 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 17:45:52.610239 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 17:45:52.610239 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:45:52.610239 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:45:52.610239 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:45:52.610239 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:45:52.610239 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:45:52.610239 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:45:52.610239 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:45:52.610239 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:45:52.610239 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:45:52.610239 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:45:52.610239 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:45:52.610239 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:45:52.610239 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:45:52.610239 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:45:52.610239 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:45:52.610239 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:45:52.611202 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 17:45:52.611202 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 17:45:52.611202 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 17:45:52.611202 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 17:45:52.611202 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 17:45:52.611202 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 17:45:52.611202 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:45:52.611202 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:45:52.611202 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 622/1258] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:45:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:45:52.618248 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801040c-f304-402a-a89c-8fcb8d729ebb None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:52.718866 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801040c-f304-402a-a89c-8fcb8d729ebb None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:52.751074 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee579423-034e-4557-bd5d-33e705228071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:52.751677 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee579423-034e-4557-bd5d-33e705228071 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:52.751958 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee579423-034e-4557-bd5d-33e705228071 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:52.752231 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee579423-034e-4557-bd5d-33e705228071 None admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:52.752917 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee579423-034e-4557-bd5d-33e705228071 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:45:52.753258 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee579423-034e-4557-bd5d-33e705228071 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:52.754694 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee579423-034e-4557-bd5d-33e705228071 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:52.766231 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 637/1259] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Sep 26 17:45:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:45:52.772454 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b1bcb-e22d-43fd-8b65-43c3753186b3 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:52.798283 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:52.870655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b1bcb-e22d-43fd-8b65-43c3753186b3 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:52.903303 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad7ab5-09fb-4a34-9572-ab07d1ec3e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:52.903883 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad7ab5-09fb-4a34-9572-ab07d1ec3e09 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:52.904157 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad7ab5-09fb-4a34-9572-ab07d1ec3e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:52.904420 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad7ab5-09fb-4a34-9572-ab07d1ec3e09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:52.905153 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad7ab5-09fb-4a34-9572-ab07d1ec3e09 None admin] RBAC: Adding query filter params (role.id=be6ee971abf54b26be509c14823ece55, scope.project.id=125361b23eb14b53aca5e0139919881e, user.id=f5043d835c08458c9f3911a4741bdaa8) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:45:52.905455 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad7ab5-09fb-4a34-9572-ab07d1ec3e09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:52.906876 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad7ab5-09fb-4a34-9572-ab07d1ec3e09 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:52.912546 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 623/1260] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:45:52 2022] GET /identity/v3/role_assignments?user.id=f5043d835c08458c9f3911a4741bdaa8&scope.project.id=125361b23eb14b53aca5e0139919881e&role.id=be6ee971abf54b26be509c14823ece55 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:45:55.010965 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699e872-53d5-4e99-8e56-129b767c5a34 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:55.011521 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699e872-53d5-4e99-8e56-129b767c5a34 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:55.011521 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699e872-53d5-4e99-8e56-129b767c5a34 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:55.012824 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 638/1261] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:45:55.017885 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251b50b-e994-45e3-be66-10fc9297c321 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:55.018320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251b50b-e994-45e3-be66-10fc9297c321 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:55.018442 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251b50b-e994-45e3-be66-10fc9297c321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:55.036763 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-8251b50b-e994-45e3-be66-10fc9297c321 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:45:55.037973 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-8251b50b-e994-45e3-be66-10fc9297c321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:45:55.113840 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 624/1262] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:45:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:45:55.397916 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699e872-53d5-4e99-8e56-129b767c5a34 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:55.409323 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:55.499608 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699e872-53d5-4e99-8e56-129b767c5a34 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:55.533786 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeffd6e-6cda-42d6-b72e-1e0acdd31430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:55.534401 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeffd6e-6cda-42d6-b72e-1e0acdd31430 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:55.534680 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeffd6e-6cda-42d6-b72e-1e0acdd31430 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:55.534949 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeffd6e-6cda-42d6-b72e-1e0acdd31430 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:55.544605 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeffd6e-6cda-42d6-b72e-1e0acdd31430 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:45:55.549342 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-5aeffd6e-6cda-42d6-b72e-1e0acdd31430 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:45:55.549342 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:45:55.549342 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:45:55.549342 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:45:55.549342 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:45:55.549342 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:45:55.549342 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:45:55.549342 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:45:55.549342 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:45:55.549342 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:45:55.549342 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:45:55.549342 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:45:55.549342 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:45:55.549342 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:45:55.549342 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:45:55.549342 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:45:55.550429 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:45:55.550429 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:45:55.550429 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:45:55.550429 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:45:55.550429 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:45:55.550429 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:45:55.550429 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:45:55.550429 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:45:55.550429 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:45:55.550429 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:45:55.550429 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:45:55.550429 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:45:55.550429 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:45:55.550429 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:45:55.550429 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:45:55.550429 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:45:55.551405 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:45:55.551405 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:45:55.551405 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:45:55.551405 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:45:55.551405 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:45:55.551405 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:45:55.551405 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:45:55.551405 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:45:55.551405 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:45:55.551405 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:45:55.551405 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:45:55.551405 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:45:55.551405 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 639/1263] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Sep 26 17:45:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:45:55.556897 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251b50b-e994-45e3-be66-10fc9297c321 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:55.575623 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:55.659635 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251b50b-e994-45e3-be66-10fc9297c321 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:55.692770 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abb583-ab6c-44e7-a1bc-ced4dd09eb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:55.693394 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abb583-ab6c-44e7-a1bc-ced4dd09eb1c None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:55.693667 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abb583-ab6c-44e7-a1bc-ced4dd09eb1c None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:55.693933 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abb583-ab6c-44e7-a1bc-ced4dd09eb1c None admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:55.694584 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8abb583-ab6c-44e7-a1bc-ced4dd09eb1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:45:55.694880 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8abb583-ab6c-44e7-a1bc-ced4dd09eb1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:55.696888 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8abb583-ab6c-44e7-a1bc-ced4dd09eb1c None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:55.704884 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 625/1264] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:45:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:45:55.710712 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeffd6e-6cda-42d6-b72e-1e0acdd31430 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:55.774351 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:55.807179 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeffd6e-6cda-42d6-b72e-1e0acdd31430 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:55.839259 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a50d4e-63f4-432e-bf7f-86b7f1586da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:55.839931 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a50d4e-63f4-432e-bf7f-86b7f1586da6 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:55.840207 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a50d4e-63f4-432e-bf7f-86b7f1586da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:55.840479 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a50d4e-63f4-432e-bf7f-86b7f1586da6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:55.850929 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a50d4e-63f4-432e-bf7f-86b7f1586da6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:55.852871 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a50d4e-63f4-432e-bf7f-86b7f1586da6 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:55.866495 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-b8a50d4e-63f4-432e-bf7f-86b7f1586da6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:45:55.866495 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:45:55.866495 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:45:55.866495 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:45:55.866495 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:45:55.866495 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:45:55.866495 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:45:55.866495 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:45:55.866495 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:45:55.866495 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:45:55.866495 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:45:55.866495 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:45:55.866495 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:45:55.866495 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:45:55.866495 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:45:55.866495 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:45:55.868164 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:45:55.868164 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:45:55.868164 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:45:55.868164 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:45:55.868164 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:45:55.868164 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:45:55.868164 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:45:55.868164 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:45:55.868164 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:45:55.868164 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:45:55.868164 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:45:55.868164 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:45:55.868164 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:45:55.868164 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:45:55.868164 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:45:55.868164 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:45:55.868164 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:45:55.869287 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:45:55.869287 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:45:55.869287 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:45:55.869287 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 640/1265] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:45:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:45:55.874003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abb583-ab6c-44e7-a1bc-ced4dd09eb1c None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:55.953798 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:55.973306 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abb583-ab6c-44e7-a1bc-ced4dd09eb1c None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:56.007795 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476da15-f46d-4cd9-a459-66a90144fd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:56.008396 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476da15-f46d-4cd9-a459-66a90144fd7f None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:56.008674 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476da15-f46d-4cd9-a459-66a90144fd7f None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:56.008946 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476da15-f46d-4cd9-a459-66a90144fd7f None admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:56.009617 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476da15-f46d-4cd9-a459-66a90144fd7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:45:56.009919 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476da15-f46d-4cd9-a459-66a90144fd7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:56.011287 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476da15-f46d-4cd9-a459-66a90144fd7f None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:56.022627 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 626/1266] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:45:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:45:56.028278 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a50d4e-63f4-432e-bf7f-86b7f1586da6 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:56.127921 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a50d4e-63f4-432e-bf7f-86b7f1586da6 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:56.146396 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:56.160157 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240b336-28ac-46ac-9366-53eaa19f158e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:56.160774 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240b336-28ac-46ac-9366-53eaa19f158e None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:56.161075 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240b336-28ac-46ac-9366-53eaa19f158e None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:56.161345 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240b336-28ac-46ac-9366-53eaa19f158e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:56.168881 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240b336-28ac-46ac-9366-53eaa19f158e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:56.170332 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240b336-28ac-46ac-9366-53eaa19f158e None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:56.181622 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-c240b336-28ac-46ac-9366-53eaa19f158e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 26 17:45:56.181622 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:45:56.181622 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:45:56.181622 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:45:56.181622 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:45:56.181622 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:45:56.181622 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:45:56.181622 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:45:56.181622 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:45:56.181622 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:45:56.181622 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:45:56.181622 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:45:56.181622 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 17:45:56.181622 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 17:45:56.181622 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 17:45:56.181622 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 17:45:56.182677 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:45:56.182677 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:45:56.182677 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 17:45:56.182677 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:45:56.182677 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 17:45:56.182677 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:45:56.182677 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:45:56.182677 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:45:56.182677 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:45:56.182677 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:45:56.182677 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:45:56.182677 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:45:56.182677 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:45:56.182677 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:45:56.182677 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:45:56.182677 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:45:56.182677 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:45:56.182677 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:45:56.183623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:45:56.183623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:45:56.183623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 17:45:56.183623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 17:45:56.183623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 17:45:56.183623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 17:45:56.183623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 17:45:56.183623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 17:45:56.183623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 26 17:45:56.183623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:45:56.183623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 641/1267] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:45:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:45:56.188696 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476da15-f46d-4cd9-a459-66a90144fd7f None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:56.286419 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476da15-f46d-4cd9-a459-66a90144fd7f None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:56.319763 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69aa5b-353c-4d4a-851b-ddede1f90bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:56.320356 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69aa5b-353c-4d4a-851b-ddede1f90bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:56.320635 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69aa5b-353c-4d4a-851b-ddede1f90bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:56.320909 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69aa5b-353c-4d4a-851b-ddede1f90bd3 None admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:56.321661 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69aa5b-353c-4d4a-851b-ddede1f90bd3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:45:56.321965 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69aa5b-353c-4d4a-851b-ddede1f90bd3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:56.323387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69aa5b-353c-4d4a-851b-ddede1f90bd3 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:56.331799 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:56.340913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 627/1268] 10.222.0.62 () {56 vars in 1143 bytes} [Mon Sep 26 17:45:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:45:56.346715 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240b336-28ac-46ac-9366-53eaa19f158e None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:56.443858 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240b336-28ac-46ac-9366-53eaa19f158e None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:56.476306 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b2988-fe87-4953-b2c4-0a5e767ff136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:56.476920 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b2988-fe87-4953-b2c4-0a5e767ff136 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:56.477228 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b2988-fe87-4953-b2c4-0a5e767ff136 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:56.477501 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b2988-fe87-4953-b2c4-0a5e767ff136 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:56.487632 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b2988-fe87-4953-b2c4-0a5e767ff136 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:56.489095 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b2988-fe87-4953-b2c4-0a5e767ff136 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:56.503262 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-145b2988-fe87-4953-b2c4-0a5e767ff136 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:45:56.503262 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:45:56.503262 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:45:56.503262 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:45:56.503262 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:45:56.503262 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:45:56.503262 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:45:56.503262 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:45:56.503262 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:45:56.503262 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:45:56.503262 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:45:56.503262 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:45:56.503262 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:45:56.503262 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:45:56.503262 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:45:56.503262 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:45:56.509112 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:45:56.509112 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:45:56.509112 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:45:56.509112 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:45:56.509112 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:45:56.509112 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:45:56.509112 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:45:56.509112 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:45:56.509112 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:45:56.509112 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:45:56.509112 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:45:56.509112 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:45:56.509112 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:45:56.509112 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:45:56.509112 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:45:56.509112 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:45:56.509112 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:45:56.510257 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:45:56.510257 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:45:56.510257 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:45:56.510257 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 642/1269] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:45:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:45:56.510709 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69aa5b-353c-4d4a-851b-ddede1f90bd3 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:56.607644 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69aa5b-353c-4d4a-851b-ddede1f90bd3 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:56.640506 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a866c3c4-b51c-43f4-8193-de6f64ccf9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:56.641128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866c3c4-b51c-43f4-8193-de6f64ccf9cc None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:56.641412 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866c3c4-b51c-43f4-8193-de6f64ccf9cc None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:56.641683 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866c3c4-b51c-43f4-8193-de6f64ccf9cc None admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:56.642315 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a866c3c4-b51c-43f4-8193-de6f64ccf9cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:45:56.642615 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a866c3c4-b51c-43f4-8193-de6f64ccf9cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:56.643973 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a866c3c4-b51c-43f4-8193-de6f64ccf9cc None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:56.654888 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 628/1270] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:45:56.660609 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b2988-fe87-4953-b2c4-0a5e767ff136 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:56.692510 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:56.759738 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b2988-fe87-4953-b2c4-0a5e767ff136 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:56.791997 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b1201-a59b-4918-97d1-c71165e941b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:56.792613 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b1201-a59b-4918-97d1-c71165e941b8 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:56.792893 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b1201-a59b-4918-97d1-c71165e941b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:56.793195 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b1201-a59b-4918-97d1-c71165e941b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:56.799565 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b1201-a59b-4918-97d1-c71165e941b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:56.800993 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b1201-a59b-4918-97d1-c71165e941b8 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:56.813144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-1c2b1201-a59b-4918-97d1-c71165e941b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:45:56.813144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:45:56.813144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:45:56.813144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:45:56.813144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:45:56.813144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:45:56.813144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:45:56.813144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:45:56.813144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:45:56.813144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:45:56.813144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:45:56.813144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:45:56.813144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 17:45:56.813144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 17:45:56.813144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 17:45:56.814155 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 17:45:56.814155 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:45:56.814155 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:45:56.814155 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:45:56.814155 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:45:56.814155 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:45:56.814155 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:45:56.814155 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:45:56.814155 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:45:56.814155 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:45:56.814155 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:45:56.814155 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:45:56.814155 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:45:56.814155 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:45:56.814155 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:45:56.814155 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:45:56.814155 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:45:56.815102 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 17:45:56.815102 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 17:45:56.815102 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 17:45:56.815102 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 17:45:56.815102 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 17:45:56.815102 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 17:45:56.815102 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:45:56.815102 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:45:56.815102 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 643/1271] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:45:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:45:56.820437 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a866c3c4-b51c-43f4-8193-de6f64ccf9cc None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:56.877955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:56.919745 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a866c3c4-b51c-43f4-8193-de6f64ccf9cc None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:56.952604 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963c315-74df-488e-91bf-c1af0f50ba34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:56.953222 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963c315-74df-488e-91bf-c1af0f50ba34 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:56.953503 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963c315-74df-488e-91bf-c1af0f50ba34 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:56.953776 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963c315-74df-488e-91bf-c1af0f50ba34 None admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:56.954459 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963c315-74df-488e-91bf-c1af0f50ba34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:45:56.954762 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963c315-74df-488e-91bf-c1af0f50ba34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:56.956202 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963c315-74df-488e-91bf-c1af0f50ba34 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:56.968287 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 629/1272] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Sep 26 17:45:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:45:56.974230 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b1201-a59b-4918-97d1-c71165e941b8 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:57.063277 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:57.073801 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b1201-a59b-4918-97d1-c71165e941b8 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:57.110123 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1019f77-3d4e-453e-bf95-0ec7f2cc1810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:57.110771 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1019f77-3d4e-453e-bf95-0ec7f2cc1810 None admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:57.111045 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1019f77-3d4e-453e-bf95-0ec7f2cc1810 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:57.111311 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1019f77-3d4e-453e-bf95-0ec7f2cc1810 None admin] PATH_INFO: `/v3/projects/125361b23eb14b53aca5e0139919881e/users/f5043d835c08458c9f3911a4741bdaa8/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:57.113206 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1019f77-3d4e-453e-bf95-0ec7f2cc1810 None admin] RBAC: Authorizing `identity:create_grant(project_id=125361b23eb14b53aca5e0139919881e, user_id=f5043d835c08458c9f3911a4741bdaa8, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:57.114615 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1019f77-3d4e-453e-bf95-0ec7f2cc1810 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:57.126401 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 644/1273] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Sep 26 17:45:56 2022] PUT /identity/v3/projects/125361b23eb14b53aca5e0139919881e/users/f5043d835c08458c9f3911a4741bdaa8/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:45:59.309979 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77e930-42c4-4f59-b799-17a1637db3c9 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:59.310510 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77e930-42c4-4f59-b799-17a1637db3c9 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:59.310510 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77e930-42c4-4f59-b799-17a1637db3c9 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:59.311868 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 630/1274] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:45:59.317466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935b0ce-b74f-4cbe-9414-dbacc02f5d23 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:59.317871 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935b0ce-b74f-4cbe-9414-dbacc02f5d23 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:59.318013 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935b0ce-b74f-4cbe-9414-dbacc02f5d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:59.336576 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-5935b0ce-b74f-4cbe-9414-dbacc02f5d23 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:45:59.337789 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-5935b0ce-b74f-4cbe-9414-dbacc02f5d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:45:59.401952 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 645/1275] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:45:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 17:45:59.673552 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77e930-42c4-4f59-b799-17a1637db3c9 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:59.771747 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77e930-42c4-4f59-b799-17a1637db3c9 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:59.789445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:59.805603 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550bbe4-e5f1-44af-97a9-c267879aa215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:59.806223 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550bbe4-e5f1-44af-97a9-c267879aa215 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:59.806501 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550bbe4-e5f1-44af-97a9-c267879aa215 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:59.806768 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550bbe4-e5f1-44af-97a9-c267879aa215 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:59.816447 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d550bbe4-e5f1-44af-97a9-c267879aa215 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 17:45:59.821999 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-d550bbe4-e5f1-44af-97a9-c267879aa215 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:45:59.821999 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:45:59.821999 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:45:59.821999 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:45:59.821999 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:45:59.821999 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:45:59.821999 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:45:59.821999 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:45:59.821999 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:45:59.821999 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:45:59.821999 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:45:59.821999 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:45:59.821999 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 17:45:59.821999 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 17:45:59.821999 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 17:45:59.821999 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 17:45:59.823102 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 17:45:59.823102 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 17:45:59.823102 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 17:45:59.823102 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 17:45:59.823102 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:45:59.823102 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:45:59.823102 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:45:59.823102 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:45:59.823102 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:45:59.823102 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:45:59.823102 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:45:59.823102 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:45:59.823102 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:45:59.823102 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:45:59.823102 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:45:59.823102 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:45:59.823940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:45:59.823940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:45:59.823940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:45:59.823940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:45:59.823940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 17:45:59.823940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 17:45:59.823940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 17:45:59.823940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 17:45:59.823940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 17:45:59.823940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 17:45:59.823940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 17:45:59.823940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:45:59.823940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 631/1276] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Sep 26 17:45:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:45:59.829160 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935b0ce-b74f-4cbe-9414-dbacc02f5d23 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:45:59.907794 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:45:59.926031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935b0ce-b74f-4cbe-9414-dbacc02f5d23 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:45:59.958892 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80f1f2-563e-4e77-ab26-7d8c7942357b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:45:59.959486 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80f1f2-563e-4e77-ab26-7d8c7942357b None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:45:59.959764 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80f1f2-563e-4e77-ab26-7d8c7942357b None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:45:59.960033 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80f1f2-563e-4e77-ab26-7d8c7942357b None admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:45:59.961382 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80f1f2-563e-4e77-ab26-7d8c7942357b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:45:59.961682 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80f1f2-563e-4e77-ab26-7d8c7942357b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:45:59.963038 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80f1f2-563e-4e77-ab26-7d8c7942357b None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:45:59.970702 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 646/1277] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Sep 26 17:45:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:45:59.976483 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550bbe4-e5f1-44af-97a9-c267879aa215 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:46:00.076555 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550bbe4-e5f1-44af-97a9-c267879aa215 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:46:00.114704 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e57c91-d422-4ab7-a4bd-dd7e552c290e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:46:00.115427 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e57c91-d422-4ab7-a4bd-dd7e552c290e None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:46:00.115781 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e57c91-d422-4ab7-a4bd-dd7e552c290e None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:46:00.116135 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e57c91-d422-4ab7-a4bd-dd7e552c290e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:46:00.128558 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e57c91-d422-4ab7-a4bd-dd7e552c290e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:46:00.130215 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e57c91-d422-4ab7-a4bd-dd7e552c290e None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:46:00.146387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-43e57c91-d422-4ab7-a4bd-dd7e552c290e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:46:00.146387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:46:00.146387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:46:00.146387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:46:00.146387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:46:00.146387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:46:00.146387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:46:00.146387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:46:00.146387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:46:00.146387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:46:00.146387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:46:00.146387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:46:00.146387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:46:00.146387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:46:00.146387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:46:00.146387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:46:00.147586 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:46:00.147586 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:46:00.147586 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:46:00.147586 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:46:00.147586 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:46:00.147586 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:46:00.147586 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:46:00.147586 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:46:00.147586 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:46:00.147586 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:46:00.147586 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:46:00.147586 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:46:00.147586 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:46:00.147586 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:46:00.147586 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:46:00.147586 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:46:00.147586 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:46:00.148610 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:46:00.148610 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:46:00.148610 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:46:00.148610 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 632/1278] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:45:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:46:00.153352 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80f1f2-563e-4e77-ab26-7d8c7942357b None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:46:00.248914 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80f1f2-563e-4e77-ab26-7d8c7942357b None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:46:00.281378 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64d5c7-dca4-4417-859e-29bbefbb5239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:46:00.281982 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64d5c7-dca4-4417-859e-29bbefbb5239 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:46:00.282259 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64d5c7-dca4-4417-859e-29bbefbb5239 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:46:00.282526 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64d5c7-dca4-4417-859e-29bbefbb5239 None admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:46:00.283157 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64d5c7-dca4-4417-859e-29bbefbb5239 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:46:00.283456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64d5c7-dca4-4417-859e-29bbefbb5239 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:46:00.284806 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64d5c7-dca4-4417-859e-29bbefbb5239 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:46:00.296052 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 647/1279] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:46:00.301901 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e57c91-d422-4ab7-a4bd-dd7e552c290e None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:46:00.332997 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:46:00.401362 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e57c91-d422-4ab7-a4bd-dd7e552c290e None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:46:00.437753 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8155624-75fa-438c-9e43-5e527009435b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:46:00.438555 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8155624-75fa-438c-9e43-5e527009435b None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:46:00.438980 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8155624-75fa-438c-9e43-5e527009435b None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:46:00.439273 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8155624-75fa-438c-9e43-5e527009435b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:46:00.447675 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8155624-75fa-438c-9e43-5e527009435b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:46:00.449132 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8155624-75fa-438c-9e43-5e527009435b None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:46:00.460046 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-d8155624-75fa-438c-9e43-5e527009435b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 26 17:46:00.460046 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:46:00.460046 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:46:00.460046 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:46:00.460046 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:46:00.460046 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:46:00.460046 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:46:00.460046 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:46:00.460046 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:46:00.460046 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:46:00.460046 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:46:00.460046 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:46:00.460046 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 17:46:00.460046 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 17:46:00.460046 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 17:46:00.460046 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 17:46:00.461189 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:46:00.461189 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:46:00.461189 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 17:46:00.461189 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:46:00.461189 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 17:46:00.461189 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 17:46:00.461189 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:46:00.461189 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:46:00.461189 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:46:00.461189 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:46:00.461189 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:46:00.461189 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:46:00.461189 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:46:00.461189 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:46:00.461189 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:46:00.461189 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:46:00.461189 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:46:00.461189 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:46:00.462478 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:46:00.462478 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:46:00.462478 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 17:46:00.462478 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 17:46:00.462478 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 17:46:00.462478 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 17:46:00.462478 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 17:46:00.462478 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 17:46:00.462478 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 26 17:46:00.462478 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:46:00.462478 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 633/1280] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:46:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:46:00.467098 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64d5c7-dca4-4417-859e-29bbefbb5239 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:46:00.470983 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:46:00.563902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64d5c7-dca4-4417-859e-29bbefbb5239 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:46:00.596201 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f7d9c-968b-4002-9a40-eeb21314f4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:46:00.596798 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f7d9c-968b-4002-9a40-eeb21314f4c5 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:46:00.597108 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f7d9c-968b-4002-9a40-eeb21314f4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:46:00.597383 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f7d9c-968b-4002-9a40-eeb21314f4c5 None admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:46:00.598110 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48f7d9c-968b-4002-9a40-eeb21314f4c5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:46:00.598417 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48f7d9c-968b-4002-9a40-eeb21314f4c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:46:00.599835 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48f7d9c-968b-4002-9a40-eeb21314f4c5 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:46:00.618008 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 648/1281] 10.222.0.62 () {56 vars in 1143 bytes} [Mon Sep 26 17:46:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:46:00.623746 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8155624-75fa-438c-9e43-5e527009435b None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:46:00.712597 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:46:00.724755 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8155624-75fa-438c-9e43-5e527009435b None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:46:00.763108 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733f4e4-82a8-4e15-92b1-e46b85f7a900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:46:00.763705 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733f4e4-82a8-4e15-92b1-e46b85f7a900 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:46:00.763983 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733f4e4-82a8-4e15-92b1-e46b85f7a900 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:46:00.764251 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733f4e4-82a8-4e15-92b1-e46b85f7a900 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:46:00.830360 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733f4e4-82a8-4e15-92b1-e46b85f7a900 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:46:00.831730 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733f4e4-82a8-4e15-92b1-e46b85f7a900 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:46:00.917477 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:46:00.928154 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 634/1282] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Sep 26 17:46:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 17:46:00.934029 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f7d9c-968b-4002-9a40-eeb21314f4c5 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:46:00.992577 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:46:01.029203 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f7d9c-968b-4002-9a40-eeb21314f4c5 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:46:01.062589 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f21358-8748-4a77-8a1d-a6c8a77cb5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:46:01.063201 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f21358-8748-4a77-8a1d-a6c8a77cb5a4 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:46:01.063480 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f21358-8748-4a77-8a1d-a6c8a77cb5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:46:01.063746 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f21358-8748-4a77-8a1d-a6c8a77cb5a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:46:01.075268 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f21358-8748-4a77-8a1d-a6c8a77cb5a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:46:01.076735 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f21358-8748-4a77-8a1d-a6c8a77cb5a4 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:46:01.094062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-26f21358-8748-4a77-8a1d-a6c8a77cb5a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:46:01.094062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:46:01.094062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:46:01.094062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:46:01.094062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:46:01.094062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:46:01.094062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:46:01.094062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:46:01.094062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:46:01.094062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:46:01.094062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:46:01.094062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:46:01.094062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 17:46:01.094062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 17:46:01.094062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 17:46:01.094062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 17:46:01.095255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:46:01.095255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:46:01.095255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:46:01.095255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:46:01.095255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:46:01.095255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:46:01.095255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:46:01.095255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:46:01.095255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:46:01.095255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:46:01.095255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:46:01.095255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:46:01.095255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:46:01.095255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:46:01.095255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:46:01.095255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:46:01.095255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 17:46:01.096216 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 17:46:01.096216 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 17:46:01.096216 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:46:01.096216 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 649/1283] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:46:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:46:01.101073 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733f4e4-82a8-4e15-92b1-e46b85f7a900 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:46:01.202942 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733f4e4-82a8-4e15-92b1-e46b85f7a900 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:46:01.241525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040ff1c-0bf2-4d2d-9f1f-124efbc7aeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:46:01.242159 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040ff1c-0bf2-4d2d-9f1f-124efbc7aeb8 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:46:01.242438 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040ff1c-0bf2-4d2d-9f1f-124efbc7aeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:46:01.242708 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040ff1c-0bf2-4d2d-9f1f-124efbc7aeb8 None admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:46:01.243371 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040ff1c-0bf2-4d2d-9f1f-124efbc7aeb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:46:01.243673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040ff1c-0bf2-4d2d-9f1f-124efbc7aeb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:46:01.245098 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040ff1c-0bf2-4d2d-9f1f-124efbc7aeb8 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:46:01.258120 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 635/1284] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Sep 26 17:46:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:46:01.263920 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f21358-8748-4a77-8a1d-a6c8a77cb5a4 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:46:01.364911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f21358-8748-4a77-8a1d-a6c8a77cb5a4 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:46:01.379311 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:46:01.399953 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dbc3c0-0ab9-4858-a4d9-4b2537f7ded0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:46:01.400584 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbc3c0-0ab9-4858-a4d9-4b2537f7ded0 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:46:01.400863 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbc3c0-0ab9-4858-a4d9-4b2537f7ded0 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:46:01.401179 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbc3c0-0ab9-4858-a4d9-4b2537f7ded0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:46:01.407879 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dbc3c0-0ab9-4858-a4d9-4b2537f7ded0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:46:01.409359 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dbc3c0-0ab9-4858-a4d9-4b2537f7ded0 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:46:01.421563 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application [None req-c7dbc3c0-0ab9-4858-a4d9-4b2537f7ded0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:46:01.421563 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:46:01.421563 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:46:01.421563 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:46:01.421563 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:46:01.421563 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:46:01.421563 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:46:01.421563 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:46:01.421563 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:46:01.421563 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:46:01.421563 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:46:01.421563 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:46:01.421563 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 17:46:01.421563 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 17:46:01.421563 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 17:46:01.422678 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 17:46:01.422678 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:46:01.422678 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:46:01.422678 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:46:01.422678 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:46:01.422678 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:46:01.422678 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:46:01.422678 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:46:01.422678 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application with Lock( Sep 26 17:46:01.422678 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:46:01.422678 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:46:01.422678 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:46:01.422678 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:46:01.422678 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:46:01.422678 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:46:01.422678 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:46:01.422678 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:46:01.428722 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 17:46:01.428722 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 17:46:01.428722 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 17:46:01.428722 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 17:46:01.428722 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 17:46:01.428722 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 17:46:01.428722 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 17:46:01.428722 dv-cinder-859318-1-smb devstack@keystone.service[81277]: ERROR keystone.server.flask.application Sep 26 17:46:01.428722 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 650/1285] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Sep 26 17:46:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 17:46:01.429899 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040ff1c-0bf2-4d2d-9f1f-124efbc7aeb8 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:46:01.481173 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:46:01.532310 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040ff1c-0bf2-4d2d-9f1f-124efbc7aeb8 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:46:01.567194 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af1c2e-f524-44e2-9121-7cb7ae7df90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:46:01.567795 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af1c2e-f524-44e2-9121-7cb7ae7df90d None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:46:01.568077 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af1c2e-f524-44e2-9121-7cb7ae7df90d None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:46:01.568349 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af1c2e-f524-44e2-9121-7cb7ae7df90d None admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:46:01.569059 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af1c2e-f524-44e2-9121-7cb7ae7df90d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:46:01.569372 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af1c2e-f524-44e2-9121-7cb7ae7df90d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:46:01.570811 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af1c2e-f524-44e2-9121-7cb7ae7df90d None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:46:01.582769 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 636/1286] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Sep 26 17:46:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:46:01.589510 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dbc3c0-0ab9-4858-a4d9-4b2537f7ded0 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:46:01.706962 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dbc3c0-0ab9-4858-a4d9-4b2537f7ded0 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:46:01.742098 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527d5fa-0275-4c72-9ea2-d21026874e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:46:01.742747 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527d5fa-0275-4c72-9ea2-d21026874e8b None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:46:01.743029 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527d5fa-0275-4c72-9ea2-d21026874e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:46:01.743347 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527d5fa-0275-4c72-9ea2-d21026874e8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:46:01.744028 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527d5fa-0275-4c72-9ea2-d21026874e8b None admin] RBAC: Adding query filter params (role.id=be6ee971abf54b26be509c14823ece55, scope.project.id=125361b23eb14b53aca5e0139919881e, user.id=f5043d835c08458c9f3911a4741bdaa8) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:46:01.744338 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527d5fa-0275-4c72-9ea2-d21026874e8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:46:01.745864 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527d5fa-0275-4c72-9ea2-d21026874e8b None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:46:01.751828 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 651/1287] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Sep 26 17:46:01 2022] GET /identity/v3/role_assignments?user.id=f5043d835c08458c9f3911a4741bdaa8&scope.project.id=125361b23eb14b53aca5e0139919881e&role.id=be6ee971abf54b26be509c14823ece55 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:46:03.893487 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b936823-71b4-40af-a64e-6c4744b13355 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:46:03.894004 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b936823-71b4-40af-a64e-6c4744b13355 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:46:03.894004 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b936823-71b4-40af-a64e-6c4744b13355 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:46:03.895356 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 637/1288] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:46:03.901111 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909177ad-4827-4177-9c63-47a34bb7493d None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:46:03.901493 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909177ad-4827-4177-9c63-47a34bb7493d None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:46:03.901663 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909177ad-4827-4177-9c63-47a34bb7493d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:46:03.920189 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-909177ad-4827-4177-9c63-47a34bb7493d None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:46:03.921422 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-909177ad-4827-4177-9c63-47a34bb7493d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:46:03.949821 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:46:03.986379 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 652/1289] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:46:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:46:04.268489 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b936823-71b4-40af-a64e-6c4744b13355 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:46:04.368115 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b936823-71b4-40af-a64e-6c4744b13355 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:46:04.378805 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:46:04.402183 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17807e-4321-43ad-9bb4-ffc6616c56a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:46:04.402807 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17807e-4321-43ad-9bb4-ffc6616c56a5 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:46:04.403087 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17807e-4321-43ad-9bb4-ffc6616c56a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:46:04.403357 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17807e-4321-43ad-9bb4-ffc6616c56a5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:46:04.403938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17807e-4321-43ad-9bb4-ffc6616c56a5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:46:04.405464 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17807e-4321-43ad-9bb4-ffc6616c56a5 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:46:04.414669 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-7c17807e-4321-43ad-9bb4-ffc6616c56a5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 17:46:04.414669 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:46:04.414669 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 17:46:04.414669 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 17:46:04.414669 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 17:46:04.414669 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 17:46:04.414669 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 17:46:04.414669 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:46:04.414669 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 17:46:04.414669 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:46:04.414669 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 17:46:04.414669 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:46:04.414669 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:46:04.414669 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:46:04.414669 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:46:04.414669 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:46:04.414669 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:46:04.415884 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:46:04.415884 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:46:04.415884 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:46:04.415884 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:46:04.415884 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:46:04.415884 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:46:04.415884 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 17:46:04.415884 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 17:46:04.415884 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 17:46:04.415884 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 17:46:04.415884 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:46:04.415884 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:46:04.415884 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:46:04.415884 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:46:04.415884 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:46:04.415884 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:46:04.416913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:46:04.416913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:46:04.416913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:46:04.416913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:46:04.416913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:46:04.416913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:46:04.416913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:46:04.416913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:46:04.416913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:46:04.416913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:46:04.416913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 17:46:04.416913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:46:04.416913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 17:46:04.416913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:46:04.416913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 638/1290] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Sep 26 17:46:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:46:04.421747 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909177ad-4827-4177-9c63-47a34bb7493d None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:46:04.517692 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909177ad-4827-4177-9c63-47a34bb7493d None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:46:04.552201 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810c747-73ef-4790-a0f4-919920d6921e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:46:04.552711 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810c747-73ef-4790-a0f4-919920d6921e None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:46:04.552986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810c747-73ef-4790-a0f4-919920d6921e None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:46:04.553282 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810c747-73ef-4790-a0f4-919920d6921e None admin] PATH_INFO: `/v3/services` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:46:04.553931 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810c747-73ef-4790-a0f4-919920d6921e None admin] RBAC: Adding query filter params (name=placement) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:46:04.554229 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810c747-73ef-4790-a0f4-919920d6921e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:46:04.555575 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810c747-73ef-4790-a0f4-919920d6921e None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:46:04.560154 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 653/1291] 10.222.0.62 () {56 vars in 1116 bytes} [Mon Sep 26 17:46:04 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:46:04.565938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17807e-4321-43ad-9bb4-ffc6616c56a5 None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:46:04.663531 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17807e-4321-43ad-9bb4-ffc6616c56a5 None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:46:04.695860 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01587790-3877-41ea-8fc6-b12b24ae4916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:46:04.696454 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01587790-3877-41ea-8fc6-b12b24ae4916 None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:46:04.696733 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01587790-3877-41ea-8fc6-b12b24ae4916 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:46:04.697026 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01587790-3877-41ea-8fc6-b12b24ae4916 None admin] PATH_INFO: `/v3/services` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:46:04.697667 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01587790-3877-41ea-8fc6-b12b24ae4916 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:46:04.698058 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01587790-3877-41ea-8fc6-b12b24ae4916 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:46:04.699341 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01587790-3877-41ea-8fc6-b12b24ae4916 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:46:04.703824 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 639/1292] 10.222.0.62 () {56 vars in 1116 bytes} [Mon Sep 26 17:46:04 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:46:06.852930 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2dc52-e6e6-4e3b-b86e-65aed93ca42b None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:46:06.853496 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2dc52-e6e6-4e3b-b86e-65aed93ca42b None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:46:06.853496 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2dc52-e6e6-4e3b-b86e-65aed93ca42b None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:46:06.854839 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 654/1293] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:46:06.859922 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705a877-b7bd-442d-b9b9-c27b2f7c18dc None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:46:06.860303 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705a877-b7bd-442d-b9b9-c27b2f7c18dc None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:46:06.860473 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705a877-b7bd-442d-b9b9-c27b2f7c18dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:46:06.878905 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-f705a877-b7bd-442d-b9b9-c27b2f7c18dc None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:46:06.880077 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-f705a877-b7bd-442d-b9b9-c27b2f7c18dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:46:06.908950 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:46:06.946273 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 640/1294] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:46:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:46:07.219812 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2dc52-e6e6-4e3b-b86e-65aed93ca42b None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:46:07.249903 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:46:07.319447 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2dc52-e6e6-4e3b-b86e-65aed93ca42b None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:46:07.352153 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2dc29e-f9d1-4a28-ba65-125c00e3bcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:46:07.352747 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dc29e-f9d1-4a28-ba65-125c00e3bcc8 None admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:46:07.353048 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dc29e-f9d1-4a28-ba65-125c00e3bcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:46:07.353325 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dc29e-f9d1-4a28-ba65-125c00e3bcc8 None admin] PATH_INFO: `/v3/services` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:46:07.353983 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2dc29e-f9d1-4a28-ba65-125c00e3bcc8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:46:07.355338 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2dc29e-f9d1-4a28-ba65-125c00e3bcc8 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:46:07.369269 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 655/1295] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Sep 26 17:46:07 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:46:09.479489 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee5e15-c56b-4d18-9043-8ed426f2de90 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:46:09.480034 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee5e15-c56b-4d18-9043-8ed426f2de90 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:46:09.480034 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee5e15-c56b-4d18-9043-8ed426f2de90 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:46:09.481393 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 641/1296] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:46:09.486584 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d572c37-25bf-48b3-aeab-f9f227de213c None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:46:09.486997 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d572c37-25bf-48b3-aeab-f9f227de213c None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:46:09.487136 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d572c37-25bf-48b3-aeab-f9f227de213c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:46:09.505585 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-1d572c37-25bf-48b3-aeab-f9f227de213c None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:46:09.506806 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-1d572c37-25bf-48b3-aeab-f9f227de213c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:46:09.577076 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 656/1297] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:46:09 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:46:09.845622 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee5e15-c56b-4d18-9043-8ed426f2de90 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:46:09.943924 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee5e15-c56b-4d18-9043-8ed426f2de90 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:46:09.976887 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39a86a-9c43-42d1-8186-fa2e2ffbd88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:46:09.977526 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39a86a-9c43-42d1-8186-fa2e2ffbd88d None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:46:09.977807 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39a86a-9c43-42d1-8186-fa2e2ffbd88d None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:46:09.978079 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39a86a-9c43-42d1-8186-fa2e2ffbd88d None admin] PATH_INFO: `/v3/services/placement` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:46:09.978657 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c39a86a-9c43-42d1-8186-fa2e2ffbd88d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:46:09.980017 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c39a86a-9c43-42d1-8186-fa2e2ffbd88d None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:46:09.988574 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-4c39a86a-9c43-42d1-8186-fa2e2ffbd88d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 17:46:09.988574 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:46:09.988574 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 17:46:09.988574 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 17:46:09.988574 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 17:46:09.988574 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 17:46:09.988574 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 17:46:09.988574 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:46:09.988574 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 17:46:09.988574 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:46:09.988574 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 17:46:09.988574 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:46:09.988574 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:46:09.988574 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:46:09.988574 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:46:09.988574 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:46:09.988574 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:46:09.989605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:46:09.989605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:46:09.989605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:46:09.989605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:46:09.989605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:46:09.989605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:46:09.989605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 17:46:09.989605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 17:46:09.989605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 17:46:09.989605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 17:46:09.989605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:46:09.989605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:46:09.989605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:46:09.989605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:46:09.989605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:46:09.989605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:46:09.990434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:46:09.990434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:46:09.990434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:46:09.990434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:46:09.990434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:46:09.990434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:46:09.990434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:46:09.990434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:46:09.990434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:46:09.990434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:46:09.990434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 17:46:09.990434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:46:09.990434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 17:46:09.990434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:46:09.990434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 642/1298] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Sep 26 17:46:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:46:09.996234 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d572c37-25bf-48b3-aeab-f9f227de213c None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:46:10.014451 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:46:10.097788 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d572c37-25bf-48b3-aeab-f9f227de213c None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:46:10.138168 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912495d1-396b-493c-80cb-e047709e5299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:46:10.138812 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912495d1-396b-493c-80cb-e047709e5299 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:46:10.139119 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912495d1-396b-493c-80cb-e047709e5299 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:46:10.139426 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912495d1-396b-493c-80cb-e047709e5299 None admin] PATH_INFO: `/v3/services` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:46:10.140127 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912495d1-396b-493c-80cb-e047709e5299 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:46:10.140485 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912495d1-396b-493c-80cb-e047709e5299 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:46:10.142241 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912495d1-396b-493c-80cb-e047709e5299 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:46:10.148370 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 657/1299] 10.222.0.62 () {56 vars in 1116 bytes} [Mon Sep 26 17:46:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:46:10.154513 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39a86a-9c43-42d1-8186-fa2e2ffbd88d None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:46:10.187037 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:46:10.254555 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39a86a-9c43-42d1-8186-fa2e2ffbd88d None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:46:10.286643 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0222085-8e57-4ad5-b0f6-5dfd7235a15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:46:10.287232 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0222085-8e57-4ad5-b0f6-5dfd7235a15f None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:46:10.287997 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0222085-8e57-4ad5-b0f6-5dfd7235a15f None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:46:10.288262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0222085-8e57-4ad5-b0f6-5dfd7235a15f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:46:10.288952 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0222085-8e57-4ad5-b0f6-5dfd7235a15f None admin] RBAC: Adding query filter params (interface=public, service_id=da68cf0e4a4b4906853f52b07315daa1, region_id=RegionOne) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:46:10.289289 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0222085-8e57-4ad5-b0f6-5dfd7235a15f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:46:10.290989 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0222085-8e57-4ad5-b0f6-5dfd7235a15f None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:46:10.295789 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 643/1300] 10.222.0.62 () {56 vars in 1251 bytes} [Mon Sep 26 17:46:10 2022] GET /identity/v3/endpoints?service_id=da68cf0e4a4b4906853f52b07315daa1&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:46:10.301610 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912495d1-396b-493c-80cb-e047709e5299 None admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:46:10.381773 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:46:10.399888 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912495d1-396b-493c-80cb-e047709e5299 None admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:46:10.433326 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d14353-a99a-42f3-9624-57d1bea9fd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:46:10.433916 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d14353-a99a-42f3-9624-57d1bea9fd86 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:46:10.434195 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d14353-a99a-42f3-9624-57d1bea9fd86 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:46:10.434467 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d14353-a99a-42f3-9624-57d1bea9fd86 None admin] PATH_INFO: `/v3/services` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:46:10.435066 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d14353-a99a-42f3-9624-57d1bea9fd86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:46:10.436427 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d14353-a99a-42f3-9624-57d1bea9fd86 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:46:10.443257 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 658/1301] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Sep 26 17:46:10 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:46:12.544492 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcb3a1-1823-4e22-81fa-46db14b57aa2 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:46:12.545145 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcb3a1-1823-4e22-81fa-46db14b57aa2 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:46:12.545145 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcb3a1-1823-4e22-81fa-46db14b57aa2 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:46:12.546404 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 644/1302] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:46:12.551671 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbaa22-1b63-40cd-8a22-b044d8b15e83 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:46:12.552154 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbaa22-1b63-40cd-8a22-b044d8b15e83 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:46:12.552259 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbaa22-1b63-40cd-8a22-b044d8b15e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:46:12.570598 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-55bbaa22-1b63-40cd-8a22-b044d8b15e83 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:46:12.571765 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-55bbaa22-1b63-40cd-8a22-b044d8b15e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:46:12.635956 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 659/1303] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:46:12 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 17:46:12.905550 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcb3a1-1823-4e22-81fa-46db14b57aa2 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:46:13.000430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:46:13.008392 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcb3a1-1823-4e22-81fa-46db14b57aa2 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:46:13.041990 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384aa10-df50-400f-b9a0-441c233ffdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:46:13.042693 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384aa10-df50-400f-b9a0-441c233ffdfc None admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:46:13.042971 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384aa10-df50-400f-b9a0-441c233ffdfc None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:46:13.043246 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384aa10-df50-400f-b9a0-441c233ffdfc None admin] PATH_INFO: `/v3/services/placement` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:46:13.044040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384aa10-df50-400f-b9a0-441c233ffdfc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:46:13.045228 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384aa10-df50-400f-b9a0-441c233ffdfc None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:46:13.054516 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application [None req-0384aa10-df50-400f-b9a0-441c233ffdfc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 17:46:13.054516 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:46:13.054516 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 17:46:13.054516 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 17:46:13.054516 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 17:46:13.054516 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 17:46:13.054516 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 17:46:13.054516 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:46:13.054516 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 17:46:13.054516 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:46:13.054516 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 17:46:13.054516 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:46:13.054516 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 17:46:13.054516 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 17:46:13.054516 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 17:46:13.054516 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 17:46:13.054516 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 17:46:13.055787 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 17:46:13.055787 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 17:46:13.055787 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 17:46:13.055787 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 17:46:13.055787 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 17:46:13.055787 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 17:46:13.055787 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 17:46:13.055787 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 17:46:13.055787 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 17:46:13.055787 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 17:46:13.055787 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 17:46:13.055787 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 17:46:13.055787 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 17:46:13.055787 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 17:46:13.055787 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 17:46:13.055787 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 17:46:13.056709 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 17:46:13.056709 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application with Lock( Sep 26 17:46:13.056709 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 17:46:13.056709 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self._enter() Sep 26 17:46:13.056709 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 17:46:13.056709 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 17:46:13.056709 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 17:46:13.056709 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application return self.creator() Sep 26 17:46:13.056709 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 17:46:13.056709 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application created_value = creator( Sep 26 17:46:13.056709 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 17:46:13.056709 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 17:46:13.056709 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 17:46:13.056709 dv-cinder-859318-1-smb devstack@keystone.service[81278]: ERROR keystone.server.flask.application Sep 26 17:46:13.056709 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 645/1304] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Sep 26 17:46:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 17:46:13.061774 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbaa22-1b63-40cd-8a22-b044d8b15e83 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:46:13.180170 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:46:13.217225 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbaa22-1b63-40cd-8a22-b044d8b15e83 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:46:13.274602 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e445447-73be-4b4e-ac74-20da72763938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:46:13.275631 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e445447-73be-4b4e-ac74-20da72763938 None admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:46:13.276162 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e445447-73be-4b4e-ac74-20da72763938 None admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:46:13.276651 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e445447-73be-4b4e-ac74-20da72763938 None admin] PATH_INFO: `/v3/services` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:46:13.277830 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e445447-73be-4b4e-ac74-20da72763938 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:46:13.278366 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e445447-73be-4b4e-ac74-20da72763938 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:46:13.280904 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e445447-73be-4b4e-ac74-20da72763938 None admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:46:13.290472 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 660/1305] 10.222.0.62 () {56 vars in 1116 bytes} [Mon Sep 26 17:46:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:46:13.296178 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384aa10-df50-400f-b9a0-441c233ffdfc None admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:46:13.409991 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384aa10-df50-400f-b9a0-441c233ffdfc None admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:46:13.444827 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2c261-0901-40e1-a7af-493e3db52ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:46:13.445367 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2c261-0901-40e1-a7af-493e3db52ba1 None admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:46:13.445643 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2c261-0901-40e1-a7af-493e3db52ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:46:13.445908 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2c261-0901-40e1-a7af-493e3db52ba1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:46:13.446574 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d2c261-0901-40e1-a7af-493e3db52ba1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:46:13.447926 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d2c261-0901-40e1-a7af-493e3db52ba1 None admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:46:13.468197 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 646/1306] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:46:13 2022] POST /identity/v3/endpoints => generated 331 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:46:23.284489 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=30 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:46:23.463583 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:47:18.079838 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0534f5-b3ce-4e2b-907b-8d342728947c None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:47:18.080707 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0534f5-b3ce-4e2b-907b-8d342728947c None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:47:18.081173 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0534f5-b3ce-4e2b-907b-8d342728947c None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:47:18.082693 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 661/1307] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:47:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:47:18.088312 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a151c3-370a-4fc0-8932-e7b919ba45c2 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:47:18.089219 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a151c3-370a-4fc0-8932-e7b919ba45c2 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:47:18.089219 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a151c3-370a-4fc0-8932-e7b919ba45c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:47:18.169938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-66a151c3-370a-4fc0-8932-e7b919ba45c2 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:47:18.171181 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-66a151c3-370a-4fc0-8932-e7b919ba45c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:47:18.297654 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 647/1308] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:47:18.580286 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7bdfc-c35f-45a2-a644-5992b6b910a6 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:47:18.580842 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7bdfc-c35f-45a2-a644-5992b6b910a6 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:47:18.581294 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7bdfc-c35f-45a2-a644-5992b6b910a6 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:47:18.583027 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 662/1309] 10.222.0.62 () {54 vars in 964 bytes} [Mon Sep 26 17:47:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:47:18.591175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320a63d-c63a-43f2-90ed-c65bd7e72fe4 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:47:18.591468 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320a63d-c63a-43f2-90ed-c65bd7e72fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:47:18.591744 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320a63d-c63a-43f2-90ed-c65bd7e72fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:47:18.679245 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-1320a63d-c63a-43f2-90ed-c65bd7e72fe4 None None] MFA Rules not processed for user `a0ed50f4edcf468192a053b1e0fd6910`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:47:18.680474 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-1320a63d-c63a-43f2-90ed-c65bd7e72fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:47:18.704553 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:47:18.775649 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 648/1310] 10.222.0.62 () {58 vars in 1061 bytes} [Mon Sep 26 17:47:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:47:18.785628 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7bdfc-c35f-45a2-a644-5992b6b910a6 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:47:18.787639 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-d8c7bdfc-c35f-45a2-a644-5992b6b910a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:47:18.942054 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7bdfc-c35f-45a2-a644-5992b6b910a6 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:47:19.044317 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90f2f6-5376-4ddc-a039-553be5188cf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:47:19.045312 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90f2f6-5376-4ddc-a039-553be5188cf6 service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:47:19.045938 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90f2f6-5376-4ddc-a039-553be5188cf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:47:19.046376 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90f2f6-5376-4ddc-a039-553be5188cf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:47:19.048386 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-da90f2f6-5376-4ddc-a039-553be5188cf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:47:19.131474 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:47:19.233601 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da90f2f6-5376-4ddc-a039-553be5188cf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:47:19.235455 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da90f2f6-5376-4ddc-a039-553be5188cf6 service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:47:19.259923 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 663/1311] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:47:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:47:21.773466 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a991861-67a6-4fbd-b431-2a5762d9bfa3 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:47:21.774039 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a991861-67a6-4fbd-b431-2a5762d9bfa3 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:47:21.774039 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a991861-67a6-4fbd-b431-2a5762d9bfa3 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:47:21.775366 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 649/1312] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:47:21.780589 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295a9dd-2b7d-456f-9a55-7a6d88036235 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:47:21.780987 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295a9dd-2b7d-456f-9a55-7a6d88036235 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:47:21.781177 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295a9dd-2b7d-456f-9a55-7a6d88036235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:47:21.867612 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-4295a9dd-2b7d-456f-9a55-7a6d88036235 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:47:21.868845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-4295a9dd-2b7d-456f-9a55-7a6d88036235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:47:21.964679 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 664/1313] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:47:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:47:22.245099 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a991861-67a6-4fbd-b431-2a5762d9bfa3 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:47:22.246605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-7a991861-67a6-4fbd-b431-2a5762d9bfa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:47:22.347791 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a991861-67a6-4fbd-b431-2a5762d9bfa3 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:47:22.424377 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:47:22.426516 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac61f7-502e-463a-9729-1b8656976064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:47:22.427130 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac61f7-502e-463a-9729-1b8656976064 service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:47:22.427598 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac61f7-502e-463a-9729-1b8656976064 service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:47:22.428069 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac61f7-502e-463a-9729-1b8656976064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:47:22.430045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-beac61f7-502e-463a-9729-1b8656976064 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:47:22.537447 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac61f7-502e-463a-9729-1b8656976064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:47:22.538795 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac61f7-502e-463a-9729-1b8656976064 service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:47:22.556816 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 650/1314] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:47:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:47:25.011823 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41129e7-9654-4ec4-abf2-0a59b2ad58a4 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:47:25.012365 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41129e7-9654-4ec4-abf2-0a59b2ad58a4 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:47:25.012365 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41129e7-9654-4ec4-abf2-0a59b2ad58a4 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:47:25.013744 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 665/1315] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:47:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:47:25.018862 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39e5f8-808c-401c-b7f0-2043f6057774 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:47:25.019287 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39e5f8-808c-401c-b7f0-2043f6057774 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:47:25.019421 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39e5f8-808c-401c-b7f0-2043f6057774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:47:25.087215 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-9d39e5f8-808c-401c-b7f0-2043f6057774 None None] MFA Rules not processed for user `593a808ea3dc4b34b162c475e055673b`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:47:25.088547 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-9d39e5f8-808c-401c-b7f0-2043f6057774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:47:25.141451 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:47:25.186259 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 651/1316] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:47:25 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:47:25.474834 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41129e7-9654-4ec4-abf2-0a59b2ad58a4 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:47:25.476407 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-e41129e7-9654-4ec4-abf2-0a59b2ad58a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:47:25.486624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:47:25.579102 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41129e7-9654-4ec4-abf2-0a59b2ad58a4 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:47:25.651470 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bda173-5a5d-4f35-a32f-bdb5d2ee3e5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:47:25.651986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bda173-5a5d-4f35-a32f-bdb5d2ee3e5d service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:47:25.652264 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bda173-5a5d-4f35-a32f-bdb5d2ee3e5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:47:25.652538 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bda173-5a5d-4f35-a32f-bdb5d2ee3e5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:47:25.654289 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-e9bda173-5a5d-4f35-a32f-bdb5d2ee3e5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:47:25.715542 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:47:25.760658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bda173-5a5d-4f35-a32f-bdb5d2ee3e5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:47:25.762118 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bda173-5a5d-4f35-a32f-bdb5d2ee3e5d service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:47:25.780040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 666/1317] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:47:25 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:47:28.428086 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc6fa9-b13e-4326-a480-731b868a2b26 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:47:28.428621 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc6fa9-b13e-4326-a480-731b868a2b26 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:47:28.428621 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc6fa9-b13e-4326-a480-731b868a2b26 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:47:28.430042 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 652/1318] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:47:28.436108 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b67da6-fdf4-463a-861b-175adf6bbf1f None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:47:28.436514 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b67da6-fdf4-463a-861b-175adf6bbf1f None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:47:28.436689 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b67da6-fdf4-463a-861b-175adf6bbf1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:47:28.503084 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-b6b67da6-fdf4-463a-861b-175adf6bbf1f None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:47:28.504294 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-b6b67da6-fdf4-463a-861b-175adf6bbf1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:47:28.598887 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 667/1319] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:47:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:47:28.914376 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc6fa9-b13e-4326-a480-731b868a2b26 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:47:28.915921 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-46fc6fa9-b13e-4326-a480-731b868a2b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:47:29.018105 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc6fa9-b13e-4326-a480-731b868a2b26 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:47:29.092545 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef7878-9798-49ec-8a60-b5df48b7cf56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:47:29.093176 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef7878-9798-49ec-8a60-b5df48b7cf56 service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:47:29.093456 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef7878-9798-49ec-8a60-b5df48b7cf56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:47:29.093728 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef7878-9798-49ec-8a60-b5df48b7cf56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:47:29.095310 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-42ef7878-9798-49ec-8a60-b5df48b7cf56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:47:29.102193 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:47:29.204306 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef7878-9798-49ec-8a60-b5df48b7cf56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:47:29.205770 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef7878-9798-49ec-8a60-b5df48b7cf56 service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:47:29.225119 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 653/1320] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:47:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:47:32.016410 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c76ac3-413a-42ec-9ca1-457d06685102 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:47:32.016942 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c76ac3-413a-42ec-9ca1-457d06685102 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:47:32.016942 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c76ac3-413a-42ec-9ca1-457d06685102 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:47:32.018319 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 668/1321] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:47:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:47:32.023652 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b23ea-26ac-4730-88d3-40a5f48e45fa None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:47:32.024046 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b23ea-26ac-4730-88d3-40a5f48e45fa None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:47:32.024330 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b23ea-26ac-4730-88d3-40a5f48e45fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:47:32.096621 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-a06b23ea-26ac-4730-88d3-40a5f48e45fa None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:47:32.097893 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-a06b23ea-26ac-4730-88d3-40a5f48e45fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:47:32.162306 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:47:32.205244 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 654/1322] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:47:32.502893 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19beedd7-bb84-489a-9701-83d1a09acafc None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:47:32.503196 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19beedd7-bb84-489a-9701-83d1a09acafc None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:47:32.503534 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19beedd7-bb84-489a-9701-83d1a09acafc None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:47:32.504951 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 669/1323] 10.222.0.62 () {54 vars in 964 bytes} [Mon Sep 26 17:47:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:47:32.510975 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46dd9f2-7805-4966-a22b-d7f0a1f022fe None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:47:32.511323 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46dd9f2-7805-4966-a22b-d7f0a1f022fe None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:47:32.511659 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46dd9f2-7805-4966-a22b-d7f0a1f022fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:47:32.588128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-c46dd9f2-7805-4966-a22b-d7f0a1f022fe None None] MFA Rules not processed for user `a0ed50f4edcf468192a053b1e0fd6910`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:47:32.589363 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-c46dd9f2-7805-4966-a22b-d7f0a1f022fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:47:32.670362 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 655/1324] 10.222.0.62 () {58 vars in 1061 bytes} [Mon Sep 26 17:47:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:47:32.679468 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19beedd7-bb84-489a-9701-83d1a09acafc None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:47:32.680999 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-19beedd7-bb84-489a-9701-83d1a09acafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:47:32.702121 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:47:32.785459 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19beedd7-bb84-489a-9701-83d1a09acafc None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:47:32.859216 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed3025-c411-40c9-a323-9d9537e6b78c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:47:32.859859 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed3025-c411-40c9-a323-9d9537e6b78c service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:47:32.860167 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed3025-c411-40c9-a323-9d9537e6b78c service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:47:32.860442 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed3025-c411-40c9-a323-9d9537e6b78c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:47:32.862076 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-44ed3025-c411-40c9-a323-9d9537e6b78c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:47:32.931795 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:47:32.969992 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed3025-c411-40c9-a323-9d9537e6b78c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:47:32.971435 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed3025-c411-40c9-a323-9d9537e6b78c service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:47:32.989778 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 670/1325] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:47:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:47:35.419138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198608ef-7bf3-4a56-bcd6-c58ce6a46b1c None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:47:35.419638 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198608ef-7bf3-4a56-bcd6-c58ce6a46b1c None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:47:35.419638 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198608ef-7bf3-4a56-bcd6-c58ce6a46b1c None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:47:35.420968 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 656/1326] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:47:35.426361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04652ef-8f7a-4d95-a8a2-3103409ebe08 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:47:35.426772 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04652ef-8f7a-4d95-a8a2-3103409ebe08 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:47:35.426908 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04652ef-8f7a-4d95-a8a2-3103409ebe08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:47:35.493717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-b04652ef-8f7a-4d95-a8a2-3103409ebe08 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:47:35.494846 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-b04652ef-8f7a-4d95-a8a2-3103409ebe08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:47:35.590276 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 671/1327] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:47:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:47:35.869864 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198608ef-7bf3-4a56-bcd6-c58ce6a46b1c None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:47:35.871462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-198608ef-7bf3-4a56-bcd6-c58ce6a46b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:47:35.931635 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:47:35.975714 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198608ef-7bf3-4a56-bcd6-c58ce6a46b1c None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:47:36.047995 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580f02b-9203-4c4e-b122-1c3ea90fe775 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:47:36.048592 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580f02b-9203-4c4e-b122-1c3ea90fe775 service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:47:36.048865 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580f02b-9203-4c4e-b122-1c3ea90fe775 service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:47:36.049173 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580f02b-9203-4c4e-b122-1c3ea90fe775 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:47:36.050751 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-a580f02b-9203-4c4e-b122-1c3ea90fe775 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:47:36.159281 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:47:36.161806 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580f02b-9203-4c4e-b122-1c3ea90fe775 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:47:36.163525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580f02b-9203-4c4e-b122-1c3ea90fe775 service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:47:36.182151 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 657/1328] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:47:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:47:38.430461 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d721cb7-6634-4237-aa59-25728140c4cf None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:47:38.430986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d721cb7-6634-4237-aa59-25728140c4cf None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:47:38.430986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d721cb7-6634-4237-aa59-25728140c4cf None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:47:38.432373 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 672/1329] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:47:38.438458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae300ca-7f45-48b6-95b2-2f589b8713f6 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:47:38.438924 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae300ca-7f45-48b6-95b2-2f589b8713f6 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:47:38.439005 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae300ca-7f45-48b6-95b2-2f589b8713f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:47:38.508933 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-3ae300ca-7f45-48b6-95b2-2f589b8713f6 None None] MFA Rules not processed for user `593a808ea3dc4b34b162c475e055673b`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:47:38.510195 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-3ae300ca-7f45-48b6-95b2-2f589b8713f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:47:38.610857 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 658/1330] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:47:38 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:47:38.899137 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d721cb7-6634-4237-aa59-25728140c4cf None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:47:38.900685 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-9d721cb7-6634-4237-aa59-25728140c4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:47:38.932370 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:47:39.004878 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d721cb7-6634-4237-aa59-25728140c4cf None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:47:39.083103 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e1c2d-2387-492e-aad9-28da88ac2071 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:47:39.083713 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e1c2d-2387-492e-aad9-28da88ac2071 service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:47:39.084000 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e1c2d-2387-492e-aad9-28da88ac2071 service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:47:39.084269 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e1c2d-2387-492e-aad9-28da88ac2071 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:47:39.085943 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-2b7e1c2d-2387-492e-aad9-28da88ac2071 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:47:39.169218 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:47:39.202369 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e1c2d-2387-492e-aad9-28da88ac2071 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:47:39.203815 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e1c2d-2387-492e-aad9-28da88ac2071 service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:47:39.222979 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 673/1331] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:47:38 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:47:41.604478 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d59a5-1d31-4481-8525-3c8874eb2cae None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:47:41.605069 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d59a5-1d31-4481-8525-3c8874eb2cae None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:47:41.605069 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d59a5-1d31-4481-8525-3c8874eb2cae None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:47:41.606982 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 659/1332] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:47:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:47:41.612270 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145925c-efcc-4dce-a9dc-b9b31a8b7d74 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:47:41.612645 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145925c-efcc-4dce-a9dc-b9b31a8b7d74 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:47:41.612819 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145925c-efcc-4dce-a9dc-b9b31a8b7d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:47:41.677345 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-4145925c-efcc-4dce-a9dc-b9b31a8b7d74 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:47:41.678543 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-4145925c-efcc-4dce-a9dc-b9b31a8b7d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:47:41.775316 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 674/1333] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:47:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:47:42.090486 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d59a5-1d31-4481-8525-3c8874eb2cae None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:47:42.092019 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-437d59a5-1d31-4481-8525-3c8874eb2cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:47:42.160903 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:47:42.194486 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d59a5-1d31-4481-8525-3c8874eb2cae None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:47:42.267179 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576621f-7ca5-4b88-99c7-4519196c220d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:47:42.267776 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576621f-7ca5-4b88-99c7-4519196c220d service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:47:42.268048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576621f-7ca5-4b88-99c7-4519196c220d service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:47:42.268314 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576621f-7ca5-4b88-99c7-4519196c220d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:47:42.269926 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-c576621f-7ca5-4b88-99c7-4519196c220d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:47:42.384737 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c576621f-7ca5-4b88-99c7-4519196c220d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:47:42.386223 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c576621f-7ca5-4b88-99c7-4519196c220d service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:47:42.396856 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:47:42.405882 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 660/1334] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:47:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:47:44.569789 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683f9da-85a9-4a17-b368-4eaeeb27728a None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:47:44.570322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683f9da-85a9-4a17-b368-4eaeeb27728a None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:47:44.570322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683f9da-85a9-4a17-b368-4eaeeb27728a None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:47:44.571679 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 675/1335] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:47:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:47:44.579847 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165e616-8b9c-45ec-8e8c-c76799ad70c0 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:47:44.580696 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165e616-8b9c-45ec-8e8c-c76799ad70c0 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:47:44.580696 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165e616-8b9c-45ec-8e8c-c76799ad70c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:47:44.645232 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-8165e616-8b9c-45ec-8e8c-c76799ad70c0 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:47:44.646343 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-8165e616-8b9c-45ec-8e8c-c76799ad70c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:47:44.747445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 661/1336] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:47:45.031609 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683f9da-85a9-4a17-b368-4eaeeb27728a None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:47:45.033175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-1683f9da-85a9-4a17-b368-4eaeeb27728a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:47:45.073797 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:47:45.143359 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683f9da-85a9-4a17-b368-4eaeeb27728a None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:47:45.215572 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e406d-9828-471f-a8ec-38dbafb9b191 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:47:45.216173 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e406d-9828-471f-a8ec-38dbafb9b191 service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:47:45.216449 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e406d-9828-471f-a8ec-38dbafb9b191 service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:47:45.216718 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e406d-9828-471f-a8ec-38dbafb9b191 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:47:45.218323 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-ad5e406d-9828-471f-a8ec-38dbafb9b191 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:47:45.299493 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:47:45.325855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e406d-9828-471f-a8ec-38dbafb9b191 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:47:45.327314 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e406d-9828-471f-a8ec-38dbafb9b191 service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:47:45.345573 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 676/1337] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:47:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:47:47.828529 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31ae17-fd5e-4d96-9cbf-41c7add4ccb2 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:47:47.829327 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31ae17-fd5e-4d96-9cbf-41c7add4ccb2 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:47:47.829327 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31ae17-fd5e-4d96-9cbf-41c7add4ccb2 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:47:47.830604 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 662/1338] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:47:47.835767 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b96605-2650-465d-a4b3-644602362150 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:47:47.836184 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b96605-2650-465d-a4b3-644602362150 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:47:47.836312 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b96605-2650-465d-a4b3-644602362150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:47:47.905562 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-b6b96605-2650-465d-a4b3-644602362150 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:47:47.906786 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-b6b96605-2650-465d-a4b3-644602362150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:47:48.002553 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 677/1339] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:47:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:47:48.285569 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a31ae17-fd5e-4d96-9cbf-41c7add4ccb2 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:47:48.287156 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-2a31ae17-fd5e-4d96-9cbf-41c7add4ccb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:47:48.363988 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:47:48.392083 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a31ae17-fd5e-4d96-9cbf-41c7add4ccb2 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:47:48.468763 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa708b7-7940-4180-91d1-9027bd7b9ba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:47:48.469547 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa708b7-7940-4180-91d1-9027bd7b9ba5 service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:47:48.469829 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa708b7-7940-4180-91d1-9027bd7b9ba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:47:48.470101 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa708b7-7940-4180-91d1-9027bd7b9ba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:47:48.471688 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-4aa708b7-7940-4180-91d1-9027bd7b9ba5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:47:48.582051 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa708b7-7940-4180-91d1-9027bd7b9ba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:47:48.583410 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa708b7-7940-4180-91d1-9027bd7b9ba5 service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:47:48.600988 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 663/1340] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:47:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:47:52.669156 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79605b7-9b8d-48c1-92fb-fa20c917e787 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:47:52.669680 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79605b7-9b8d-48c1-92fb-fa20c917e787 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:47:52.669680 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79605b7-9b8d-48c1-92fb-fa20c917e787 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:47:52.670897 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 678/1341] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:47:52.676220 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11672c02-4529-4cfb-82aa-87be88a5fa9c None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:47:52.676664 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11672c02-4529-4cfb-82aa-87be88a5fa9c None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:47:52.676768 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11672c02-4529-4cfb-82aa-87be88a5fa9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:47:52.683654 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:47:52.746423 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-11672c02-4529-4cfb-82aa-87be88a5fa9c None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:47:52.747527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-11672c02-4529-4cfb-82aa-87be88a5fa9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:47:52.851805 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 664/1342] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:47:53.140380 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79605b7-9b8d-48c1-92fb-fa20c917e787 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:47:53.142167 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-b79605b7-9b8d-48c1-92fb-fa20c917e787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:47:53.192936 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:47:53.249194 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79605b7-9b8d-48c1-92fb-fa20c917e787 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:47:53.324688 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b80893-009d-40a3-bdaa-9b3cb6a496f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:47:53.325335 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b80893-009d-40a3-bdaa-9b3cb6a496f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:47:53.325620 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b80893-009d-40a3-bdaa-9b3cb6a496f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:47:53.325893 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b80893-009d-40a3-bdaa-9b3cb6a496f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:47:53.327516 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-78b80893-009d-40a3-bdaa-9b3cb6a496f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:47:53.421410 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:47:53.438132 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b80893-009d-40a3-bdaa-9b3cb6a496f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:47:53.439559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b80893-009d-40a3-bdaa-9b3cb6a496f1 service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:47:53.458811 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 679/1343] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:47:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:47:56.277577 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c8f47-9559-4d05-a4c6-0132d62562e2 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:47:56.278116 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c8f47-9559-4d05-a4c6-0132d62562e2 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:47:56.278116 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c8f47-9559-4d05-a4c6-0132d62562e2 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:47:56.279468 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 665/1344] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:47:56.284590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ba1ba-6393-4d1f-932a-8726dd31655d None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:47:56.285106 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ba1ba-6393-4d1f-932a-8726dd31655d None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:47:56.285244 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ba1ba-6393-4d1f-932a-8726dd31655d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:47:56.355034 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-4a7ba1ba-6393-4d1f-932a-8726dd31655d None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:47:56.356255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-4a7ba1ba-6393-4d1f-932a-8726dd31655d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:47:56.458482 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 680/1345] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:47:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:47:56.742127 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c8f47-9559-4d05-a4c6-0132d62562e2 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:47:56.743648 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-5e2c8f47-9559-4d05-a4c6-0132d62562e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:47:56.837405 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:47:56.855404 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c8f47-9559-4d05-a4c6-0132d62562e2 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:47:56.929530 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1022a6-e786-4178-8c25-8a4729eeffad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:47:56.930169 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1022a6-e786-4178-8c25-8a4729eeffad service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:47:56.930445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1022a6-e786-4178-8c25-8a4729eeffad service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:47:56.930714 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1022a6-e786-4178-8c25-8a4729eeffad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:47:56.932319 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-7a1022a6-e786-4178-8c25-8a4729eeffad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:47:57.042832 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1022a6-e786-4178-8c25-8a4729eeffad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:47:57.044265 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1022a6-e786-4178-8c25-8a4729eeffad service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:47:57.062709 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 666/1346] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:47:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:48:01.323763 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f1376-199e-4438-a274-1addd312fab6 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:01.324264 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f1376-199e-4438-a274-1addd312fab6 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:01.324264 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f1376-199e-4438-a274-1addd312fab6 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:01.325608 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 681/1347] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:48:01.330762 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cd48b-12de-4454-8432-4129277a5883 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:01.331181 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cd48b-12de-4454-8432-4129277a5883 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:01.331303 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cd48b-12de-4454-8432-4129277a5883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:01.348251 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:01.399524 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-d76cd48b-12de-4454-8432-4129277a5883 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:48:01.401241 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-d76cd48b-12de-4454-8432-4129277a5883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:01.497826 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 667/1348] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:48:01.782385 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f1376-199e-4438-a274-1addd312fab6 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:48:01.783920 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-359f1376-199e-4438-a274-1addd312fab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:01.843618 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:01.903081 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f1376-199e-4438-a274-1addd312fab6 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:48:01.989924 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d79312-72da-4864-9876-3a74e855b56d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:48:01.990951 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d79312-72da-4864-9876-3a74e855b56d service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:01.991435 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d79312-72da-4864-9876-3a74e855b56d service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:01.991917 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d79312-72da-4864-9876-3a74e855b56d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:01.995090 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-74d79312-72da-4864-9876-3a74e855b56d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:02.130196 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:02.137119 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d79312-72da-4864-9876-3a74e855b56d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:48:02.139284 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d79312-72da-4864-9876-3a74e855b56d service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:48:02.161538 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 682/1349] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:48:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:48:07.019050 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07714cf6-662c-4512-898f-98803ca816aa None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:07.019897 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07714cf6-662c-4512-898f-98803ca816aa None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:07.020369 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07714cf6-662c-4512-898f-98803ca816aa None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:07.023826 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 668/1350] 10.222.0.62 () {54 vars in 921 bytes} [Mon Sep 26 17:48:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:48:07.030042 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e285c-92f7-4cd5-9745-e699de0248ca None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:07.030042 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e285c-92f7-4cd5-9745-e699de0248ca None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:07.030593 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e285c-92f7-4cd5-9745-e699de0248ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:07.127589 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-878e285c-92f7-4cd5-9745-e699de0248ca None None] MFA Rules not processed for user `f5043d835c08458c9f3911a4741bdaa8`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:48:07.129149 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-878e285c-92f7-4cd5-9745-e699de0248ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:07.342708 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 683/1351] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Sep 26 17:48:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:48:11.489337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1ab68-b5f9-427c-9faa-38e0a3c5d6f9 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:11.489932 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1ab68-b5f9-427c-9faa-38e0a3c5d6f9 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:11.489932 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1ab68-b5f9-427c-9faa-38e0a3c5d6f9 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:11.491509 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 669/1352] 10.222.0.62 () {54 vars in 921 bytes} [Mon Sep 26 17:48:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:48:11.497471 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=59 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:11.499538 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf1097-fbb2-47e1-9e71-433108355c91 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:11.499994 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf1097-fbb2-47e1-9e71-433108355c91 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:11.500291 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf1097-fbb2-47e1-9e71-433108355c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:11.555301 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:11.581706 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-95bf1097-fbb2-47e1-9e71-433108355c91 None None] MFA Rules not processed for user `f5043d835c08458c9f3911a4741bdaa8`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:48:11.583054 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-95bf1097-fbb2-47e1-9e71-433108355c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:11.693041 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 684/1353] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Sep 26 17:48:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:48:13.199680 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43494320-a9c5-43ed-b81d-363bc146cb6b None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:13.200488 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43494320-a9c5-43ed-b81d-363bc146cb6b None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:13.200639 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43494320-a9c5-43ed-b81d-363bc146cb6b None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:13.202625 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 670/1354] 10.222.0.62 () {54 vars in 921 bytes} [Mon Sep 26 17:48:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:48:13.207405 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ae6b6-349b-45f8-830d-983d4e40c343 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:13.207859 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ae6b6-349b-45f8-830d-983d4e40c343 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:13.207943 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ae6b6-349b-45f8-830d-983d4e40c343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:13.285044 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-ca6ae6b6-349b-45f8-830d-983d4e40c343 None None] MFA Rules not processed for user `f5043d835c08458c9f3911a4741bdaa8`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:48:13.286289 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-ca6ae6b6-349b-45f8-830d-983d4e40c343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:13.328773 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:13.405699 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 685/1355] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Sep 26 17:48:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:48:16.887905 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154bb05-a91d-47de-b5b5-d5363ae03d05 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:16.888434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154bb05-a91d-47de-b5b5-d5363ae03d05 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:16.888434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154bb05-a91d-47de-b5b5-d5363ae03d05 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:16.889811 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 671/1356] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:48:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:48:16.895388 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f01b1-f729-475c-936c-a23d7ea87d84 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:16.895883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f01b1-f729-475c-936c-a23d7ea87d84 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:16.896209 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f01b1-f729-475c-936c-a23d7ea87d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:16.971364 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-586f01b1-f729-475c-936c-a23d7ea87d84 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:48:16.972619 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-586f01b1-f729-475c-936c-a23d7ea87d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:17.073580 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 686/1357] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:48:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:48:17.372482 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd960f-9277-4b4f-b472-2bc794610bc4 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:17.372873 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd960f-9277-4b4f-b472-2bc794610bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:17.373265 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd960f-9277-4b4f-b472-2bc794610bc4 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:17.374707 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 672/1358] 10.222.0.62 () {54 vars in 961 bytes} [Mon Sep 26 17:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 17:48:17.391546 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8b4db-8c1f-45e4-8c00-e0e0bea35eca None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:17.391832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8b4db-8c1f-45e4-8c00-e0e0bea35eca None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:17.392106 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8b4db-8c1f-45e4-8c00-e0e0bea35eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:17.416299 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:17.481952 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-adb8b4db-8c1f-45e4-8c00-e0e0bea35eca None None] MFA Rules not processed for user `1792e79b9c9a47e1923f19bfd2cd495b`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:48:17.483551 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-adb8b4db-8c1f-45e4-8c00-e0e0bea35eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:17.613307 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 687/1359] 10.222.0.62 () {58 vars in 1058 bytes} [Mon Sep 26 17:48:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:48:17.620654 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd960f-9277-4b4f-b472-2bc794610bc4 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:48:17.622361 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-d8cd960f-9277-4b4f-b472-2bc794610bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:17.788537 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd960f-9277-4b4f-b472-2bc794610bc4 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:48:17.866128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:17.910440 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01f320-03cf-41d3-b670-843f53a683ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:48:17.911186 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01f320-03cf-41d3-b670-843f53a683ac service nova] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:17.911413 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01f320-03cf-41d3-b670-843f53a683ac service nova] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:17.911688 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01f320-03cf-41d3-b670-843f53a683ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:17.913344 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-7f01f320-03cf-41d3-b670-843f53a683ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:18.012757 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01f320-03cf-41d3-b670-843f53a683ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:48:18.014553 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01f320-03cf-41d3-b670-843f53a683ac service nova] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:48:18.035228 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 673/1360] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:48:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:48:20.468400 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae246d-a606-4450-bafd-42c287236a34 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:20.468400 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae246d-a606-4450-bafd-42c287236a34 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:20.468400 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae246d-a606-4450-bafd-42c287236a34 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:20.468400 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 688/1361] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:48:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:48:20.473954 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3300d85-0838-4c65-b76a-362c8cc39ec0 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:20.473954 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3300d85-0838-4c65-b76a-362c8cc39ec0 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:20.474750 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3300d85-0838-4c65-b76a-362c8cc39ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:20.549573 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-c3300d85-0838-4c65-b76a-362c8cc39ec0 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:48:20.550823 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-c3300d85-0838-4c65-b76a-362c8cc39ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:20.596183 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:20.656874 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 674/1362] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:48:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:48:20.944303 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae246d-a606-4450-bafd-42c287236a34 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:48:20.946417 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-13ae246d-a606-4450-bafd-42c287236a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:21.023308 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:21.131493 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae246d-a606-4450-bafd-42c287236a34 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:48:21.257469 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655dadc7-0d8b-4ccf-8d6c-95a93161c048 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:48:21.258083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dadc7-0d8b-4ccf-8d6c-95a93161c048 service nova] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:21.258362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dadc7-0d8b-4ccf-8d6c-95a93161c048 service nova] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:21.259632 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dadc7-0d8b-4ccf-8d6c-95a93161c048 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:21.261255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-655dadc7-0d8b-4ccf-8d6c-95a93161c048 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:21.284815 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:21.358483 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655dadc7-0d8b-4ccf-8d6c-95a93161c048 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:48:21.360095 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655dadc7-0d8b-4ccf-8d6c-95a93161c048 service nova] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:48:21.379599 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 689/1363] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:48:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:48:23.881428 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93be462-37d5-4519-9764-9546995698d7 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:23.881886 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93be462-37d5-4519-9764-9546995698d7 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:23.881969 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93be462-37d5-4519-9764-9546995698d7 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:23.885212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 675/1364] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:48:23.889629 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d70cd-158b-479a-952a-08d4442663b1 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:23.890073 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d70cd-158b-479a-952a-08d4442663b1 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:23.890168 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d70cd-158b-479a-952a-08d4442663b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:23.959007 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-bc3d70cd-158b-479a-952a-08d4442663b1 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:48:23.960124 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-bc3d70cd-158b-479a-952a-08d4442663b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:24.065309 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:24.072765 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 690/1365] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:48:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:48:24.359526 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb93af6-8e17-430f-9607-2e1f61b0b951 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:24.359879 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb93af6-8e17-430f-9607-2e1f61b0b951 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:24.360219 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb93af6-8e17-430f-9607-2e1f61b0b951 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:24.362119 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 676/1366] 10.222.0.62 () {54 vars in 961 bytes} [Mon Sep 26 17:48:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:48:24.368307 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18ec84-4e37-435f-b324-709a6c13ab67 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:24.368649 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18ec84-4e37-435f-b324-709a6c13ab67 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:24.368978 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18ec84-4e37-435f-b324-709a6c13ab67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:24.461494 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-8b18ec84-4e37-435f-b324-709a6c13ab67 None None] MFA Rules not processed for user `1792e79b9c9a47e1923f19bfd2cd495b`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:48:24.463460 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-8b18ec84-4e37-435f-b324-709a6c13ab67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:24.593470 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 691/1367] 10.222.0.62 () {58 vars in 1058 bytes} [Mon Sep 26 17:48:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:48:24.601484 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb93af6-8e17-430f-9607-2e1f61b0b951 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:48:24.603060 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-efb93af6-8e17-430f-9607-2e1f61b0b951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:24.762308 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb93af6-8e17-430f-9607-2e1f61b0b951 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:48:24.786531 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:24.891395 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250c693-631a-4bec-972a-fb9b3d06517c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:48:24.892043 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250c693-631a-4bec-972a-fb9b3d06517c service nova] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:24.892303 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250c693-631a-4bec-972a-fb9b3d06517c service nova] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:24.892423 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250c693-631a-4bec-972a-fb9b3d06517c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:24.894195 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-7250c693-631a-4bec-972a-fb9b3d06517c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:24.994432 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250c693-631a-4bec-972a-fb9b3d06517c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:48:24.996039 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250c693-631a-4bec-972a-fb9b3d06517c service nova] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:48:25.015949 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 677/1368] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:48:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 17:48:25.192125 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f695f9-1554-449c-9ac1-45ad0dc1d474 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:25.192769 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f695f9-1554-449c-9ac1-45ad0dc1d474 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:25.192769 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f695f9-1554-449c-9ac1-45ad0dc1d474 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:25.194520 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 692/1369] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:48:25.200924 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bf717-f4ae-4cd1-aa4d-573e2272150c None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:25.201234 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bf717-f4ae-4cd1-aa4d-573e2272150c None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:25.201494 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bf717-f4ae-4cd1-aa4d-573e2272150c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:25.241815 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:25.286951 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-b98bf717-f4ae-4cd1-aa4d-573e2272150c None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:48:25.288177 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-b98bf717-f4ae-4cd1-aa4d-573e2272150c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:25.423524 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 678/1370] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:48:25.779975 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0a5e5-d17d-4b5e-8f1a-e39b1086321a None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:25.780264 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0a5e5-d17d-4b5e-8f1a-e39b1086321a None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:25.780533 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0a5e5-d17d-4b5e-8f1a-e39b1086321a None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:25.782157 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 693/1371] 10.222.0.62 () {54 vars in 963 bytes} [Mon Sep 26 17:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:48:25.787272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd45284-d764-42aa-b921-dcbb9aa8d919 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:25.787668 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd45284-d764-42aa-b921-dcbb9aa8d919 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:25.788039 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd45284-d764-42aa-b921-dcbb9aa8d919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:25.871152 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-4fd45284-d764-42aa-b921-dcbb9aa8d919 None None] MFA Rules not processed for user `14b32df88c21499d9ca81e439b129431`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:48:25.872548 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-4fd45284-d764-42aa-b921-dcbb9aa8d919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:25.922465 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:25.954644 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 679/1372] 10.222.0.62 () {58 vars in 1060 bytes} [Mon Sep 26 17:48:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:48:25.964870 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0a5e5-d17d-4b5e-8f1a-e39b1086321a None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:48:25.967058 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-bbe0a5e5-d17d-4b5e-8f1a-e39b1086321a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:26.042148 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:26.113430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0a5e5-d17d-4b5e-8f1a-e39b1086321a None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:48:26.193488 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84482c92-7f8c-49b0-a867-bd846d27de6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:48:26.194135 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84482c92-7f8c-49b0-a867-bd846d27de6c service cinder] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:26.194843 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84482c92-7f8c-49b0-a867-bd846d27de6c service cinder] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:26.194843 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84482c92-7f8c-49b0-a867-bd846d27de6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:26.196701 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-84482c92-7f8c-49b0-a867-bd846d27de6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:26.301711 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:26.318562 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84482c92-7f8c-49b0-a867-bd846d27de6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:48:26.319884 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84482c92-7f8c-49b0-a867-bd846d27de6c service cinder] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:48:26.340180 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 694/1373] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:48:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:48:27.304153 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2986ec6-43c0-4038-8cc9-2c0c532def95 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:27.304685 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2986ec6-43c0-4038-8cc9-2c0c532def95 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:27.304685 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2986ec6-43c0-4038-8cc9-2c0c532def95 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:27.306517 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 680/1374] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:48:27.311785 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28c925-5c02-42c0-90f6-72b047c1572f None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:27.312210 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28c925-5c02-42c0-90f6-72b047c1572f None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:27.312440 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28c925-5c02-42c0-90f6-72b047c1572f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:27.382190 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-1c28c925-5c02-42c0-90f6-72b047c1572f None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:48:27.383458 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-1c28c925-5c02-42c0-90f6-72b047c1572f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:27.480540 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 695/1375] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:48:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:48:27.775781 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2986ec6-43c0-4038-8cc9-2c0c532def95 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:48:27.777334 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-d2986ec6-43c0-4038-8cc9-2c0c532def95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:27.944372 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2986ec6-43c0-4038-8cc9-2c0c532def95 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:48:27.999216 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:28.064705 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f10025-6798-4c97-8121-d907037619fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:48:28.065512 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f10025-6798-4c97-8121-d907037619fd service nova] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:28.065955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f10025-6798-4c97-8121-d907037619fd service nova] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:28.066469 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f10025-6798-4c97-8121-d907037619fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:28.068941 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-69f10025-6798-4c97-8121-d907037619fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:28.167390 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f10025-6798-4c97-8121-d907037619fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:48:28.169880 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f10025-6798-4c97-8121-d907037619fd service nova] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:48:28.190361 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 681/1376] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:48:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:48:30.410662 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4e4b1-b8df-4e57-8644-1f640da4c672 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:30.411177 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4e4b1-b8df-4e57-8644-1f640da4c672 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:30.411607 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4e4b1-b8df-4e57-8644-1f640da4c672 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:30.413214 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 696/1377] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:48:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:48:30.418484 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f70fbc-7d54-40f2-87ba-47cac6dc3bab None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:30.418911 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f70fbc-7d54-40f2-87ba-47cac6dc3bab None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:30.419081 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f70fbc-7d54-40f2-87ba-47cac6dc3bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:30.487306 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-15f70fbc-7d54-40f2-87ba-47cac6dc3bab None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:48:30.488485 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-15f70fbc-7d54-40f2-87ba-47cac6dc3bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:30.496219 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:30.596237 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 682/1378] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:48:30.884886 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4e4b1-b8df-4e57-8644-1f640da4c672 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:48:30.886552 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-03f4e4b1-b8df-4e57-8644-1f640da4c672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:30.952060 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:31.045242 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4e4b1-b8df-4e57-8644-1f640da4c672 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:48:31.166149 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5903da-c384-4afc-a00f-a6f4ad1e421c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:48:31.166820 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5903da-c384-4afc-a00f-a6f4ad1e421c service nova] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:31.167201 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5903da-c384-4afc-a00f-a6f4ad1e421c service nova] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:31.167574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5903da-c384-4afc-a00f-a6f4ad1e421c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:31.169313 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-dd5903da-c384-4afc-a00f-a6f4ad1e421c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:31.189028 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:31.266964 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5903da-c384-4afc-a00f-a6f4ad1e421c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:48:31.269779 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5903da-c384-4afc-a00f-a6f4ad1e421c service nova] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:48:31.297762 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 697/1379] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:48:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:48:33.578991 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b627b-a407-443f-8a08-03b79a06f6b7 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:33.579435 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b627b-a407-443f-8a08-03b79a06f6b7 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:33.579529 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b627b-a407-443f-8a08-03b79a06f6b7 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:33.583253 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 683/1380] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:48:33.586492 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f2d23-0989-405b-889f-280e86d95e5d None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:33.586916 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f2d23-0989-405b-889f-280e86d95e5d None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:33.587109 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f2d23-0989-405b-889f-280e86d95e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:33.657137 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-3a8f2d23-0989-405b-889f-280e86d95e5d None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:48:33.658379 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-3a8f2d23-0989-405b-889f-280e86d95e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:33.784784 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:33.792255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 698/1381] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:48:34.090079 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b627b-a407-443f-8a08-03b79a06f6b7 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:48:34.091726 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-6d3b627b-a407-443f-8a08-03b79a06f6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:34.248242 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:34.259776 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b627b-a407-443f-8a08-03b79a06f6b7 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:48:34.389565 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756ae13-fac8-497c-a4b0-0998a1638f88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:48:34.390174 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756ae13-fac8-497c-a4b0-0998a1638f88 service nova] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:34.390613 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756ae13-fac8-497c-a4b0-0998a1638f88 service nova] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:34.390613 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756ae13-fac8-497c-a4b0-0998a1638f88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:34.392252 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-3756ae13-fac8-497c-a4b0-0998a1638f88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:34.486763 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3756ae13-fac8-497c-a4b0-0998a1638f88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:48:34.488363 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3756ae13-fac8-497c-a4b0-0998a1638f88 service nova] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:48:34.498456 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:34.507120 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 684/1382] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:48:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 17:48:36.705186 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f8cd3-9974-4201-ab32-27350de4038d None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:36.705885 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f8cd3-9974-4201-ab32-27350de4038d None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:36.705885 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f8cd3-9974-4201-ab32-27350de4038d None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:36.706941 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 699/1383] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:48:36.712181 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e40a3f-710a-481f-8e9d-13a4ef5ef652 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:36.712606 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e40a3f-710a-481f-8e9d-13a4ef5ef652 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:36.712704 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e40a3f-710a-481f-8e9d-13a4ef5ef652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:36.782876 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-b3e40a3f-710a-481f-8e9d-13a4ef5ef652 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:48:36.784345 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-b3e40a3f-710a-481f-8e9d-13a4ef5ef652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:36.880997 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 685/1384] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:48:37.165666 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f8cd3-9974-4201-ab32-27350de4038d None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:48:37.167830 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-8c4f8cd3-9974-4201-ab32-27350de4038d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:37.331661 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f8cd3-9974-4201-ab32-27350de4038d None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:48:37.405938 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:37.454612 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581b225-dca9-4a31-9df8-f4473ba99faf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:48:37.455250 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581b225-dca9-4a31-9df8-f4473ba99faf service nova] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:37.455536 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581b225-dca9-4a31-9df8-f4473ba99faf service nova] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:37.455810 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581b225-dca9-4a31-9df8-f4473ba99faf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:37.457563 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-c581b225-dca9-4a31-9df8-f4473ba99faf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:37.568129 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581b225-dca9-4a31-9df8-f4473ba99faf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:48:37.570707 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581b225-dca9-4a31-9df8-f4473ba99faf service nova] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:48:37.591252 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 700/1385] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:48:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:48:39.750208 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47da01-dd0a-4155-8d36-dca804bd8e47 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:39.750747 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47da01-dd0a-4155-8d36-dca804bd8e47 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:39.750747 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47da01-dd0a-4155-8d36-dca804bd8e47 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:39.752107 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 686/1386] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:48:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:48:39.757896 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c6437-9353-48a5-b534-382aa3054cbe None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:39.758329 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c6437-9353-48a5-b534-382aa3054cbe None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:39.758446 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c6437-9353-48a5-b534-382aa3054cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:39.824665 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-ee8c6437-9353-48a5-b534-382aa3054cbe None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:48:39.825907 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-ee8c6437-9353-48a5-b534-382aa3054cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:39.859185 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:39.923173 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 701/1387] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:48:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:48:40.213237 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47da01-dd0a-4155-8d36-dca804bd8e47 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:48:40.217319 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-5b47da01-dd0a-4155-8d36-dca804bd8e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:40.295878 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:40.368034 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47da01-dd0a-4155-8d36-dca804bd8e47 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:48:40.482801 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be6eb2-797b-4c05-a7af-47780b97b3a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:48:40.483396 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be6eb2-797b-4c05-a7af-47780b97b3a0 service nova] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:40.483669 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be6eb2-797b-4c05-a7af-47780b97b3a0 service nova] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:40.483937 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be6eb2-797b-4c05-a7af-47780b97b3a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:40.485546 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-99be6eb2-797b-4c05-a7af-47780b97b3a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:40.524870 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:40.577767 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be6eb2-797b-4c05-a7af-47780b97b3a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:48:40.579324 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be6eb2-797b-4c05-a7af-47780b97b3a0 service nova] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:48:40.597703 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 687/1388] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:48:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:48:41.588366 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619b3c6-d879-4384-9766-2a424070e7f7 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:41.588963 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619b3c6-d879-4384-9766-2a424070e7f7 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:41.588963 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619b3c6-d879-4384-9766-2a424070e7f7 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:41.590274 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 702/1389] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:48:41.595512 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0e63a-0b3c-4aec-a6c0-9eeaca544702 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:41.595981 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0e63a-0b3c-4aec-a6c0-9eeaca544702 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:41.596151 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0e63a-0b3c-4aec-a6c0-9eeaca544702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:41.661976 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-71c0e63a-0b3c-4aec-a6c0-9eeaca544702 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:48:41.663697 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-71c0e63a-0b3c-4aec-a6c0-9eeaca544702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:41.761653 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 688/1390] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:48:42.063182 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ff278-d496-4d62-b1c9-69c7dc077b62 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:42.063530 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ff278-d496-4d62-b1c9-69c7dc077b62 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:42.063884 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ff278-d496-4d62-b1c9-69c7dc077b62 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:42.065347 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 703/1391] 10.222.0.62 () {54 vars in 962 bytes} [Mon Sep 26 17:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:48:42.070922 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bcb70-d38b-4aaf-9316-b475f5208809 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:42.071207 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bcb70-d38b-4aaf-9316-b475f5208809 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:42.071477 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bcb70-d38b-4aaf-9316-b475f5208809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:42.088184 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:42.151570 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-9e6bcb70-d38b-4aaf-9316-b475f5208809 None None] MFA Rules not processed for user `ab3b7ac09599477bb0c6c1d32e2d5dbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:48:42.153084 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-9e6bcb70-d38b-4aaf-9316-b475f5208809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:42.231558 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 689/1392] 10.222.0.62 () {58 vars in 1059 bytes} [Mon Sep 26 17:48:42 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:48:42.240726 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ff278-d496-4d62-b1c9-69c7dc077b62 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:48:42.242862 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-084ff278-d496-4d62-b1c9-69c7dc077b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:42.348544 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ff278-d496-4d62-b1c9-69c7dc077b62 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:48:42.411373 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:42.427824 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc568a-0108-4233-9e34-664f9e6b3618 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab3b7ac09599477bb0c6c1d32e2d5dbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:48:42.428433 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc568a-0108-4233-9e34-664f9e6b3618 service glance] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:42.428706 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc568a-0108-4233-9e34-664f9e6b3618 service glance] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:42.429258 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc568a-0108-4233-9e34-664f9e6b3618 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:42.430840 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-f5dc568a-0108-4233-9e34-664f9e6b3618 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:42.543555 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc568a-0108-4233-9e34-664f9e6b3618 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:48:42.544989 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc568a-0108-4233-9e34-664f9e6b3618 service glance] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:48:42.563403 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 704/1393] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:48:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:48:42.807780 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca7a31-2cbc-4713-825a-5b8236b371cc None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:42.808416 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca7a31-2cbc-4713-825a-5b8236b371cc None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:42.808416 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca7a31-2cbc-4713-825a-5b8236b371cc None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:42.809945 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 690/1394] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:48:42.815764 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfcc92a-c79d-4e66-baf7-12259479dd66 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:42.816383 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfcc92a-c79d-4e66-baf7-12259479dd66 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:42.816383 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfcc92a-c79d-4e66-baf7-12259479dd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:42.888192 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-6cfcc92a-c79d-4e66-baf7-12259479dd66 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:48:42.889489 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-6cfcc92a-c79d-4e66-baf7-12259479dd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:42.945261 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:43.011097 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 705/1395] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:48:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:48:43.300883 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24210c0-b5d2-4890-b419-198d98fc7921 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:43.301195 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24210c0-b5d2-4890-b419-198d98fc7921 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:43.301466 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24210c0-b5d2-4890-b419-198d98fc7921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:43.302347 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfcc92a-c79d-4e66-baf7-12259479dd66 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:48:43.303593 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-6cfcc92a-c79d-4e66-baf7-12259479dd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:43.371105 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-b24210c0-b5d2-4890-b419-198d98fc7921 None None] MFA Rules not processed for user `8475122232ef4d8893f2a9b98768396e`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:48:43.372451 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-b24210c0-b5d2-4890-b419-198d98fc7921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:43.422831 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfcc92a-c79d-4e66-baf7-12259479dd66 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:48:43.430913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:43.462161 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 691/1396] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Sep 26 17:48:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:48:43.495433 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:43.510408 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76000fed-de7e-4037-b303-5b5a11be2955 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:43.510687 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76000fed-de7e-4037-b303-5b5a11be2955 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:43.510953 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76000fed-de7e-4037-b303-5b5a11be2955 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:43.512301 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 692/1397] 10.222.0.62 () {54 vars in 943 bytes} [Mon Sep 26 17:48:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 17:48:43.518872 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea8c03-a80d-4058-bd91-c100146847bc None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:43.519245 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea8c03-a80d-4058-bd91-c100146847bc None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:43.519589 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea8c03-a80d-4058-bd91-c100146847bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:43.557778 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf76b87-26cc-411c-8fd5-8940d6835667 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:48:43.558307 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf76b87-26cc-411c-8fd5-8940d6835667 service nova] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:43.558583 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf76b87-26cc-411c-8fd5-8940d6835667 service nova] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:43.558856 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf76b87-26cc-411c-8fd5-8940d6835667 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:43.560449 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-9cf76b87-26cc-411c-8fd5-8940d6835667 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:43.596159 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-3dea8c03-a80d-4058-bd91-c100146847bc None None] MFA Rules not processed for user `ea49cd9839474232a0cbe66ccffbf082`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:48:43.597394 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-3dea8c03-a80d-4058-bd91-c100146847bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:43.649708 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf76b87-26cc-411c-8fd5-8940d6835667 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:48:43.651333 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf76b87-26cc-411c-8fd5-8940d6835667 service nova] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:48:43.669784 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 706/1398] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:48:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:48:43.708311 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 693/1399] 10.222.0.62 () {58 vars in 1040 bytes} [Mon Sep 26 17:48:43 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:48:43.718812 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf76b87-26cc-411c-8fd5-8940d6835667 service nova] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:48:43.720190 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-9cf76b87-26cc-411c-8fd5-8940d6835667 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:43.789714 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:43.819728 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf76b87-26cc-411c-8fd5-8940d6835667 service nova] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:48:43.935419 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ce07a-2109-4ff7-b18e-8b7c3323cc64 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea49cd9839474232a0cbe66ccffbf082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:48:43.936028 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ce07a-2109-4ff7-b18e-8b7c3323cc64 service swift] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:43.936376 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ce07a-2109-4ff7-b18e-8b7c3323cc64 service swift] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:43.936562 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ce07a-2109-4ff7-b18e-8b7c3323cc64 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:43.938212 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-422ce07a-2109-4ff7-b18e-8b7c3323cc64 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:44.022495 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ce07a-2109-4ff7-b18e-8b7c3323cc64 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:48:44.024129 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ce07a-2109-4ff7-b18e-8b7c3323cc64 service swift] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:48:44.032487 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 707/1400] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Sep 26 17:48:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 17:48:45.879459 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e07ce9-8d81-4be1-ad61-5e82e159f3ae None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:45.880007 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e07ce9-8d81-4be1-ad61-5e82e159f3ae None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:45.880007 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e07ce9-8d81-4be1-ad61-5e82e159f3ae None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:45.882263 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 694/1401] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:48:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:48:45.889304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65abaf2-d681-4bc8-8d40-7787f5f99172 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:45.890074 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65abaf2-d681-4bc8-8d40-7787f5f99172 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:45.890233 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65abaf2-d681-4bc8-8d40-7787f5f99172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:45.907060 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:45.966721 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-c65abaf2-d681-4bc8-8d40-7787f5f99172 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:48:45.968049 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-c65abaf2-d681-4bc8-8d40-7787f5f99172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:46.132226 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 708/1402] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:48:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:48:46.417151 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e07ce9-8d81-4be1-ad61-5e82e159f3ae None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:48:46.418676 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-66e07ce9-8d81-4be1-ad61-5e82e159f3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:46.453207 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:46.589463 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e07ce9-8d81-4be1-ad61-5e82e159f3ae None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:48:46.707529 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:46.720934 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf954c6-6573-439f-9a88-1c24f557a0cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:48:46.721580 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf954c6-6573-439f-9a88-1c24f557a0cf service nova] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:46.721856 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf954c6-6573-439f-9a88-1c24f557a0cf service nova] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:46.722128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf954c6-6573-439f-9a88-1c24f557a0cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:46.723725 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-ebf954c6-6573-439f-9a88-1c24f557a0cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:46.825584 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf954c6-6573-439f-9a88-1c24f557a0cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:48:46.827212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf954c6-6573-439f-9a88-1c24f557a0cf service nova] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:48:46.846415 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 695/1403] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:48:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:48:49.055773 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143c8eb-fc05-48d2-aeea-6957ab5e80c0 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:49.056302 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143c8eb-fc05-48d2-aeea-6957ab5e80c0 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:49.056302 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143c8eb-fc05-48d2-aeea-6957ab5e80c0 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:49.061055 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 709/1404] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:48:49.063080 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17477f5a-83c2-47e0-ba5d-0bb924ca8354 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:49.063489 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17477f5a-83c2-47e0-ba5d-0bb924ca8354 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:49.063626 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17477f5a-83c2-47e0-ba5d-0bb924ca8354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:49.138451 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-17477f5a-83c2-47e0-ba5d-0bb924ca8354 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:48:49.139789 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-17477f5a-83c2-47e0-ba5d-0bb924ca8354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:49.212935 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:49.254887 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 696/1405] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:48:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:48:49.550317 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143c8eb-fc05-48d2-aeea-6957ab5e80c0 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:48:49.552111 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-b143c8eb-fc05-48d2-aeea-6957ab5e80c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:49.649935 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:49.713374 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143c8eb-fc05-48d2-aeea-6957ab5e80c0 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:48:49.838665 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8145cfa4-9c97-44c4-91ce-5a0d060b9e37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:48:49.839286 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145cfa4-9c97-44c4-91ce-5a0d060b9e37 service nova] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:49.839567 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145cfa4-9c97-44c4-91ce-5a0d060b9e37 service nova] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:49.839841 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145cfa4-9c97-44c4-91ce-5a0d060b9e37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:49.841521 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-8145cfa4-9c97-44c4-91ce-5a0d060b9e37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:49.900785 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:49.942957 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8145cfa4-9c97-44c4-91ce-5a0d060b9e37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:48:49.945231 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8145cfa4-9c97-44c4-91ce-5a0d060b9e37 service nova] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:48:49.974570 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 710/1406] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:48:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:48:52.212732 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ac2dc-4021-4558-a29d-f3137c7199ed None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:52.213332 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ac2dc-4021-4558-a29d-f3137c7199ed None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:52.213332 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ac2dc-4021-4558-a29d-f3137c7199ed None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:52.214665 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 697/1407] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:48:52.221992 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0024d-053f-428c-befe-048dcca57862 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:52.223027 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0024d-053f-428c-befe-048dcca57862 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:52.223373 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0024d-053f-428c-befe-048dcca57862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:52.300703 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-ade0024d-053f-428c-befe-048dcca57862 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:48:52.302019 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-ade0024d-053f-428c-befe-048dcca57862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:52.417897 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 711/1408] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:48:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:48:52.714758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ac2dc-4021-4558-a29d-f3137c7199ed None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:48:52.716287 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-4f3ac2dc-4021-4558-a29d-f3137c7199ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:52.878388 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ac2dc-4021-4558-a29d-f3137c7199ed None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:48:52.937928 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:48:53.012551 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e8d16-cbc4-4fb4-9442-c6305174eaeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:48:53.013101 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e8d16-cbc4-4fb4-9442-c6305174eaeb service nova] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:48:53.013382 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e8d16-cbc4-4fb4-9442-c6305174eaeb service nova] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:48:53.013655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e8d16-cbc4-4fb4-9442-c6305174eaeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:48:53.015248 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-b00e8d16-cbc4-4fb4-9442-c6305174eaeb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:48:53.122791 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e8d16-cbc4-4fb4-9442-c6305174eaeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:48:53.124427 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e8d16-cbc4-4fb4-9442-c6305174eaeb service nova] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:48:53.142802 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 698/1409] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:48:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:49:02.416276 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=87 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:03.140120 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=76 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:06.831417 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd528ed-df62-4b62-960e-58add5c8ed41 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:06.831994 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd528ed-df62-4b62-960e-58add5c8ed41 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:06.831994 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd528ed-df62-4b62-960e-58add5c8ed41 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:06.833345 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 712/1410] 10.222.0.62 () {54 vars in 918 bytes} [Mon Sep 26 17:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:49:06.838412 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ef9e5-e06f-46b0-9bab-5e35f8b8531b None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:06.838828 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ef9e5-e06f-46b0-9bab-5e35f8b8531b None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:06.838955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ef9e5-e06f-46b0-9bab-5e35f8b8531b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:06.915334 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-c34ef9e5-e06f-46b0-9bab-5e35f8b8531b None None] MFA Rules not processed for user `f5043d835c08458c9f3911a4741bdaa8`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:49:06.916544 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-c34ef9e5-e06f-46b0-9bab-5e35f8b8531b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:07.024319 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 699/1411] 10.222.0.62 () {58 vars in 1015 bytes} [Mon Sep 26 17:49:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:49:07.039006 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf657da-121a-4073-a280-43643e00afff None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:07.039288 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf657da-121a-4073-a280-43643e00afff None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:07.039562 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf657da-121a-4073-a280-43643e00afff None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:07.040902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 713/1412] 10.222.0.62 () {54 vars in 918 bytes} [Mon Sep 26 17:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:49:07.046478 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248182d1-bf0b-4805-b8a3-6c30592ee76c None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:07.046771 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248182d1-bf0b-4805-b8a3-6c30592ee76c None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:07.047050 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248182d1-bf0b-4805-b8a3-6c30592ee76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:07.120928 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:07.124219 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-248182d1-bf0b-4805-b8a3-6c30592ee76c None None] MFA Rules not processed for user `1792e79b9c9a47e1923f19bfd2cd495b`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:49:07.125942 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-248182d1-bf0b-4805-b8a3-6c30592ee76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:07.243596 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 700/1413] 10.222.0.62 () {58 vars in 1015 bytes} [Mon Sep 26 17:49:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:49:09.823115 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36ce80-d9e3-403d-ac92-433f4fce7525 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:09.823715 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36ce80-d9e3-403d-ac92-433f4fce7525 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:09.823715 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36ce80-d9e3-403d-ac92-433f4fce7525 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:09.824997 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 714/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 17:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:49:09.830793 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48e446-1988-439f-8bf8-6da5286e61a3 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:09.831201 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48e446-1988-439f-8bf8-6da5286e61a3 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:09.831338 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48e446-1988-439f-8bf8-6da5286e61a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:09.899349 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-bf48e446-1988-439f-8bf8-6da5286e61a3 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:49:09.900631 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-bf48e446-1988-439f-8bf8-6da5286e61a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:09.958379 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:10.000571 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 701/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 17:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:49:10.291214 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36ce80-d9e3-403d-ac92-433f4fce7525 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:49:10.292808 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-be36ce80-d9e3-403d-ac92-433f4fce7525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:10.439130 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36ce80-d9e3-403d-ac92-433f4fce7525 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:49:10.511224 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:10.552330 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52cc50-95db-4d4b-b41e-47e69a26316d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:49:10.552860 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52cc50-95db-4d4b-b41e-47e69a26316d service nova] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:10.553174 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52cc50-95db-4d4b-b41e-47e69a26316d service nova] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:10.553449 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52cc50-95db-4d4b-b41e-47e69a26316d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:10.555070 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-de52cc50-95db-4d4b-b41e-47e69a26316d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:10.646744 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de52cc50-95db-4d4b-b41e-47e69a26316d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:49:10.648359 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de52cc50-95db-4d4b-b41e-47e69a26316d service nova] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:49:10.666104 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 715/1416] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:49:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:49:11.809346 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f77250-053f-4116-879a-0cd3108fa7b6 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:11.809954 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f77250-053f-4116-879a-0cd3108fa7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:11.809954 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f77250-053f-4116-879a-0cd3108fa7b6 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:11.811258 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 702/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 17:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:49:11.817983 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43e258-4ed0-40f4-9421-8f15efe60d4e None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:11.818431 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43e258-4ed0-40f4-9421-8f15efe60d4e None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:11.818537 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43e258-4ed0-40f4-9421-8f15efe60d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:11.892608 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-ec43e258-4ed0-40f4-9421-8f15efe60d4e None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:49:11.893830 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-ec43e258-4ed0-40f4-9421-8f15efe60d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:11.921584 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:11.992993 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 716/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 17:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:49:12.144591 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f77250-053f-4116-879a-0cd3108fa7b6 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:49:12.146160 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-c5f77250-053f-4116-879a-0cd3108fa7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:12.300956 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f77250-053f-4116-879a-0cd3108fa7b6 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:49:12.345231 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:12.420368 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4cce2d-385d-4633-aefd-70571dec439b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:49:12.420895 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cce2d-385d-4633-aefd-70571dec439b service nova] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:12.421200 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cce2d-385d-4633-aefd-70571dec439b service nova] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:12.421472 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cce2d-385d-4633-aefd-70571dec439b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:12.423046 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-1c4cce2d-385d-4633-aefd-70571dec439b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:12.511728 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4cce2d-385d-4633-aefd-70571dec439b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:49:12.513344 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4cce2d-385d-4633-aefd-70571dec439b service nova] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:49:12.531426 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 703/1419] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:49:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:49:13.755083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50fb09-f233-4b2d-a72e-3bd4e7f24e6c None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:13.755682 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50fb09-f233-4b2d-a72e-3bd4e7f24e6c None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:13.755682 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50fb09-f233-4b2d-a72e-3bd4e7f24e6c None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:13.756965 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 717/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 17:49:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:49:13.763350 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1185a-8292-45e1-942c-cd5cda762332 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:13.763834 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1185a-8292-45e1-942c-cd5cda762332 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:13.764035 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1185a-8292-45e1-942c-cd5cda762332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:13.818643 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:13.841296 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-b6f1185a-8292-45e1-942c-cd5cda762332 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:49:13.843007 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-b6f1185a-8292-45e1-942c-cd5cda762332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:13.940193 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 704/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 17:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:49:14.093545 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50fb09-f233-4b2d-a72e-3bd4e7f24e6c None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:49:14.094967 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-ca50fb09-f233-4b2d-a72e-3bd4e7f24e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:14.245813 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50fb09-f233-4b2d-a72e-3bd4e7f24e6c None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:49:14.258015 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:14.358368 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07481243-3d13-444a-9a3a-87f0a0dba9dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:49:14.358889 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07481243-3d13-444a-9a3a-87f0a0dba9dd service nova] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:14.359163 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07481243-3d13-444a-9a3a-87f0a0dba9dd service nova] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:14.359429 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07481243-3d13-444a-9a3a-87f0a0dba9dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:14.361039 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-07481243-3d13-444a-9a3a-87f0a0dba9dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:14.452823 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07481243-3d13-444a-9a3a-87f0a0dba9dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:49:14.454525 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07481243-3d13-444a-9a3a-87f0a0dba9dd service nova] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:49:14.472674 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 718/1422] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:49:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:49:15.587028 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ca001-53c0-4da7-85e5-7d2b75f09e94 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:15.587570 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ca001-53c0-4da7-85e5-7d2b75f09e94 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:15.587570 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ca001-53c0-4da7-85e5-7d2b75f09e94 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:15.588934 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 705/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 17:49:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:49:15.595748 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05107a-a8a0-4821-9954-424cc9ded071 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:15.596197 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05107a-a8a0-4821-9954-424cc9ded071 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:15.596291 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05107a-a8a0-4821-9954-424cc9ded071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:15.616187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:15.673100 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-cf05107a-a8a0-4821-9954-424cc9ded071 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:49:15.674308 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-cf05107a-a8a0-4821-9954-424cc9ded071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:15.768764 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 719/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 17:49:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:49:15.926757 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ca001-53c0-4da7-85e5-7d2b75f09e94 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:49:15.928287 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-4b9ca001-53c0-4da7-85e5-7d2b75f09e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:16.038637 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:16.076026 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ca001-53c0-4da7-85e5-7d2b75f09e94 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:49:16.192996 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe15e0-ed02-4b68-8b1a-e046e935570a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:49:16.193573 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe15e0-ed02-4b68-8b1a-e046e935570a service nova] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:16.193884 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe15e0-ed02-4b68-8b1a-e046e935570a service nova] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:16.194174 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe15e0-ed02-4b68-8b1a-e046e935570a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:16.195875 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-c7fe15e0-ed02-4b68-8b1a-e046e935570a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:16.272305 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:16.286088 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe15e0-ed02-4b68-8b1a-e046e935570a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:49:16.287673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe15e0-ed02-4b68-8b1a-e046e935570a service nova] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:49:16.305186 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 706/1425] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:49:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:49:17.421954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21add161-d296-4bc0-85eb-6dc2008fbe4d None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:17.422466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21add161-d296-4bc0-85eb-6dc2008fbe4d None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:17.422580 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21add161-d296-4bc0-85eb-6dc2008fbe4d None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:17.423859 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 720/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 17:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:49:17.430159 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b156be-761e-4d58-a48d-07ec9d63649a None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:17.430553 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b156be-761e-4d58-a48d-07ec9d63649a None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:17.430777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b156be-761e-4d58-a48d-07ec9d63649a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:17.508660 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-64b156be-761e-4d58-a48d-07ec9d63649a None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:49:17.509970 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-64b156be-761e-4d58-a48d-07ec9d63649a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:17.605146 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 707/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 17:49:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:49:17.754619 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21add161-d296-4bc0-85eb-6dc2008fbe4d None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:49:17.756284 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-21add161-d296-4bc0-85eb-6dc2008fbe4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:17.840534 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:17.903725 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21add161-d296-4bc0-85eb-6dc2008fbe4d None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:49:18.018096 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e720f-c0c3-4a9e-842f-fed82e9a2fa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:49:18.018697 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e720f-c0c3-4a9e-842f-fed82e9a2fa4 service nova] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:18.018978 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e720f-c0c3-4a9e-842f-fed82e9a2fa4 service nova] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:18.019249 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e720f-c0c3-4a9e-842f-fed82e9a2fa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:18.020839 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-528e720f-c0c3-4a9e-842f-fed82e9a2fa4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:18.072202 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:18.115151 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e720f-c0c3-4a9e-842f-fed82e9a2fa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:49:18.116750 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e720f-c0c3-4a9e-842f-fed82e9a2fa4 service nova] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:49:18.135275 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 721/1428] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:49:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:49:19.300188 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b38eea-d824-4068-b243-5733d23631bb None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:19.300737 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b38eea-d824-4068-b243-5733d23631bb None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:19.300856 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b38eea-d824-4068-b243-5733d23631bb None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:19.302176 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 708/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 17:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:49:19.309084 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743d6da-ea4d-4736-9462-0dbdb0c1507e None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:19.309535 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743d6da-ea4d-4736-9462-0dbdb0c1507e None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:19.309647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743d6da-ea4d-4736-9462-0dbdb0c1507e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:19.385699 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-2743d6da-ea4d-4736-9462-0dbdb0c1507e None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:49:19.386906 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-2743d6da-ea4d-4736-9462-0dbdb0c1507e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:19.484690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 722/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 17:49:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:49:19.633234 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b38eea-d824-4068-b243-5733d23631bb None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:49:19.634666 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-e3b38eea-d824-4068-b243-5733d23631bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:19.686811 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:19.791062 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b38eea-d824-4068-b243-5733d23631bb None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:49:19.913073 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6e506-bb43-4abc-a049-0947dab4fb50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:49:19.913668 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6e506-bb43-4abc-a049-0947dab4fb50 service nova] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:19.913976 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6e506-bb43-4abc-a049-0947dab4fb50 service nova] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:19.914277 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6e506-bb43-4abc-a049-0947dab4fb50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:19.915958 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-3ac6e506-bb43-4abc-a049-0947dab4fb50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:19.924705 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:20.021480 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6e506-bb43-4abc-a049-0947dab4fb50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:49:20.023186 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6e506-bb43-4abc-a049-0947dab4fb50 service nova] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:49:20.042229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 709/1431] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:49:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:49:21.105309 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5ece9-2e69-426e-bfb5-e35c2534a215 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:21.105889 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5ece9-2e69-426e-bfb5-e35c2534a215 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:21.105889 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5ece9-2e69-426e-bfb5-e35c2534a215 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:21.107206 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 723/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 17:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:49:21.113933 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c541c-66de-4cc7-9489-5b5717315812 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:21.114401 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c541c-66de-4cc7-9489-5b5717315812 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:21.114527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c541c-66de-4cc7-9489-5b5717315812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:21.191773 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-ba8c541c-66de-4cc7-9489-5b5717315812 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:49:21.192975 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-ba8c541c-66de-4cc7-9489-5b5717315812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:21.260920 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:21.290862 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 710/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 17:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:49:21.453161 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5ece9-2e69-426e-bfb5-e35c2534a215 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:49:21.454721 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-f3a5ece9-2e69-426e-bfb5-e35c2534a215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:21.472694 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:21.598931 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5ece9-2e69-426e-bfb5-e35c2534a215 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:49:21.684799 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:21.711314 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65624271-8ad9-473e-8fb6-d833d0781a89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:49:21.711944 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65624271-8ad9-473e-8fb6-d833d0781a89 service nova] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:21.712219 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65624271-8ad9-473e-8fb6-d833d0781a89 service nova] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:21.712487 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65624271-8ad9-473e-8fb6-d833d0781a89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:21.714100 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-65624271-8ad9-473e-8fb6-d833d0781a89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:21.802915 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65624271-8ad9-473e-8fb6-d833d0781a89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:49:21.804647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65624271-8ad9-473e-8fb6-d833d0781a89 service nova] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:49:21.823192 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 724/1434] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:49:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:49:22.868850 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83d470-594b-4895-978a-838c06985d0c None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:22.869429 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83d470-594b-4895-978a-838c06985d0c None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:22.869429 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83d470-594b-4895-978a-838c06985d0c None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:22.871052 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 711/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 17:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:49:22.878112 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4c31c-af8a-44b7-80d9-975b0f42f0ff None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:22.878573 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4c31c-af8a-44b7-80d9-975b0f42f0ff None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:22.878691 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4c31c-af8a-44b7-80d9-975b0f42f0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:22.954692 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-fdf4c31c-af8a-44b7-80d9-975b0f42f0ff None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:49:22.955906 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-fdf4c31c-af8a-44b7-80d9-975b0f42f0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:22.997638 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:23.052827 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 725/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 17:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:49:23.204960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83d470-594b-4895-978a-838c06985d0c None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:49:23.206491 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-6d83d470-594b-4895-978a-838c06985d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:23.357782 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83d470-594b-4895-978a-838c06985d0c None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:49:23.411989 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:23.471778 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059240dc-e21a-42b2-ab3a-71f94ecc0d3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:49:23.472293 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059240dc-e21a-42b2-ab3a-71f94ecc0d3a service nova] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:23.472567 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059240dc-e21a-42b2-ab3a-71f94ecc0d3a service nova] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:23.472835 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059240dc-e21a-42b2-ab3a-71f94ecc0d3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:23.474451 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-059240dc-e21a-42b2-ab3a-71f94ecc0d3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:23.562886 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059240dc-e21a-42b2-ab3a-71f94ecc0d3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:49:23.564518 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059240dc-e21a-42b2-ab3a-71f94ecc0d3a service nova] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:49:23.582324 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 712/1437] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:49:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:49:24.628413 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b5878-dd94-417a-9242-b704527074fb None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:24.628982 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b5878-dd94-417a-9242-b704527074fb None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:24.628982 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b5878-dd94-417a-9242-b704527074fb None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:24.630320 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 726/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 17:49:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:49:24.636632 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec332c2-be3f-4b08-a35b-02407052123d None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:24.637087 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec332c2-be3f-4b08-a35b-02407052123d None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:24.637240 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec332c2-be3f-4b08-a35b-02407052123d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:24.712311 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-dec332c2-be3f-4b08-a35b-02407052123d None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:49:24.713535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-dec332c2-be3f-4b08-a35b-02407052123d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:24.715548 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:24.811546 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 713/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 17:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:49:24.959936 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b5878-dd94-417a-9242-b704527074fb None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:49:24.961480 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-ea1b5878-dd94-417a-9242-b704527074fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:25.115476 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b5878-dd94-417a-9242-b704527074fb None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:49:25.143666 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:25.232401 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1518fb-9a23-46cd-950f-49e3d250ee88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:49:25.232945 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1518fb-9a23-46cd-950f-49e3d250ee88 service nova] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:25.233256 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1518fb-9a23-46cd-950f-49e3d250ee88 service nova] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:25.233564 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1518fb-9a23-46cd-950f-49e3d250ee88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:25.235246 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-de1518fb-9a23-46cd-950f-49e3d250ee88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:25.328947 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1518fb-9a23-46cd-950f-49e3d250ee88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:49:25.331127 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1518fb-9a23-46cd-950f-49e3d250ee88 service nova] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:49:25.349525 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 727/1440] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:49:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:49:27.414729 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4572a9-9dfa-4273-b6b1-58c602b9e611 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:27.415313 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4572a9-9dfa-4273-b6b1-58c602b9e611 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:27.415313 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4572a9-9dfa-4273-b6b1-58c602b9e611 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:27.416639 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 714/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 17:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:49:27.422401 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac80523-5655-4d98-9a8f-bc39a8cb4a80 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:27.422862 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac80523-5655-4d98-9a8f-bc39a8cb4a80 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:27.422967 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac80523-5655-4d98-9a8f-bc39a8cb4a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:27.579854 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:27.606117 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-dac80523-5655-4d98-9a8f-bc39a8cb4a80 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:49:27.607324 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-dac80523-5655-4d98-9a8f-bc39a8cb4a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:27.702102 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 728/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 17:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:49:27.984713 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4572a9-9dfa-4273-b6b1-58c602b9e611 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:49:27.986272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-ff4572a9-9dfa-4273-b6b1-58c602b9e611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:28.089765 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4572a9-9dfa-4273-b6b1-58c602b9e611 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:49:28.121765 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:28.163559 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87d95e-80ec-42c8-80c2-5b760a727008 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:49:28.164158 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87d95e-80ec-42c8-80c2-5b760a727008 service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:28.164433 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87d95e-80ec-42c8-80c2-5b760a727008 service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:28.164701 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87d95e-80ec-42c8-80c2-5b760a727008 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:28.166383 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-5a87d95e-80ec-42c8-80c2-5b760a727008 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:28.275675 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a87d95e-80ec-42c8-80c2-5b760a727008 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:49:28.277107 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a87d95e-80ec-42c8-80c2-5b760a727008 service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:49:28.294937 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 715/1443] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:49:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:49:30.612109 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712a6ef-98b4-42fd-877a-6d5f8a07fe11 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:30.612692 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712a6ef-98b4-42fd-877a-6d5f8a07fe11 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:30.612692 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712a6ef-98b4-42fd-877a-6d5f8a07fe11 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:30.614060 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 729/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 17:49:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:49:30.619378 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fb254-ceac-4efc-b44c-c8687fdbeff0 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:30.619784 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fb254-ceac-4efc-b44c-c8687fdbeff0 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:30.619929 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fb254-ceac-4efc-b44c-c8687fdbeff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:30.685316 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-604fb254-ceac-4efc-b44c-c8687fdbeff0 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:49:30.686514 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-604fb254-ceac-4efc-b44c-c8687fdbeff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:30.699926 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:30.781826 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 716/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 17:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:49:31.071847 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712a6ef-98b4-42fd-877a-6d5f8a07fe11 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:49:31.073562 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-8712a6ef-98b4-42fd-877a-6d5f8a07fe11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:31.177731 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712a6ef-98b4-42fd-877a-6d5f8a07fe11 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:49:31.191071 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:31.252329 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f323a-52aa-4450-9fc9-0af2333e215a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:49:31.252932 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f323a-52aa-4450-9fc9-0af2333e215a service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:31.253238 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f323a-52aa-4450-9fc9-0af2333e215a service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:31.253510 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f323a-52aa-4450-9fc9-0af2333e215a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:31.255097 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-8d4f323a-52aa-4450-9fc9-0af2333e215a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:31.365499 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f323a-52aa-4450-9fc9-0af2333e215a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:49:31.366878 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f323a-52aa-4450-9fc9-0af2333e215a service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:49:31.385892 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 730/1446] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:49:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:49:33.859254 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3597d2d-bbc9-4402-9a5a-702808312301 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:33.859844 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3597d2d-bbc9-4402-9a5a-702808312301 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:33.859844 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3597d2d-bbc9-4402-9a5a-702808312301 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:33.861190 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 717/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 17:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:49:33.867194 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd42d60-2bb3-4a47-b7cb-81d55035e2f0 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:33.867646 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd42d60-2bb3-4a47-b7cb-81d55035e2f0 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:33.867753 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd42d60-2bb3-4a47-b7cb-81d55035e2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:33.914527 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:33.932569 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-8dd42d60-2bb3-4a47-b7cb-81d55035e2f0 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:49:33.933805 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-8dd42d60-2bb3-4a47-b7cb-81d55035e2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:34.028566 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 731/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 17:49:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:49:34.320380 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3597d2d-bbc9-4402-9a5a-702808312301 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:49:34.321940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-f3597d2d-bbc9-4402-9a5a-702808312301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:34.426918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3597d2d-bbc9-4402-9a5a-702808312301 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:49:34.466962 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:34.500727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37cb073-0dab-4004-9b10-a34be96a1dcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:49:34.501356 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37cb073-0dab-4004-9b10-a34be96a1dcd service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:34.501628 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37cb073-0dab-4004-9b10-a34be96a1dcd service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:34.501890 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37cb073-0dab-4004-9b10-a34be96a1dcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:34.503479 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-a37cb073-0dab-4004-9b10-a34be96a1dcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:34.610613 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37cb073-0dab-4004-9b10-a34be96a1dcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:49:34.611959 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37cb073-0dab-4004-9b10-a34be96a1dcd service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:49:34.631072 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 718/1449] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:49:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:49:36.913976 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b9262-1d3c-4dce-949d-f42c7fcc21ff None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:36.914550 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b9262-1d3c-4dce-949d-f42c7fcc21ff None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:36.914550 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b9262-1d3c-4dce-949d-f42c7fcc21ff None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:36.915885 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 732/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 17:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:49:36.921165 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c102f-59d3-45a2-90cf-b19824144b4a None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:36.921578 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c102f-59d3-45a2-90cf-b19824144b4a None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:36.921718 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c102f-59d3-45a2-90cf-b19824144b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:36.987022 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-825c102f-59d3-45a2-90cf-b19824144b4a None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:49:36.988229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-825c102f-59d3-45a2-90cf-b19824144b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:37.009537 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:37.085210 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 719/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 17:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:49:37.374424 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b9262-1d3c-4dce-949d-f42c7fcc21ff None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:49:37.375961 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-4f5b9262-1d3c-4dce-949d-f42c7fcc21ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:37.479327 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b9262-1d3c-4dce-949d-f42c7fcc21ff None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:49:37.499900 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:37.552817 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3625a8f-c9ff-4b02-becf-cfd3279f071c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:49:37.553447 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3625a8f-c9ff-4b02-becf-cfd3279f071c service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:37.553727 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3625a8f-c9ff-4b02-becf-cfd3279f071c service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:37.554001 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3625a8f-c9ff-4b02-becf-cfd3279f071c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:37.555592 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-a3625a8f-c9ff-4b02-becf-cfd3279f071c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:37.662332 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3625a8f-c9ff-4b02-becf-cfd3279f071c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:49:37.663661 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3625a8f-c9ff-4b02-becf-cfd3279f071c service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:49:37.681234 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 733/1452] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:49:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:49:40.015323 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38146df9-5cb9-433c-ac33-caa0bff8f42e None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:40.015877 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38146df9-5cb9-433c-ac33-caa0bff8f42e None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:40.015877 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38146df9-5cb9-433c-ac33-caa0bff8f42e None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:40.017424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 720/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 17:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:49:40.022917 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a95caa-f7c5-4d7b-a01f-33036ae11970 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:40.023332 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a95caa-f7c5-4d7b-a01f-33036ae11970 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:40.023453 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a95caa-f7c5-4d7b-a01f-33036ae11970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:40.087894 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:40.090771 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-e4a95caa-f7c5-4d7b-a01f-33036ae11970 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:49:40.092542 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-e4a95caa-f7c5-4d7b-a01f-33036ae11970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:40.188628 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 734/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 17:49:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:49:40.474784 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38146df9-5cb9-433c-ac33-caa0bff8f42e None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:49:40.476302 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-38146df9-5cb9-433c-ac33-caa0bff8f42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:40.579837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38146df9-5cb9-433c-ac33-caa0bff8f42e None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:49:40.629854 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:40.654527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc560f-47e6-4f5c-8d1a-d79cf50957d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:49:40.655123 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc560f-47e6-4f5c-8d1a-d79cf50957d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:40.655403 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc560f-47e6-4f5c-8d1a-d79cf50957d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:40.655676 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc560f-47e6-4f5c-8d1a-d79cf50957d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:40.657292 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-ebfc560f-47e6-4f5c-8d1a-d79cf50957d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:40.765618 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc560f-47e6-4f5c-8d1a-d79cf50957d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:49:40.766978 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc560f-47e6-4f5c-8d1a-d79cf50957d1 service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:49:40.784855 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 721/1455] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:49:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:49:43.033289 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7732d3f-1bfc-4ec0-84cc-ef26a6cfda3d None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:43.033849 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7732d3f-1bfc-4ec0-84cc-ef26a6cfda3d None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:43.033849 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7732d3f-1bfc-4ec0-84cc-ef26a6cfda3d None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:43.035214 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 735/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 17:49:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:49:43.041380 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f721fa-80ca-4cbe-8a1a-447cf103bb93 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:43.041854 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f721fa-80ca-4cbe-8a1a-447cf103bb93 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:43.041999 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f721fa-80ca-4cbe-8a1a-447cf103bb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:43.107908 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-d5f721fa-80ca-4cbe-8a1a-447cf103bb93 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:49:43.109048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-d5f721fa-80ca-4cbe-8a1a-447cf103bb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:43.138006 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:43.205432 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 722/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 17:49:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:49:43.495815 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7732d3f-1bfc-4ec0-84cc-ef26a6cfda3d None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:49:43.497396 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-e7732d3f-1bfc-4ec0-84cc-ef26a6cfda3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:43.598620 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7732d3f-1bfc-4ec0-84cc-ef26a6cfda3d None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:49:43.627663 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:43.673676 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8cdc3e-b13c-4fc9-8e06-d9495e55cd06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:49:43.674281 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8cdc3e-b13c-4fc9-8e06-d9495e55cd06 service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:43.674565 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8cdc3e-b13c-4fc9-8e06-d9495e55cd06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:43.674833 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8cdc3e-b13c-4fc9-8e06-d9495e55cd06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:43.676411 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-6f8cdc3e-b13c-4fc9-8e06-d9495e55cd06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:43.783902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8cdc3e-b13c-4fc9-8e06-d9495e55cd06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:49:43.785358 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8cdc3e-b13c-4fc9-8e06-d9495e55cd06 service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:49:43.803381 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 736/1458] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:49:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:49:46.011777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2118787-4822-4d41-812e-da37f756e8e5 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:46.012320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2118787-4822-4d41-812e-da37f756e8e5 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:46.012320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2118787-4822-4d41-812e-da37f756e8e5 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:46.013722 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 723/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 17:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:49:46.019006 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140837c-d738-440c-aded-e31d4e44cdb3 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:46.019414 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140837c-d738-440c-aded-e31d4e44cdb3 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:46.019552 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140837c-d738-440c-aded-e31d4e44cdb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:46.085328 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-5140837c-d738-440c-aded-e31d4e44cdb3 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:49:46.087112 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-5140837c-d738-440c-aded-e31d4e44cdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:46.096595 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:46.183734 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 737/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 17:49:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:49:46.467195 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2118787-4822-4d41-812e-da37f756e8e5 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:49:46.468719 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-e2118787-4822-4d41-812e-da37f756e8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:46.574182 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2118787-4822-4d41-812e-da37f756e8e5 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:49:46.630253 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:46.649322 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb940b03-673c-40bd-a604-d8c972e88af0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:49:46.649859 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb940b03-673c-40bd-a604-d8c972e88af0 service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:46.650138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb940b03-673c-40bd-a604-d8c972e88af0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:46.650408 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb940b03-673c-40bd-a604-d8c972e88af0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:46.651988 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-eb940b03-673c-40bd-a604-d8c972e88af0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:46.759730 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb940b03-673c-40bd-a604-d8c972e88af0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:49:46.761209 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb940b03-673c-40bd-a604-d8c972e88af0 service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:49:46.779250 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 724/1461] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:49:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:49:48.993424 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b06f2f-ec92-4722-a9b2-c05e87e52a4e None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:48.993992 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b06f2f-ec92-4722-a9b2-c05e87e52a4e None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:48.993992 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b06f2f-ec92-4722-a9b2-c05e87e52a4e None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:48.995318 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 738/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 17:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:49:49.000586 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e1c8a-88b4-49e5-9c84-f32b56da0a71 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:49.000976 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e1c8a-88b4-49e5-9c84-f32b56da0a71 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:49.001162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e1c8a-88b4-49e5-9c84-f32b56da0a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:49.066881 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-454e1c8a-88b4-49e5-9c84-f32b56da0a71 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:49:49.068174 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-454e1c8a-88b4-49e5-9c84-f32b56da0a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:49.107622 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:49.164994 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 725/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 17:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:49:49.452604 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b06f2f-ec92-4722-a9b2-c05e87e52a4e None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:49:49.454213 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-d3b06f2f-ec92-4722-a9b2-c05e87e52a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:49.557573 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b06f2f-ec92-4722-a9b2-c05e87e52a4e None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:49:49.598169 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:49.634628 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3a88c-9ecb-4766-819b-34e1d69d0bb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:49:49.635154 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3a88c-9ecb-4766-819b-34e1d69d0bb4 service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:49.635430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3a88c-9ecb-4766-819b-34e1d69d0bb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:49.635726 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3a88c-9ecb-4766-819b-34e1d69d0bb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:49.637335 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-55b3a88c-9ecb-4766-819b-34e1d69d0bb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:49.745794 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b3a88c-9ecb-4766-819b-34e1d69d0bb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:49:49.747231 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b3a88c-9ecb-4766-819b-34e1d69d0bb4 service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:49:49.764807 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 739/1464] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:49:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:49:52.126032 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5381dc4-a361-4234-a363-892c92645f94 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:52.126571 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5381dc4-a361-4234-a363-892c92645f94 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:52.126571 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5381dc4-a361-4234-a363-892c92645f94 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:52.127941 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 726/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 17:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:49:52.133494 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d19bc-ec98-4d42-9d7e-b2cc7d0ab49e None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:52.133939 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d19bc-ec98-4d42-9d7e-b2cc7d0ab49e None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:52.134044 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d19bc-ec98-4d42-9d7e-b2cc7d0ab49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:52.199879 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-137d19bc-ec98-4d42-9d7e-b2cc7d0ab49e None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:49:52.200975 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-137d19bc-ec98-4d42-9d7e-b2cc7d0ab49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:52.218204 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:52.295604 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 740/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 17:49:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:49:52.582235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5381dc4-a361-4234-a363-892c92645f94 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:49:52.583754 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-e5381dc4-a361-4234-a363-892c92645f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:52.686713 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5381dc4-a361-4234-a363-892c92645f94 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:49:52.753651 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:52.761449 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792fca3-524c-4b0b-b71c-7e9f3ae1191e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:49:52.762049 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792fca3-524c-4b0b-b71c-7e9f3ae1191e service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:52.762321 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792fca3-524c-4b0b-b71c-7e9f3ae1191e service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:52.762587 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792fca3-524c-4b0b-b71c-7e9f3ae1191e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:52.764176 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-a792fca3-524c-4b0b-b71c-7e9f3ae1191e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:52.878107 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792fca3-524c-4b0b-b71c-7e9f3ae1191e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:49:52.879468 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792fca3-524c-4b0b-b71c-7e9f3ae1191e service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:49:52.897878 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 727/1467] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:49:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:49:55.067928 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3dc7e1-3434-4914-a9fa-946574e7544e None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:55.068515 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3dc7e1-3434-4914-a9fa-946574e7544e None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:55.068515 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3dc7e1-3434-4914-a9fa-946574e7544e None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:55.069835 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 741/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 17:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:49:55.075315 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5fce8-b6f7-4567-94d4-3c9f4d12452a None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:55.075725 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5fce8-b6f7-4567-94d4-3c9f4d12452a None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:55.075861 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5fce8-b6f7-4567-94d4-3c9f4d12452a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:55.142872 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-99d5fce8-b6f7-4567-94d4-3c9f4d12452a None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:49:55.144074 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-99d5fce8-b6f7-4567-94d4-3c9f4d12452a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:55.191767 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:55.239664 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 728/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 17:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:49:55.522307 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3dc7e1-3434-4914-a9fa-946574e7544e None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:49:55.524431 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-7b3dc7e1-3434-4914-a9fa-946574e7544e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:55.627378 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3dc7e1-3434-4914-a9fa-946574e7544e None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:49:55.675595 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:49:55.701134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26774ec-ee3d-4675-862e-77710e1dcb4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:49:55.701738 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26774ec-ee3d-4675-862e-77710e1dcb4f service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:49:55.702016 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26774ec-ee3d-4675-862e-77710e1dcb4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:49:55.702286 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26774ec-ee3d-4675-862e-77710e1dcb4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:49:55.703880 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-a26774ec-ee3d-4675-862e-77710e1dcb4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:49:55.813088 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26774ec-ee3d-4675-862e-77710e1dcb4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:49:55.814614 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26774ec-ee3d-4675-862e-77710e1dcb4f service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:49:55.833868 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 742/1470] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:49:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:50:05.238173 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=22 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:50:05.831404 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=66 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:50:16.142355 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fb93e-d548-45c4-9441-aa8d37a4437a None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:50:16.142932 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fb93e-d548-45c4-9441-aa8d37a4437a None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:50:16.142932 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fb93e-d548-45c4-9441-aa8d37a4437a None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:50:16.144254 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 729/1471] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:50:16.149452 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d12f4-8c70-4d70-b99f-8f5da9d21e44 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:50:16.149860 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d12f4-8c70-4d70-b99f-8f5da9d21e44 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:50:16.150002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d12f4-8c70-4d70-b99f-8f5da9d21e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:50:16.215505 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-681d12f4-8c70-4d70-b99f-8f5da9d21e44 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:50:16.216629 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-681d12f4-8c70-4d70-b99f-8f5da9d21e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:50:16.312756 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 743/1472] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:50:16.609157 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52035c-5776-4e0a-adcf-bf6c07fe8dd7 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:50:16.609445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52035c-5776-4e0a-adcf-bf6c07fe8dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:50:16.609749 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52035c-5776-4e0a-adcf-bf6c07fe8dd7 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:50:16.611150 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 730/1473] 10.222.0.62 () {54 vars in 962 bytes} [Mon Sep 26 17:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:50:16.616214 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0709a-466f-4cfd-9e4f-70d2199cca78 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:50:16.616501 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0709a-466f-4cfd-9e4f-70d2199cca78 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:50:16.616771 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0709a-466f-4cfd-9e4f-70d2199cca78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:50:16.691238 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-d2e0709a-466f-4cfd-9e4f-70d2199cca78 None None] MFA Rules not processed for user `ab3b7ac09599477bb0c6c1d32e2d5dbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:50:16.692442 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-d2e0709a-466f-4cfd-9e4f-70d2199cca78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:50:16.713126 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:50:16.767068 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 744/1474] 10.222.0.62 () {58 vars in 1059 bytes} [Mon Sep 26 17:50:16 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:50:16.774928 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad52035c-5776-4e0a-adcf-bf6c07fe8dd7 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:50:16.776919 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-ad52035c-5776-4e0a-adcf-bf6c07fe8dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:50:16.882558 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad52035c-5776-4e0a-adcf-bf6c07fe8dd7 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:50:16.955837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e2e96d-fa3b-4811-a463-563d51825baa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab3b7ac09599477bb0c6c1d32e2d5dbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:50:16.956442 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2e96d-fa3b-4811-a463-563d51825baa service glance] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:50:16.956723 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2e96d-fa3b-4811-a463-563d51825baa service glance] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:50:16.956996 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2e96d-fa3b-4811-a463-563d51825baa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:50:16.958625 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-80e2e96d-fa3b-4811-a463-563d51825baa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:50:17.014701 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:50:17.069542 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e2e96d-fa3b-4811-a463-563d51825baa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:50:17.070990 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e2e96d-fa3b-4811-a463-563d51825baa service glance] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:50:17.090350 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 731/1475] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:50:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:50:19.334573 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68051376-b6f8-4838-b63e-228e7257a0b5 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:50:19.335140 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68051376-b6f8-4838-b63e-228e7257a0b5 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:50:19.335140 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68051376-b6f8-4838-b63e-228e7257a0b5 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:50:19.336473 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 745/1476] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:50:19.342571 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f1faa-ca45-4257-a7cf-7c0742a48150 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:50:19.342960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f1faa-ca45-4257-a7cf-7c0742a48150 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:50:19.343118 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f1faa-ca45-4257-a7cf-7c0742a48150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:50:19.410430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-038f1faa-ca45-4257-a7cf-7c0742a48150 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:50:19.411645 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-038f1faa-ca45-4257-a7cf-7c0742a48150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:50:19.511560 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 732/1477] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:50:19.785468 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68051376-b6f8-4838-b63e-228e7257a0b5 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:50:19.787044 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-68051376-b6f8-4838-b63e-228e7257a0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:50:19.918174 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68051376-b6f8-4838-b63e-228e7257a0b5 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:50:19.971422 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:50:20.017209 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3babf1d1-4f8d-48b6-9158-29a84c95b76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:50:20.017814 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babf1d1-4f8d-48b6-9158-29a84c95b76f admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:50:20.018091 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babf1d1-4f8d-48b6-9158-29a84c95b76f admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:50:20.018361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babf1d1-4f8d-48b6-9158-29a84c95b76f admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:50:20.018990 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3babf1d1-4f8d-48b6-9158-29a84c95b76f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:50:20.020704 dv-cinder-859318-1-smb devstack@keystone.service[81277]: WARNING py.warnings [None req-3babf1d1-4f8d-48b6-9158-29a84c95b76f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 17:50:20.020704 dv-cinder-859318-1-smb devstack@keystone.service[81277]: warnings.warn(msg) Sep 26 17:50:20.020704 dv-cinder-859318-1-smb devstack@keystone.service[81277]: Sep 26 17:50:20.021879 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3babf1d1-4f8d-48b6-9158-29a84c95b76f admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:50:20.041155 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 746/1478] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Sep 26 17:50:19 2022] GET /identity/v3/projects => generated 2553 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:50:22.211631 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a58ff-e7d8-4e76-b1ed-d37ce4bad170 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:50:22.212198 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a58ff-e7d8-4e76-b1ed-d37ce4bad170 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:50:22.212198 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a58ff-e7d8-4e76-b1ed-d37ce4bad170 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:50:22.213479 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 733/1479] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:50:22.219490 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe80dfe-2be6-4fb4-b204-476db3ba1bb2 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:50:22.219940 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe80dfe-2be6-4fb4-b204-476db3ba1bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:50:22.220101 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe80dfe-2be6-4fb4-b204-476db3ba1bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:50:22.289840 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-7fe80dfe-2be6-4fb4-b204-476db3ba1bb2 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:50:22.291063 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-7fe80dfe-2be6-4fb4-b204-476db3ba1bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:50:22.388400 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 747/1480] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:50:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:50:22.683698 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a58ff-e7d8-4e76-b1ed-d37ce4bad170 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:50:22.685547 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-6d8a58ff-e7d8-4e76-b1ed-d37ce4bad170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:50:22.695330 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:50:22.842100 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a58ff-e7d8-4e76-b1ed-d37ce4bad170 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:50:22.926619 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:50:22.961925 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71bd7c7-a317-4bb4-8e75-ab14eee40dad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:50:22.962588 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bd7c7-a317-4bb4-8e75-ab14eee40dad service nova] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:50:22.962909 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bd7c7-a317-4bb4-8e75-ab14eee40dad service nova] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:50:22.963200 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bd7c7-a317-4bb4-8e75-ab14eee40dad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:50:22.965034 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-e71bd7c7-a317-4bb4-8e75-ab14eee40dad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:50:23.062647 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71bd7c7-a317-4bb4-8e75-ab14eee40dad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:50:23.064239 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71bd7c7-a317-4bb4-8e75-ab14eee40dad service nova] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:50:23.083452 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 734/1481] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:50:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:50:25.559530 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966e0e7-ed6b-4c83-8635-802f4527ea03 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:50:25.560068 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966e0e7-ed6b-4c83-8635-802f4527ea03 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:50:25.560068 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966e0e7-ed6b-4c83-8635-802f4527ea03 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:50:25.561503 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 748/1482] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:50:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:50:25.567280 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3086518-9c2d-4f68-b9da-80ce91c42e0c None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:50:25.567719 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3086518-9c2d-4f68-b9da-80ce91c42e0c None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:50:25.567891 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3086518-9c2d-4f68-b9da-80ce91c42e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:50:25.637075 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-e3086518-9c2d-4f68-b9da-80ce91c42e0c None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:50:25.638907 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-e3086518-9c2d-4f68-b9da-80ce91c42e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:50:25.685219 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:50:25.740045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 735/1483] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:50:26.025403 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966e0e7-ed6b-4c83-8635-802f4527ea03 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:50:26.026928 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-e966e0e7-ed6b-4c83-8635-802f4527ea03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:50:26.051254 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:50:26.130369 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966e0e7-ed6b-4c83-8635-802f4527ea03 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:50:26.204025 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e6c71-ccda-424a-9c7e-e8e65edd5849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:50:26.204612 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e6c71-ccda-424a-9c7e-e8e65edd5849 service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:50:26.204887 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e6c71-ccda-424a-9c7e-e8e65edd5849 service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:50:26.205245 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e6c71-ccda-424a-9c7e-e8e65edd5849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:50:26.206826 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-518e6c71-ccda-424a-9c7e-e8e65edd5849 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:50:26.279638 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:50:26.315545 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518e6c71-ccda-424a-9c7e-e8e65edd5849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:50:26.317040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518e6c71-ccda-424a-9c7e-e8e65edd5849 service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:50:26.335540 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 749/1484] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:50:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:50:28.532343 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deaa08b-9730-41a4-ba4f-71803ea209b5 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:50:28.532904 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deaa08b-9730-41a4-ba4f-71803ea209b5 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:50:28.532904 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deaa08b-9730-41a4-ba4f-71803ea209b5 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:50:28.534264 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 736/1485] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:50:28.539417 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74212f17-2f10-4b5a-a758-0b3a9f88dae6 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:50:28.539840 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74212f17-2f10-4b5a-a758-0b3a9f88dae6 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:50:28.539966 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74212f17-2f10-4b5a-a758-0b3a9f88dae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:50:28.606123 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-74212f17-2f10-4b5a-a758-0b3a9f88dae6 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:50:28.607828 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-74212f17-2f10-4b5a-a758-0b3a9f88dae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:50:28.705744 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 750/1486] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:50:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:50:28.999465 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deaa08b-9730-41a4-ba4f-71803ea209b5 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:50:29.000978 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-6deaa08b-9730-41a4-ba4f-71803ea209b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:50:29.106360 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deaa08b-9730-41a4-ba4f-71803ea209b5 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:50:29.178233 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:50:29.179874 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad434b4-fc08-4205-9834-a61e92f7ac60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:50:29.180609 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad434b4-fc08-4205-9834-a61e92f7ac60 service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:50:29.181138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad434b4-fc08-4205-9834-a61e92f7ac60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:50:29.181673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad434b4-fc08-4205-9834-a61e92f7ac60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:50:29.183511 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-7ad434b4-fc08-4205-9834-a61e92f7ac60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:50:29.299356 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad434b4-fc08-4205-9834-a61e92f7ac60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:50:29.300846 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad434b4-fc08-4205-9834-a61e92f7ac60 service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:50:29.320416 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 737/1487] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:50:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 17:50:31.562262 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea31bf-8da1-453c-a0cd-5022d5644261 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:50:31.562822 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea31bf-8da1-453c-a0cd-5022d5644261 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:50:31.562822 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea31bf-8da1-453c-a0cd-5022d5644261 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:50:31.564158 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 751/1488] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:50:31.569564 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941090af-d60f-420d-934c-4c90866e11c8 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:50:31.570138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941090af-d60f-420d-934c-4c90866e11c8 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:50:31.570138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941090af-d60f-420d-934c-4c90866e11c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:50:31.635125 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-941090af-d60f-420d-934c-4c90866e11c8 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:50:31.636232 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-941090af-d60f-420d-934c-4c90866e11c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:50:31.688375 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:50:31.735107 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 738/1489] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:50:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:50:32.025162 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea31bf-8da1-453c-a0cd-5022d5644261 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:50:32.026765 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-8eea31bf-8da1-453c-a0cd-5022d5644261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:50:32.063774 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:50:32.130186 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea31bf-8da1-453c-a0cd-5022d5644261 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:50:32.202943 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827d9ac-743a-404a-abd6-2bce621134a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:50:32.203808 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827d9ac-743a-404a-abd6-2bce621134a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:50:32.204083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827d9ac-743a-404a-abd6-2bce621134a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:50:32.204347 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827d9ac-743a-404a-abd6-2bce621134a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:50:32.205977 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-6827d9ac-743a-404a-abd6-2bce621134a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:50:32.283631 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:50:32.312665 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6827d9ac-743a-404a-abd6-2bce621134a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:50:32.314172 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6827d9ac-743a-404a-abd6-2bce621134a7 service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:50:32.333038 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 752/1490] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:50:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:50:34.646769 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331837e8-b882-4d79-9df8-e20c3e87a640 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:50:34.647283 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331837e8-b882-4d79-9df8-e20c3e87a640 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:50:34.647283 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331837e8-b882-4d79-9df8-e20c3e87a640 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:50:34.648594 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 739/1491] 10.222.0.62 () {54 vars in 927 bytes} [Mon Sep 26 17:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:50:34.654896 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f00d51-e561-473e-a6c9-bf87dca83736 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:50:34.655377 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f00d51-e561-473e-a6c9-bf87dca83736 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:50:34.655501 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f00d51-e561-473e-a6c9-bf87dca83736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:50:34.721272 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-a9f00d51-e561-473e-a6c9-bf87dca83736 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:50:34.722469 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-a9f00d51-e561-473e-a6c9-bf87dca83736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:50:34.816586 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 753/1492] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Sep 26 17:50:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:50:35.107224 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331837e8-b882-4d79-9df8-e20c3e87a640 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:50:35.108940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-331837e8-b882-4d79-9df8-e20c3e87a640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:50:35.217994 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331837e8-b882-4d79-9df8-e20c3e87a640 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:50:35.294569 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79dc76-cbb7-4142-b810-74598a112b01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:50:35.295169 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79dc76-cbb7-4142-b810-74598a112b01 service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:50:35.295447 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79dc76-cbb7-4142-b810-74598a112b01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:50:35.295718 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79dc76-cbb7-4142-b810-74598a112b01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:50:35.297343 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-4d79dc76-cbb7-4142-b810-74598a112b01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:50:35.306313 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:50:35.410450 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79dc76-cbb7-4142-b810-74598a112b01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:50:35.412025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79dc76-cbb7-4142-b810-74598a112b01 service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:50:35.431611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 740/1493] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:50:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 17:50:44.815058 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=82 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:50:45.429348 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=50 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:51:49.078634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b5558-f192-4ffc-85a1-3007857f3c9a None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:51:49.079197 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b5558-f192-4ffc-85a1-3007857f3c9a None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:51:49.079197 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b5558-f192-4ffc-85a1-3007857f3c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:51:49.154875 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-e29b5558-f192-4ffc-85a1-3007857f3c9a None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:51:49.156079 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-e29b5558-f192-4ffc-85a1-3007857f3c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:51:49.252464 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 754/1494] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:51:49.262483 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45604685-8348-4d40-be35-55843bdc0244 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:51:49.263010 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45604685-8348-4d40-be35-55843bdc0244 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:51:49.263010 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45604685-8348-4d40-be35-55843bdc0244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:51:49.338718 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-45604685-8348-4d40-be35-55843bdc0244 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:51:49.339862 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-45604685-8348-4d40-be35-55843bdc0244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:51:49.435891 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 741/1495] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:51:49.440510 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b5558-f192-4ffc-85a1-3007857f3c9a None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:51:49.441743 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-e29b5558-f192-4ffc-85a1-3007857f3c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:51:49.453047 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b5558-f192-4ffc-85a1-3007857f3c9a None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:51:49.514274 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:51:49.547644 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051494d4-6ee6-4633-bea0-e0d9054bcbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:51:49.548238 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051494d4-6ee6-4633-bea0-e0d9054bcbe3 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:51:49.548513 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051494d4-6ee6-4633-bea0-e0d9054bcbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:51:49.548779 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051494d4-6ee6-4633-bea0-e0d9054bcbe3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:51:49.549446 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051494d4-6ee6-4633-bea0-e0d9054bcbe3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:51:49.550373 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051494d4-6ee6-4633-bea0-e0d9054bcbe3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:51:49.551366 dv-cinder-859318-1-smb devstack@keystone.service[81277]: WARNING py.warnings [None req-051494d4-6ee6-4633-bea0-e0d9054bcbe3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 26 17:51:49.551366 dv-cinder-859318-1-smb devstack@keystone.service[81277]: warnings.warn(msg) Sep 26 17:51:49.551366 dv-cinder-859318-1-smb devstack@keystone.service[81277]: Sep 26 17:51:49.552257 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051494d4-6ee6-4633-bea0-e0d9054bcbe3 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:51:49.563136 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 755/1496] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:51:49.571545 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45604685-8348-4d40-be35-55843bdc0244 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:51:49.580633 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45604685-8348-4d40-be35-55843bdc0244 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:51:49.644189 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:51:49.677918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b541c-9e5c-406a-9194-ae6ddd9027c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:51:49.678514 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b541c-9e5c-406a-9194-ae6ddd9027c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:51:49.678790 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b541c-9e5c-406a-9194-ae6ddd9027c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:51:49.679056 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b541c-9e5c-406a-9194-ae6ddd9027c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:51:49.679691 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b541c-9e5c-406a-9194-ae6ddd9027c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:51:49.681493 dv-cinder-859318-1-smb devstack@keystone.service[81278]: WARNING py.warnings [None req-c20b541c-9e5c-406a-9194-ae6ddd9027c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 17:51:49.681493 dv-cinder-859318-1-smb devstack@keystone.service[81278]: warnings.warn(msg) Sep 26 17:51:49.681493 dv-cinder-859318-1-smb devstack@keystone.service[81278]: Sep 26 17:51:49.682702 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b541c-9e5c-406a-9194-ae6ddd9027c2 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:51:49.737153 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 742/1497] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:51:49 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 17:51:49.741426 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051494d4-6ee6-4633-bea0-e0d9054bcbe3 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:51:49.742940 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-051494d4-6ee6-4633-bea0-e0d9054bcbe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:51:49.777736 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051494d4-6ee6-4633-bea0-e0d9054bcbe3 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:51:49.870732 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416dd6f-ee07-46d8-bad1-34764ceef72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:51:49.871327 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416dd6f-ee07-46d8-bad1-34764ceef72b admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:51:49.871601 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416dd6f-ee07-46d8-bad1-34764ceef72b admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:51:49.871866 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416dd6f-ee07-46d8-bad1-34764ceef72b admin admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:51:49.872479 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416dd6f-ee07-46d8-bad1-34764ceef72b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:51:49.873491 dv-cinder-859318-1-smb devstack@keystone.service[81277]: WARNING py.warnings [None req-c416dd6f-ee07-46d8-bad1-34764ceef72b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 17:51:49.873491 dv-cinder-859318-1-smb devstack@keystone.service[81277]: warnings.warn(msg) Sep 26 17:51:49.873491 dv-cinder-859318-1-smb devstack@keystone.service[81277]: Sep 26 17:51:49.874694 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416dd6f-ee07-46d8-bad1-34764ceef72b admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:51:49.917912 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 756/1498] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:51:49 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:51:49.922049 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b541c-9e5c-406a-9194-ae6ddd9027c2 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:51:49.923550 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-c20b541c-9e5c-406a-9194-ae6ddd9027c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:51:49.989711 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b541c-9e5c-406a-9194-ae6ddd9027c2 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:51:50.074157 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:51:50.086844 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc50696-0a5f-437d-a78a-d8de03408363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:51:50.087448 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc50696-0a5f-437d-a78a-d8de03408363 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:51:50.087723 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc50696-0a5f-437d-a78a-d8de03408363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:51:50.087997 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc50696-0a5f-437d-a78a-d8de03408363 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:51:50.088633 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc50696-0a5f-437d-a78a-d8de03408363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:51:50.089684 dv-cinder-859318-1-smb devstack@keystone.service[81278]: WARNING py.warnings [None req-ccc50696-0a5f-437d-a78a-d8de03408363 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 26 17:51:50.089684 dv-cinder-859318-1-smb devstack@keystone.service[81278]: warnings.warn(msg) Sep 26 17:51:50.089684 dv-cinder-859318-1-smb devstack@keystone.service[81278]: Sep 26 17:51:50.090586 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc50696-0a5f-437d-a78a-d8de03408363 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:51:50.103694 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 743/1499] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:51:50.107933 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416dd6f-ee07-46d8-bad1-34764ceef72b admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:51:50.109568 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-c416dd6f-ee07-46d8-bad1-34764ceef72b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:51:50.120857 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416dd6f-ee07-46d8-bad1-34764ceef72b admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:51:50.145882 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:51:50.216092 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32697620-cfa5-4228-8d0a-c5bbf7480de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:51:50.216700 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32697620-cfa5-4228-8d0a-c5bbf7480de6 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:51:50.216979 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32697620-cfa5-4228-8d0a-c5bbf7480de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:51:50.217285 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32697620-cfa5-4228-8d0a-c5bbf7480de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:51:50.217925 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32697620-cfa5-4228-8d0a-c5bbf7480de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:51:50.218932 dv-cinder-859318-1-smb devstack@keystone.service[81277]: WARNING py.warnings [None req-32697620-cfa5-4228-8d0a-c5bbf7480de6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 26 17:51:50.218932 dv-cinder-859318-1-smb devstack@keystone.service[81277]: warnings.warn(msg) Sep 26 17:51:50.218932 dv-cinder-859318-1-smb devstack@keystone.service[81277]: Sep 26 17:51:50.219832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32697620-cfa5-4228-8d0a-c5bbf7480de6 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:51:50.231990 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 757/1500] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:51:50.236202 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc50696-0a5f-437d-a78a-d8de03408363 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:51:50.237882 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-ccc50696-0a5f-437d-a78a-d8de03408363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:51:50.273709 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc50696-0a5f-437d-a78a-d8de03408363 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:51:50.366425 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0882245-0e0a-4e4f-99b3-01c5626bdefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:51:50.367073 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0882245-0e0a-4e4f-99b3-01c5626bdefa admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:51:50.367349 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0882245-0e0a-4e4f-99b3-01c5626bdefa admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:51:50.367614 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0882245-0e0a-4e4f-99b3-01c5626bdefa admin admin] PATH_INFO: `/v3/projects/52b586d987b5408d85d3c35b8e50982a/users/ec8ac91b1bf648e1bde0440ae89ec17e/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:51:50.391272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0882245-0e0a-4e4f-99b3-01c5626bdefa admin admin] RBAC: Authorizing `identity:create_grant(project_id=52b586d987b5408d85d3c35b8e50982a, user_id=ec8ac91b1bf648e1bde0440ae89ec17e, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:51:50.392378 dv-cinder-859318-1-smb devstack@keystone.service[81278]: WARNING py.warnings [None req-c0882245-0e0a-4e4f-99b3-01c5626bdefa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 17:51:50.392378 dv-cinder-859318-1-smb devstack@keystone.service[81278]: warnings.warn(msg) Sep 26 17:51:50.392378 dv-cinder-859318-1-smb devstack@keystone.service[81278]: Sep 26 17:51:50.394992 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0882245-0e0a-4e4f-99b3-01c5626bdefa admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:51:50.419593 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 744/1501] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:51:50 2022] PUT /identity/v3/projects/52b586d987b5408d85d3c35b8e50982a/users/ec8ac91b1bf648e1bde0440ae89ec17e/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:51:50.431817 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14570ef2-9759-4274-b5b1-e1053e6b4826 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:51:50.432087 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14570ef2-9759-4274-b5b1-e1053e6b4826 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:51:50.432359 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14570ef2-9759-4274-b5b1-e1053e6b4826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:51:50.488582 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-14570ef2-9759-4274-b5b1-e1053e6b4826 None None] MFA Rules not processed for user `ec8ac91b1bf648e1bde0440ae89ec17e`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:51:50.489732 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-14570ef2-9759-4274-b5b1-e1053e6b4826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:51:50.566200 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 758/1502] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:51:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:51:50.579534 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f565b1-b98e-4ce8-83b7-811546f3ff00 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:51:50.579822 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f565b1-b98e-4ce8-83b7-811546f3ff00 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:51:50.580098 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f565b1-b98e-4ce8-83b7-811546f3ff00 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:51:50.581550 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 745/1503] 10.222.0.62 () {54 vars in 963 bytes} [Mon Sep 26 17:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:51:50.586499 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3784f2-19eb-4256-b7a3-fc1a76312e54 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:51:50.586783 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3784f2-19eb-4256-b7a3-fc1a76312e54 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:51:50.587053 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3784f2-19eb-4256-b7a3-fc1a76312e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:51:50.617985 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:51:50.663056 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-3a3784f2-19eb-4256-b7a3-fc1a76312e54 None None] MFA Rules not processed for user `14b32df88c21499d9ca81e439b129431`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:51:50.664242 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-3a3784f2-19eb-4256-b7a3-fc1a76312e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:51:50.739597 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 759/1504] 10.222.0.62 () {58 vars in 1060 bytes} [Mon Sep 26 17:51:50 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:51:50.747333 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f565b1-b98e-4ce8-83b7-811546f3ff00 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:51:50.748826 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-50f565b1-b98e-4ce8-83b7-811546f3ff00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:51:50.800126 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:51:50.855249 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f565b1-b98e-4ce8-83b7-811546f3ff00 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:51:50.927363 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cf51c-62c9-4e2b-bfb2-c258b193d300 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:51:50.927971 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cf51c-62c9-4e2b-bfb2-c258b193d300 service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:51:50.928251 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cf51c-62c9-4e2b-bfb2-c258b193d300 service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:51:50.928531 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cf51c-62c9-4e2b-bfb2-c258b193d300 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:51:50.930206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-d70cf51c-62c9-4e2b-bfb2-c258b193d300 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:51:51.146638 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70cf51c-62c9-4e2b-bfb2-c258b193d300 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:51:51.147988 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70cf51c-62c9-4e2b-bfb2-c258b193d300 service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:51:51.151489 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:51:51.167101 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 746/1505] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:51:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:51:51.213282 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee92067-7bd7-426e-a365-cdff88179119 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:51:51.213714 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee92067-7bd7-426e-a365-cdff88179119 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:51:51.213826 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee92067-7bd7-426e-a365-cdff88179119 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:51:51.215106 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 760/1506] 10.222.0.62 () {52 vars in 830 bytes} [Mon Sep 26 17:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:51:51.218978 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cf51c-62c9-4e2b-bfb2-c258b193d300 service cinder] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:51:51.220202 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-d70cf51c-62c9-4e2b-bfb2-c258b193d300 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:51:51.317553 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cf51c-62c9-4e2b-bfb2-c258b193d300 service cinder] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:51:51.409573 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56379439-87a4-4116-981f-e55acae4b285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:51:51.410123 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56379439-87a4-4116-981f-e55acae4b285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:51:51.410397 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56379439-87a4-4116-981f-e55acae4b285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:51:51.410662 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56379439-87a4-4116-981f-e55acae4b285 admin admin] PATH_INFO: `/v3/users/ec8ac91b1bf648e1bde0440ae89ec17e` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:51:51.423420 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56379439-87a4-4116-981f-e55acae4b285 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec8ac91b1bf648e1bde0440ae89ec17e)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:51:51.424426 dv-cinder-859318-1-smb devstack@keystone.service[81278]: WARNING py.warnings [None req-56379439-87a4-4116-981f-e55acae4b285 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 17:51:51.424426 dv-cinder-859318-1-smb devstack@keystone.service[81278]: warnings.warn(msg) Sep 26 17:51:51.424426 dv-cinder-859318-1-smb devstack@keystone.service[81278]: Sep 26 17:51:51.426174 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56379439-87a4-4116-981f-e55acae4b285 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:51:51.435800 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:51:51.490790 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-56379439-87a4-4116-981f-e55acae4b285 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec8ac91b1bf648e1bde0440ae89ec17e'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:51:51.491216 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-56379439-87a4-4116-981f-e55acae4b285 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec8ac91b1bf648e1bde0440ae89ec17e'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:51:51.491739 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-56379439-87a4-4116-981f-e55acae4b285 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec8ac91b1bf648e1bde0440ae89ec17e'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:51:51.506179 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-56379439-87a4-4116-981f-e55acae4b285 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec8ac91b1bf648e1bde0440ae89ec17e'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:51:51.515354 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-56379439-87a4-4116-981f-e55acae4b285 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec8ac91b1bf648e1bde0440ae89ec17e'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:51:51.543024 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 747/1507] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:51:51 2022] DELETE /identity/v3/users/ec8ac91b1bf648e1bde0440ae89ec17e => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:51:51.547452 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638c372-6765-447d-b612-90bde46b81a5 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:51:51.547744 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638c372-6765-447d-b612-90bde46b81a5 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:51:51.548025 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638c372-6765-447d-b612-90bde46b81a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:51:51.606371 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-4638c372-6765-447d-b612-90bde46b81a5 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:51:51.607597 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-4638c372-6765-447d-b612-90bde46b81a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:51:51.683396 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:51:51.695926 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 761/1508] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:51:51.705651 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56379439-87a4-4116-981f-e55acae4b285 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:51:51.706862 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-56379439-87a4-4116-981f-e55acae4b285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:51:51.808639 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56379439-87a4-4116-981f-e55acae4b285 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:51:51.863370 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:51:51.883722 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b03b5-5fdc-4769-ac0e-348d5ea9cc88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:51:51.884325 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b03b5-5fdc-4769-ac0e-348d5ea9cc88 service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:51:51.884601 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b03b5-5fdc-4769-ac0e-348d5ea9cc88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:51:51.884874 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b03b5-5fdc-4769-ac0e-348d5ea9cc88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:51:51.886482 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-cb5b03b5-5fdc-4769-ac0e-348d5ea9cc88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:51:52.004831 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5b03b5-5fdc-4769-ac0e-348d5ea9cc88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:51:52.006218 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5b03b5-5fdc-4769-ac0e-348d5ea9cc88 service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:51:52.025407 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 748/1509] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:51:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:51:52.423046 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4638c372-6765-447d-b612-90bde46b81a5 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:51:52.424420 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-4638c372-6765-447d-b612-90bde46b81a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:51:52.436071 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4638c372-6765-447d-b612-90bde46b81a5 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:51:52.534333 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f80dad-bead-4148-b3b6-2372e8faa70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:51:52.534991 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f80dad-bead-4148-b3b6-2372e8faa70c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:51:52.535267 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f80dad-bead-4148-b3b6-2372e8faa70c admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:51:52.535535 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f80dad-bead-4148-b3b6-2372e8faa70c admin admin] PATH_INFO: `/v3/projects/52b586d987b5408d85d3c35b8e50982a` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:51:52.545891 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f80dad-bead-4148-b3b6-2372e8faa70c admin admin] RBAC: Authorizing `identity:delete_project(project_id=52b586d987b5408d85d3c35b8e50982a)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:51:52.546875 dv-cinder-859318-1-smb devstack@keystone.service[81277]: WARNING py.warnings [None req-79f80dad-bead-4148-b3b6-2372e8faa70c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 17:51:52.546875 dv-cinder-859318-1-smb devstack@keystone.service[81277]: warnings.warn(msg) Sep 26 17:51:52.546875 dv-cinder-859318-1-smb devstack@keystone.service[81277]: Sep 26 17:51:52.548086 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f80dad-bead-4148-b3b6-2372e8faa70c admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:51:52.605718 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-79f80dad-bead-4148-b3b6-2372e8faa70c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52b586d987b5408d85d3c35b8e50982a', 'request_id': 'req-79f80dad-bead-4148-b3b6-2372e8faa70c'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:51:52.611629 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-79f80dad-bead-4148-b3b6-2372e8faa70c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52b586d987b5408d85d3c35b8e50982a', 'request_id': 'req-79f80dad-bead-4148-b3b6-2372e8faa70c'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:51:52.620910 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-79f80dad-bead-4148-b3b6-2372e8faa70c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52b586d987b5408d85d3c35b8e50982a', 'request_id': 'req-79f80dad-bead-4148-b3b6-2372e8faa70c'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:51:52.651721 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-79f80dad-bead-4148-b3b6-2372e8faa70c admin admin] The token cache is being invalidate because project 52b586d987b5408d85d3c35b8e50982a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:51:52.652009 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-79f80dad-bead-4148-b3b6-2372e8faa70c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:51:52.652433 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-79f80dad-bead-4148-b3b6-2372e8faa70c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:51:52.653954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 762/1510] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:51:52 2022] DELETE /identity/v3/projects/52b586d987b5408d85d3c35b8e50982a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:52:02.023070 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=62 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:52:02.649809 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:53:36.420502 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579ca56-041f-4ff8-9542-37b8b2e27c84 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:53:36.421097 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579ca56-041f-4ff8-9542-37b8b2e27c84 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:53:36.421097 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579ca56-041f-4ff8-9542-37b8b2e27c84 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:53:36.422425 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 749/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 17:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:53:36.427638 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f4216-dbbb-4d2a-9ad4-4cae4971fee0 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:53:36.428195 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f4216-dbbb-4d2a-9ad4-4cae4971fee0 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:53:36.428195 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f4216-dbbb-4d2a-9ad4-4cae4971fee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:53:36.521407 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-972f4216-dbbb-4d2a-9ad4-4cae4971fee0 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:53:36.522638 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-972f4216-dbbb-4d2a-9ad4-4cae4971fee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:53:36.636629 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 763/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 17:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:53:36.789274 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579ca56-041f-4ff8-9542-37b8b2e27c84 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:53:36.791516 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-8579ca56-041f-4ff8-9542-37b8b2e27c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:53:36.912150 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579ca56-041f-4ff8-9542-37b8b2e27c84 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:53:36.919763 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02c3d3-77db-4d2b-8056-2de6b65cc84d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:53:36.920384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02c3d3-77db-4d2b-8056-2de6b65cc84d service nova] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:53:36.920664 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02c3d3-77db-4d2b-8056-2de6b65cc84d service nova] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:53:36.920938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02c3d3-77db-4d2b-8056-2de6b65cc84d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:53:36.929751 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02c3d3-77db-4d2b-8056-2de6b65cc84d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:53:36.931344 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02c3d3-77db-4d2b-8056-2de6b65cc84d service nova] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:53:36.940593 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 750/1513] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:53:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:53:37.817485 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2bdd6-4b43-49a5-a8ed-663128e5bf53 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:53:37.818251 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2bdd6-4b43-49a5-a8ed-663128e5bf53 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:53:37.818251 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2bdd6-4b43-49a5-a8ed-663128e5bf53 None None] PATH_INFO: `/v3` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:53:37.819404 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 764/1514] 10.222.0.97 () {54 vars in 925 bytes} [Mon Sep 26 17:53:37 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:53:37.825693 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd67619-9d18-4b2e-a224-b9267ae0bc14 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:53:37.826164 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd67619-9d18-4b2e-a224-b9267ae0bc14 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:53:37.826273 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd67619-9d18-4b2e-a224-b9267ae0bc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:53:37.888168 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-2dd67619-9d18-4b2e-a224-b9267ae0bc14 None None] MFA Rules not processed for user `f5043d835c08458c9f3911a4741bdaa8`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:53:37.889421 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-2dd67619-9d18-4b2e-a224-b9267ae0bc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:53:37.957535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:53:37.963872 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 751/1515] 10.222.0.97 () {58 vars in 1015 bytes} [Mon Sep 26 17:53:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:53:38.035250 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1c4d6-c882-4f85-a334-bdd8914e0f41 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:53:38.035538 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1c4d6-c882-4f85-a334-bdd8914e0f41 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:53:38.035812 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1c4d6-c882-4f85-a334-bdd8914e0f41 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:53:38.037226 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 765/1516] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 17:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:53:38.043272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad30c01-8f6a-4986-a584-10f4364d24ff None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:53:38.043560 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad30c01-8f6a-4986-a584-10f4364d24ff None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:53:38.043884 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad30c01-8f6a-4986-a584-10f4364d24ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:53:38.063620 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-6ad30c01-8f6a-4986-a584-10f4364d24ff None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:53:38.064827 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-6ad30c01-8f6a-4986-a584-10f4364d24ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:53:38.073445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 752/1517] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 17:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:53:38.226426 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1c4d6-c882-4f85-a334-bdd8914e0f41 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:53:38.241516 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1c4d6-c882-4f85-a334-bdd8914e0f41 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:53:38.246921 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35125ac1-9d04-4cd4-b1f7-4f83478731fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:53:38.247516 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35125ac1-9d04-4cd4-b1f7-4f83478731fa service nova] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:53:38.247798 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35125ac1-9d04-4cd4-b1f7-4f83478731fa service nova] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:53:38.248072 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35125ac1-9d04-4cd4-b1f7-4f83478731fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:53:38.256218 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35125ac1-9d04-4cd4-b1f7-4f83478731fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:53:38.257840 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35125ac1-9d04-4cd4-b1f7-4f83478731fa service nova] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:53:38.267134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 766/1518] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:53:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:53:41.593727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8af99-106d-4e7c-ad77-5063252d1bf3 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:53:41.594206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8af99-106d-4e7c-ad77-5063252d1bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:53:41.594311 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8af99-106d-4e7c-ad77-5063252d1bf3 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:53:41.595621 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 753/1519] 10.222.0.62 () {54 vars in 961 bytes} [Mon Sep 26 17:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 17:53:41.600717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a35dd3-d6ea-4083-98bc-6cb00205accf None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:53:41.601195 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a35dd3-d6ea-4083-98bc-6cb00205accf None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:53:41.601339 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a35dd3-d6ea-4083-98bc-6cb00205accf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:53:41.621687 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-12a35dd3-d6ea-4083-98bc-6cb00205accf None None] MFA Rules not processed for user `f5043d835c08458c9f3911a4741bdaa8`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:53:41.622892 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-12a35dd3-d6ea-4083-98bc-6cb00205accf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:53:41.632422 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 767/1520] 10.222.0.62 () {58 vars in 1058 bytes} [Mon Sep 26 17:53:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:53:41.642428 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8af99-106d-4e7c-ad77-5063252d1bf3 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:53:41.657800 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8af99-106d-4e7c-ad77-5063252d1bf3 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:53:41.663095 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed4e8c-91e8-4644-8bac-da91582afd92 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5043d835c08458c9f3911a4741bdaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:53:41.663687 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed4e8c-91e8-4644-8bac-da91582afd92 service placement] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:53:41.663966 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed4e8c-91e8-4644-8bac-da91582afd92 service placement] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:53:41.664238 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed4e8c-91e8-4644-8bac-da91582afd92 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:53:41.672957 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ed4e8c-91e8-4644-8bac-da91582afd92 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:53:41.674597 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ed4e8c-91e8-4644-8bac-da91582afd92 service placement] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:53:41.685761 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 754/1521] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:53:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:53:49.759131 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c595d5a-cd0e-481b-89de-01b2b1cf6eed None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:53:49.759723 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c595d5a-cd0e-481b-89de-01b2b1cf6eed None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:53:49.759723 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c595d5a-cd0e-481b-89de-01b2b1cf6eed None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:53:49.760998 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 768/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 17:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:53:49.767143 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dccabd-4492-4066-afb0-a7c3d838b79a None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:53:49.767560 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dccabd-4492-4066-afb0-a7c3d838b79a None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:53:49.767687 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dccabd-4492-4066-afb0-a7c3d838b79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:53:49.787685 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-06dccabd-4492-4066-afb0-a7c3d838b79a None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:53:49.788867 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-06dccabd-4492-4066-afb0-a7c3d838b79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:53:49.796605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 755/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 17:53:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:53:49.950859 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c595d5a-cd0e-481b-89de-01b2b1cf6eed None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:53:49.966550 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c595d5a-cd0e-481b-89de-01b2b1cf6eed None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:53:49.971809 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8cf0b-5346-4e1e-95a8-5813b266511a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:53:49.972399 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8cf0b-5346-4e1e-95a8-5813b266511a service nova] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:53:49.973358 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8cf0b-5346-4e1e-95a8-5813b266511a service nova] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:53:49.974132 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8cf0b-5346-4e1e-95a8-5813b266511a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:53:49.984049 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8cf0b-5346-4e1e-95a8-5813b266511a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:53:49.985723 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8cf0b-5346-4e1e-95a8-5813b266511a service nova] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:53:49.996218 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 769/1524] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:53:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:53:51.053685 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315ffda-e7a4-4bb3-990c-f92057c352c9 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:53:51.054278 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315ffda-e7a4-4bb3-990c-f92057c352c9 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:53:51.054278 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315ffda-e7a4-4bb3-990c-f92057c352c9 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:53:51.055616 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 756/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 17:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:53:51.061849 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85cee9-d81d-4173-8629-26b04ec2cbe5 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:53:51.062304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85cee9-d81d-4173-8629-26b04ec2cbe5 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:53:51.062413 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85cee9-d81d-4173-8629-26b04ec2cbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:53:51.081637 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-ea85cee9-d81d-4173-8629-26b04ec2cbe5 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:53:51.083371 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-ea85cee9-d81d-4173-8629-26b04ec2cbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:53:51.091408 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 770/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 17:53:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:53:51.243412 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315ffda-e7a4-4bb3-990c-f92057c352c9 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:53:51.258450 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315ffda-e7a4-4bb3-990c-f92057c352c9 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:53:51.263867 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f9ea4-f1fe-42ce-b46c-6cfbf82bdcc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:53:51.264450 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f9ea4-f1fe-42ce-b46c-6cfbf82bdcc7 service nova] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:53:51.264728 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f9ea4-f1fe-42ce-b46c-6cfbf82bdcc7 service nova] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:53:51.264999 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f9ea4-f1fe-42ce-b46c-6cfbf82bdcc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:53:51.273166 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f9ea4-f1fe-42ce-b46c-6cfbf82bdcc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:53:51.274741 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f9ea4-f1fe-42ce-b46c-6cfbf82bdcc7 service nova] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:53:51.284138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 757/1527] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:53:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:53:55.302662 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34c537-e885-451f-8ae6-482b6eacdae5 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:53:55.303232 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34c537-e885-451f-8ae6-482b6eacdae5 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:53:55.303232 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34c537-e885-451f-8ae6-482b6eacdae5 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:53:55.304583 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 771/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 17:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:53:55.309710 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9bd145-cd9e-45a3-bee1-fc650865185a None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:53:55.310125 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9bd145-cd9e-45a3-bee1-fc650865185a None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:53:55.310253 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9bd145-cd9e-45a3-bee1-fc650865185a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:53:55.329697 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-ca9bd145-cd9e-45a3-bee1-fc650865185a None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:53:55.330879 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-ca9bd145-cd9e-45a3-bee1-fc650865185a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:53:55.338773 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 758/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 17:53:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:53:55.623733 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34c537-e885-451f-8ae6-482b6eacdae5 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:53:55.625508 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-2f34c537-e885-451f-8ae6-482b6eacdae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:53:55.657619 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:53:55.703011 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34c537-e885-451f-8ae6-482b6eacdae5 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:53:55.706547 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a74368-29bb-49dc-ada7-8fbf96ee9301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:53:55.707733 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a74368-29bb-49dc-ada7-8fbf96ee9301 service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:53:55.707733 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a74368-29bb-49dc-ada7-8fbf96ee9301 service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:53:55.707733 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a74368-29bb-49dc-ada7-8fbf96ee9301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:53:55.716936 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a74368-29bb-49dc-ada7-8fbf96ee9301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:53:55.718438 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a74368-29bb-49dc-ada7-8fbf96ee9301 service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:53:55.728457 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 772/1530] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:53:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:53:57.901598 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c0dde-669c-4a4a-b11c-e0cc270869e0 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:53:57.902178 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c0dde-669c-4a4a-b11c-e0cc270869e0 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:53:57.902178 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c0dde-669c-4a4a-b11c-e0cc270869e0 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:53:57.903489 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 759/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 17:53:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:53:57.908823 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50621a09-8b3c-40ef-9af7-256df54f8fea None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:53:57.909304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50621a09-8b3c-40ef-9af7-256df54f8fea None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:53:57.909403 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50621a09-8b3c-40ef-9af7-256df54f8fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:53:57.928978 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-50621a09-8b3c-40ef-9af7-256df54f8fea None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:53:57.930205 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-50621a09-8b3c-40ef-9af7-256df54f8fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:53:57.938044 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 773/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 17:53:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:53:58.222733 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c0dde-669c-4a4a-b11c-e0cc270869e0 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:53:58.233256 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c0dde-669c-4a4a-b11c-e0cc270869e0 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:53:58.236716 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95191ddb-95ff-4fc6-9cf7-2ca405cf0204 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:53:58.237330 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95191ddb-95ff-4fc6-9cf7-2ca405cf0204 service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:53:58.237611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95191ddb-95ff-4fc6-9cf7-2ca405cf0204 service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:53:58.238403 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95191ddb-95ff-4fc6-9cf7-2ca405cf0204 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:53:58.246937 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95191ddb-95ff-4fc6-9cf7-2ca405cf0204 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:53:58.248355 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95191ddb-95ff-4fc6-9cf7-2ca405cf0204 service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:53:58.258028 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 760/1533] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:53:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:54:02.203403 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c789b-ca1d-4596-a578-4d501b4e1691 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:54:02.203979 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c789b-ca1d-4596-a578-4d501b4e1691 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:54:02.203979 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c789b-ca1d-4596-a578-4d501b4e1691 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:54:02.205331 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 774/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 17:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:54:02.210493 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2ecbf-fb20-4fce-b23c-d18703636744 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:54:02.210938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2ecbf-fb20-4fce-b23c-d18703636744 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:54:02.211043 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2ecbf-fb20-4fce-b23c-d18703636744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:54:02.231320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-6ac2ecbf-fb20-4fce-b23c-d18703636744 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:54:02.232525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-6ac2ecbf-fb20-4fce-b23c-d18703636744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:54:02.241387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 761/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 17:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:54:02.549071 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c789b-ca1d-4596-a578-4d501b4e1691 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:54:02.550755 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-094c789b-ca1d-4596-a578-4d501b4e1691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:54:02.627959 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c789b-ca1d-4596-a578-4d501b4e1691 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:54:02.632177 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261d2b4-b257-49d4-b3e0-f27f0020737f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:54:02.632720 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261d2b4-b257-49d4-b3e0-f27f0020737f service cinder] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:54:02.633001 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261d2b4-b257-49d4-b3e0-f27f0020737f service cinder] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:54:02.633305 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261d2b4-b257-49d4-b3e0-f27f0020737f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:54:02.642494 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261d2b4-b257-49d4-b3e0-f27f0020737f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:54:02.643948 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261d2b4-b257-49d4-b3e0-f27f0020737f service cinder] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:54:02.653117 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 775/1536] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:54:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:54:04.783628 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfe4ff-708e-4be5-b4a1-3e2803dc3b98 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:54:04.784237 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfe4ff-708e-4be5-b4a1-3e2803dc3b98 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:54:04.784237 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfe4ff-708e-4be5-b4a1-3e2803dc3b98 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:54:04.786082 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 762/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 17:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:54:04.791405 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3abda-5665-44a7-8876-f1acc5d0ce22 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:54:04.791850 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3abda-5665-44a7-8876-f1acc5d0ce22 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:54:04.791955 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3abda-5665-44a7-8876-f1acc5d0ce22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:54:04.811691 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-8af3abda-5665-44a7-8876-f1acc5d0ce22 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:54:04.812892 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-8af3abda-5665-44a7-8876-f1acc5d0ce22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:54:04.820746 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 776/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 17:54:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:54:05.124004 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcfe4ff-708e-4be5-b4a1-3e2803dc3b98 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:54:05.125718 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-7dcfe4ff-708e-4be5-b4a1-3e2803dc3b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:54:05.138796 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcfe4ff-708e-4be5-b4a1-3e2803dc3b98 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:54:05.142373 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa49a41-e320-4ddf-8089-d97cc44c73d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:54:05.142961 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa49a41-e320-4ddf-8089-d97cc44c73d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:54:05.143240 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa49a41-e320-4ddf-8089-d97cc44c73d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:54:05.143538 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa49a41-e320-4ddf-8089-d97cc44c73d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:54:05.152561 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa49a41-e320-4ddf-8089-d97cc44c73d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:54:05.154052 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa49a41-e320-4ddf-8089-d97cc44c73d1 service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:54:05.163877 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 763/1539] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:54:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:54:14.806763 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=63 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:54:15.160048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=37 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:42.024314 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548cfa9f-06ec-4c4c-9082-e26e32935f85 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:42.026019 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548cfa9f-06ec-4c4c-9082-e26e32935f85 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:42.026019 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548cfa9f-06ec-4c4c-9082-e26e32935f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:42.041653 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d70898-b1d3-4d63-8812-c8ca47f58c14 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:42.042673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d70898-b1d3-4d63-8812-c8ca47f58c14 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:42.043310 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d70898-b1d3-4d63-8812-c8ca47f58c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:42.053874 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-548cfa9f-06ec-4c4c-9082-e26e32935f85 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:42.055295 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-548cfa9f-06ec-4c4c-9082-e26e32935f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:42.066265 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 777/1540] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:42.075705 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a68b1b-53bc-4c0b-848c-a5f7c994ea9f None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:42.076024 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a68b1b-53bc-4c0b-848c-a5f7c994ea9f None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:42.076270 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a68b1b-53bc-4c0b-848c-a5f7c994ea9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:42.084418 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-f4d70898-b1d3-4d63-8812-c8ca47f58c14 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:42.086173 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-f4d70898-b1d3-4d63-8812-c8ca47f58c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:42.105391 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 764/1541] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:55:42.108889 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-e0a68b1b-53bc-4c0b-848c-a5f7c994ea9f None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:42.114455 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-e0a68b1b-53bc-4c0b-848c-a5f7c994ea9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:42.116158 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3884c11-6959-4592-8e13-8137c13a17bf None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:42.116684 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3884c11-6959-4592-8e13-8137c13a17bf None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:42.117197 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3884c11-6959-4592-8e13-8137c13a17bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:42.131228 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 778/1542] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:42.136622 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a68b1b-53bc-4c0b-848c-a5f7c994ea9f None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:42.152227 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-f3884c11-6959-4592-8e13-8137c13a17bf None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:42.153787 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-f3884c11-6959-4592-8e13-8137c13a17bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:42.160627 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a68b1b-53bc-4c0b-848c-a5f7c994ea9f None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:42.172413 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 765/1543] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:42.176979 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162584be-54e8-454f-8d99-8ba258714f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:42.178064 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162584be-54e8-454f-8d99-8ba258714f61 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:42.178549 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162584be-54e8-454f-8d99-8ba258714f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:42.179030 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162584be-54e8-454f-8d99-8ba258714f61 admin admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:42.179909 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162584be-54e8-454f-8d99-8ba258714f61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:55:42.180419 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162584be-54e8-454f-8d99-8ba258714f61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:42.182328 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162584be-54e8-454f-8d99-8ba258714f61 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:42.194970 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3884c11-6959-4592-8e13-8137c13a17bf None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:42.205917 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3884c11-6959-4592-8e13-8137c13a17bf None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:42.211528 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 779/1544] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:55:42.213818 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e09ce-8889-4d5b-a0dc-a839851abd4c None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:42.214798 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e09ce-8889-4d5b-a0dc-a839851abd4c None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:42.216766 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e09ce-8889-4d5b-a0dc-a839851abd4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:42.219017 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048eadcd-3e85-40f1-a01a-0081ba068cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:42.222071 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048eadcd-3e85-40f1-a01a-0081ba068cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:42.222571 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048eadcd-3e85-40f1-a01a-0081ba068cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:42.223051 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048eadcd-3e85-40f1-a01a-0081ba068cf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:42.223902 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048eadcd-3e85-40f1-a01a-0081ba068cf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:55:42.224398 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048eadcd-3e85-40f1-a01a-0081ba068cf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:42.226042 dv-cinder-859318-1-smb devstack@keystone.service[81278]: WARNING py.warnings [None req-048eadcd-3e85-40f1-a01a-0081ba068cf5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 26 17:55:42.226042 dv-cinder-859318-1-smb devstack@keystone.service[81278]: warnings.warn(msg) Sep 26 17:55:42.226042 dv-cinder-859318-1-smb devstack@keystone.service[81278]: Sep 26 17:55:42.227891 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048eadcd-3e85-40f1-a01a-0081ba068cf5 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:42.253645 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 766/1545] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:55:42.256410 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffceb5-83e3-4b6c-9efd-d108fc834921 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:42.257899 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffceb5-83e3-4b6c-9efd-d108fc834921 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:42.258322 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffceb5-83e3-4b6c-9efd-d108fc834921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:42.265268 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-405e09ce-8889-4d5b-a0dc-a839851abd4c None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:42.265268 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-405e09ce-8889-4d5b-a0dc-a839851abd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:42.278884 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 780/1546] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:42.279702 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e09ce-8889-4d5b-a0dc-a839851abd4c None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:42.288321 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-1cffceb5-83e3-4b6c-9efd-d108fc834921 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:42.289563 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-1cffceb5-83e3-4b6c-9efd-d108fc834921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:42.296912 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e09ce-8889-4d5b-a0dc-a839851abd4c None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:42.298605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 767/1547] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:42.300623 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385fafd-9a77-4bbf-95ed-8fc162fb5773 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:42.301911 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385fafd-9a77-4bbf-95ed-8fc162fb5773 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:42.302340 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385fafd-9a77-4bbf-95ed-8fc162fb5773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:42.309170 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf338c9-2fb2-4929-b595-86ac594690aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:42.310074 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf338c9-2fb2-4929-b595-86ac594690aa admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:42.310575 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf338c9-2fb2-4929-b595-86ac594690aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:42.311080 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf338c9-2fb2-4929-b595-86ac594690aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:42.312170 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf338c9-2fb2-4929-b595-86ac594690aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:42.313837 dv-cinder-859318-1-smb devstack@keystone.service[81277]: WARNING py.warnings [None req-faf338c9-2fb2-4929-b595-86ac594690aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 17:55:42.313837 dv-cinder-859318-1-smb devstack@keystone.service[81277]: warnings.warn(msg) Sep 26 17:55:42.313837 dv-cinder-859318-1-smb devstack@keystone.service[81277]: Sep 26 17:55:42.315708 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf338c9-2fb2-4929-b595-86ac594690aa admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:42.325793 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-6385fafd-9a77-4bbf-95ed-8fc162fb5773 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:42.327157 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-6385fafd-9a77-4bbf-95ed-8fc162fb5773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:42.335167 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 768/1548] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:42.336114 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385fafd-9a77-4bbf-95ed-8fc162fb5773 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:42.354442 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385fafd-9a77-4bbf-95ed-8fc162fb5773 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:42.359992 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 781/1549] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:55:42 2022] POST /identity/v3/projects => generated 389 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:55:42.360155 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536d9eb-fa7d-4822-a2d4-0fc4ae649217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:42.360527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536d9eb-fa7d-4822-a2d4-0fc4ae649217 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:42.360805 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536d9eb-fa7d-4822-a2d4-0fc4ae649217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:42.361125 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536d9eb-fa7d-4822-a2d4-0fc4ae649217 admin admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:42.361266 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd825462-0213-4a1c-945e-1788763d5f65 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:42.361484 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd825462-0213-4a1c-945e-1788763d5f65 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:42.361723 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd825462-0213-4a1c-945e-1788763d5f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:42.361840 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f536d9eb-fa7d-4822-a2d4-0fc4ae649217 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:42.363925 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f536d9eb-fa7d-4822-a2d4-0fc4ae649217 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:42.387829 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-bd825462-0213-4a1c-945e-1788763d5f65 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:42.389038 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-bd825462-0213-4a1c-945e-1788763d5f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:42.399412 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 769/1550] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:55:42 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:55:42.400670 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee588985-05f1-4c4a-adef-2edab0422462 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:42.400956 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee588985-05f1-4c4a-adef-2edab0422462 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:42.401263 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee588985-05f1-4c4a-adef-2edab0422462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:42.421706 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-ee588985-05f1-4c4a-adef-2edab0422462 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:42.422908 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-ee588985-05f1-4c4a-adef-2edab0422462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:42.452825 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 782/1551] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:42.454579 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b0a3f-4536-4df3-84a0-69cf0423927a None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:42.454579 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b0a3f-4536-4df3-84a0-69cf0423927a None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:42.454794 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b0a3f-4536-4df3-84a0-69cf0423927a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:42.475129 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-936b0a3f-4536-4df3-84a0-69cf0423927a None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:42.476288 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-936b0a3f-4536-4df3-84a0-69cf0423927a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:42.484836 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 770/1552] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:42.486005 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501259e9-9b07-4639-b449-a0b31756f753 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:42.486300 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501259e9-9b07-4639-b449-a0b31756f753 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:42.486568 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501259e9-9b07-4639-b449-a0b31756f753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:42.508615 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-501259e9-9b07-4639-b449-a0b31756f753 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:42.509841 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-501259e9-9b07-4639-b449-a0b31756f753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:42.517749 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 771/1553] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:42.518936 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd4666-cc87-4728-bb0a-1085a1bcc1c8 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:42.519216 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd4666-cc87-4728-bb0a-1085a1bcc1c8 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:42.519483 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd4666-cc87-4728-bb0a-1085a1bcc1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:42.539111 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-45fd4666-cc87-4728-bb0a-1085a1bcc1c8 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:42.540321 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-45fd4666-cc87-4728-bb0a-1085a1bcc1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:42.548452 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 783/1554] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:42.549303 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b0a3f-4536-4df3-84a0-69cf0423927a None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:42.549732 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 772/1555] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:42.551013 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1d7bf-0763-47c7-9def-a085ed51afc2 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:42.551260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1d7bf-0763-47c7-9def-a085ed51afc2 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:42.551529 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1d7bf-0763-47c7-9def-a085ed51afc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:42.560416 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b0a3f-4536-4df3-84a0-69cf0423927a None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:42.565350 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de866bc-0f0a-428e-b83f-e41804f87e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:42.565938 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de866bc-0f0a-428e-b83f-e41804f87e5f admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:42.566201 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de866bc-0f0a-428e-b83f-e41804f87e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:42.566465 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de866bc-0f0a-428e-b83f-e41804f87e5f admin admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:42.567087 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de866bc-0f0a-428e-b83f-e41804f87e5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:42.569038 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de866bc-0f0a-428e-b83f-e41804f87e5f admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:42.571297 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-c3a1d7bf-0763-47c7-9def-a085ed51afc2 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:42.572489 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-c3a1d7bf-0763-47c7-9def-a085ed51afc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:42.580619 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 773/1556] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:42.581447 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1d7bf-0763-47c7-9def-a085ed51afc2 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:42.592925 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1d7bf-0763-47c7-9def-a085ed51afc2 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:42.598739 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 784/1557] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:55:42 2022] POST /identity/v3/users => generated 295 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:55:42.598739 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de866bc-0f0a-428e-b83f-e41804f87e5f admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:42.599789 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfce876-622b-4e9e-838c-d8f35c983a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:42.600423 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfce876-622b-4e9e-838c-d8f35c983a43 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:42.600704 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfce876-622b-4e9e-838c-d8f35c983a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:42.600974 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfce876-622b-4e9e-838c-d8f35c983a43 admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:42.601633 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfce876-622b-4e9e-838c-d8f35c983a43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:42.602653 dv-cinder-859318-1-smb devstack@keystone.service[81278]: WARNING py.warnings [None req-8cfce876-622b-4e9e-838c-d8f35c983a43 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 17:55:42.602653 dv-cinder-859318-1-smb devstack@keystone.service[81278]: warnings.warn(msg) Sep 26 17:55:42.602653 dv-cinder-859318-1-smb devstack@keystone.service[81278]: Sep 26 17:55:42.603858 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfce876-622b-4e9e-838c-d8f35c983a43 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:42.608062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de866bc-0f0a-428e-b83f-e41804f87e5f admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:42.613889 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68aaf8-fd9e-4de7-bb77-e6a843feeb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:42.614978 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68aaf8-fd9e-4de7-bb77-e6a843feeb60 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:42.614978 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68aaf8-fd9e-4de7-bb77-e6a843feeb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:42.615752 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68aaf8-fd9e-4de7-bb77-e6a843feeb60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:42.616696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68aaf8-fd9e-4de7-bb77-e6a843feeb60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:55:42.617186 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68aaf8-fd9e-4de7-bb77-e6a843feeb60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:42.619763 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68aaf8-fd9e-4de7-bb77-e6a843feeb60 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:42.626794 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 774/1558] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:55:42 2022] POST /identity/v3/users => generated 287 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:55:42.628149 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4127f-c464-42cd-b652-6615b26700d2 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:42.628437 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4127f-c464-42cd-b652-6615b26700d2 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:42.628711 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4127f-c464-42cd-b652-6615b26700d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:42.633269 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 785/1559] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:55:42.635041 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89de71-533c-49d9-8f0b-6cd633304fa4 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:42.635546 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89de71-533c-49d9-8f0b-6cd633304fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:42.636032 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89de71-533c-49d9-8f0b-6cd633304fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:42.649354 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-7cc4127f-c464-42cd-b652-6615b26700d2 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:42.650564 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-7cc4127f-c464-42cd-b652-6615b26700d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:42.651703 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:42.659991 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 775/1560] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:42.660173 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-ea89de71-533c-49d9-8f0b-6cd633304fa4 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:42.660867 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc4127f-c464-42cd-b652-6615b26700d2 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:42.661989 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-ea89de71-533c-49d9-8f0b-6cd633304fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:42.670457 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc4127f-c464-42cd-b652-6615b26700d2 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:42.675810 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 786/1561] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:42.675810 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89de71-533c-49d9-8f0b-6cd633304fa4 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:42.676059 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30f912-b112-4ba9-9f42-6e1e8d9f8d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:42.676299 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30f912-b112-4ba9-9f42-6e1e8d9f8d62 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:42.676587 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30f912-b112-4ba9-9f42-6e1e8d9f8d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:42.676855 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30f912-b112-4ba9-9f42-6e1e8d9f8d62 admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:42.677549 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30f912-b112-4ba9-9f42-6e1e8d9f8d62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:55:42.677853 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30f912-b112-4ba9-9f42-6e1e8d9f8d62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:42.679461 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30f912-b112-4ba9-9f42-6e1e8d9f8d62 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:42.683576 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89de71-533c-49d9-8f0b-6cd633304fa4 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:42.688260 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7c0e3-e42b-473c-a626-651446fc49b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:42.688851 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7c0e3-e42b-473c-a626-651446fc49b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:42.689173 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7c0e3-e42b-473c-a626-651446fc49b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:42.689444 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7c0e3-e42b-473c-a626-651446fc49b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:42.690113 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7c0e3-e42b-473c-a626-651446fc49b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:55:42.690416 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7c0e3-e42b-473c-a626-651446fc49b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:42.691195 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 776/1562] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:55:42.691999 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7c0e3-e42b-473c-a626-651446fc49b3 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:42.692449 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85dbf7-8401-4e13-830a-198eed17829c None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:42.692744 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85dbf7-8401-4e13-830a-198eed17829c None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:42.693049 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85dbf7-8401-4e13-830a-198eed17829c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:42.709586 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 787/1563] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:55:42.710191 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7c0e3-e42b-473c-a626-651446fc49b3 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:42.712832 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-ac85dbf7-8401-4e13-830a-198eed17829c None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:42.714065 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-ac85dbf7-8401-4e13-830a-198eed17829c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:42.721201 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7c0e3-e42b-473c-a626-651446fc49b3 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:42.722649 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 777/1564] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:42.723498 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85dbf7-8401-4e13-830a-198eed17829c None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:42.729205 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d57a1-2c0f-4564-a0ee-1dcdde1fa6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:42.729806 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d57a1-2c0f-4564-a0ee-1dcdde1fa6a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:42.730090 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d57a1-2c0f-4564-a0ee-1dcdde1fa6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:42.730364 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d57a1-2c0f-4564-a0ee-1dcdde1fa6a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:42.731007 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d57a1-2c0f-4564-a0ee-1dcdde1fa6a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:42.732650 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d57a1-2c0f-4564-a0ee-1dcdde1fa6a1 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:42.732813 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85dbf7-8401-4e13-830a-198eed17829c None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:42.737459 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba21da2-2cf3-4f43-99b8-3d318c687f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:42.738042 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba21da2-2cf3-4f43-99b8-3d318c687f5b admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:42.738321 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba21da2-2cf3-4f43-99b8-3d318c687f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:42.738591 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba21da2-2cf3-4f43-99b8-3d318c687f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:42.739223 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba21da2-2cf3-4f43-99b8-3d318c687f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:42.740872 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba21da2-2cf3-4f43-99b8-3d318c687f5b admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:42.743468 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 788/1565] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:55:42.744253 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d57a1-2c0f-4564-a0ee-1dcdde1fa6a1 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:42.751255 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 778/1566] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:55:42.754341 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba21da2-2cf3-4f43-99b8-3d318c687f5b admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:42.757067 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d57a1-2c0f-4564-a0ee-1dcdde1fa6a1 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:42.762169 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ecb24-713d-4d9b-a0d1-7befb8b3d827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:42.762337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba21da2-2cf3-4f43-99b8-3d318c687f5b admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:42.762765 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ecb24-713d-4d9b-a0d1-7befb8b3d827 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:42.763044 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ecb24-713d-4d9b-a0d1-7befb8b3d827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:42.763322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ecb24-713d-4d9b-a0d1-7befb8b3d827 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:42.763952 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ecb24-713d-4d9b-a0d1-7befb8b3d827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:42.766421 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ecb24-713d-4d9b-a0d1-7befb8b3d827 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:42.768155 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e35e26-ec7f-440f-87e9-c83152d6b99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:42.768739 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e35e26-ec7f-440f-87e9-c83152d6b99b admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:42.769029 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e35e26-ec7f-440f-87e9-c83152d6b99b admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:42.769404 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e35e26-ec7f-440f-87e9-c83152d6b99b admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:42.770050 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e35e26-ec7f-440f-87e9-c83152d6b99b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:55:42.770350 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e35e26-ec7f-440f-87e9-c83152d6b99b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:42.772052 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e35e26-ec7f-440f-87e9-c83152d6b99b admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:42.785462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 779/1567] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:55:42.786368 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e35e26-ec7f-440f-87e9-c83152d6b99b admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:42.795610 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 789/1568] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:55:42 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:55:42.796640 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ecb24-713d-4d9b-a0d1-7befb8b3d827 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:42.798238 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e35e26-ec7f-440f-87e9-c83152d6b99b admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:42.806081 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:42.860898 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e351b-f9fd-4e6b-a833-210c29ac9264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:42.861566 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ecb24-713d-4d9b-a0d1-7befb8b3d827 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:42.862022 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e351b-f9fd-4e6b-a833-210c29ac9264 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:42.862462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e351b-f9fd-4e6b-a833-210c29ac9264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:42.862892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e351b-f9fd-4e6b-a833-210c29ac9264 admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:42.863696 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e351b-f9fd-4e6b-a833-210c29ac9264 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:55:42.864199 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e351b-f9fd-4e6b-a833-210c29ac9264 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:42.866013 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e351b-f9fd-4e6b-a833-210c29ac9264 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:42.867106 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d17d1-d14c-4ea8-bfeb-8cc3f924c81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:42.867890 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d17d1-d14c-4ea8-bfeb-8cc3f924c81b admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:42.868246 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d17d1-d14c-4ea8-bfeb-8cc3f924c81b admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:42.868758 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d17d1-d14c-4ea8-bfeb-8cc3f924c81b admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:42.869612 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d17d1-d14c-4ea8-bfeb-8cc3f924c81b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:42.871946 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d17d1-d14c-4ea8-bfeb-8cc3f924c81b admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:42.880922 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 780/1569] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:55:42.882206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e351b-f9fd-4e6b-a833-210c29ac9264 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:42.898619 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e351b-f9fd-4e6b-a833-210c29ac9264 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:42.902221 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 790/1570] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:55:42 2022] POST /identity/v3/projects => generated 363 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:55:42.902901 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d17d1-d14c-4ea8-bfeb-8cc3f924c81b admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:42.906663 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf00621-3311-48d7-a46d-432adccf4813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:42.907261 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf00621-3311-48d7-a46d-432adccf4813 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:42.907540 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf00621-3311-48d7-a46d-432adccf4813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:42.907814 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf00621-3311-48d7-a46d-432adccf4813 admin admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:42.908942 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf00621-3311-48d7-a46d-432adccf4813 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:42.910890 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf00621-3311-48d7-a46d-432adccf4813 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:42.944202 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 781/1571] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:55:42 2022] POST /identity/v3/projects => generated 403 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:55:42.945851 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf00621-3311-48d7-a46d-432adccf4813 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:42.969439 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d17d1-d14c-4ea8-bfeb-8cc3f924c81b admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:43.016554 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf00621-3311-48d7-a46d-432adccf4813 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:43.022036 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5865f1-17c5-421e-a459-5022fc4a7ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:43.022628 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:43.022774 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5865f1-17c5-421e-a459-5022fc4a7ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:43.022911 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5865f1-17c5-421e-a459-5022fc4a7ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:43.023184 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5865f1-17c5-421e-a459-5022fc4a7ce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:43.024160 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5865f1-17c5-421e-a459-5022fc4a7ce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:43.025836 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5865f1-17c5-421e-a459-5022fc4a7ce4 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:43.038202 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d2768-b252-4719-91e1-4c82de51c78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:43.038903 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d2768-b252-4719-91e1-4c82de51c78a admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:43.042272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 782/1572] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:55:43.042727 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d2768-b252-4719-91e1-4c82de51c78a admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:43.042727 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d2768-b252-4719-91e1-4c82de51c78a admin admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:43.042727 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d2768-b252-4719-91e1-4c82de51c78a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:55:43.042727 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d2768-b252-4719-91e1-4c82de51c78a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:43.043065 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5865f1-17c5-421e-a459-5022fc4a7ce4 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:43.043154 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d2768-b252-4719-91e1-4c82de51c78a admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:43.052350 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5865f1-17c5-421e-a459-5022fc4a7ce4 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:43.054240 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 791/1573] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:55:43.055028 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d2768-b252-4719-91e1-4c82de51c78a admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:43.060081 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0fdc21-b5f4-4cff-b943-229df8b9bd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:43.060719 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fdc21-b5f4-4cff-b943-229df8b9bd68 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:43.060996 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fdc21-b5f4-4cff-b943-229df8b9bd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:43.062069 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fdc21-b5f4-4cff-b943-229df8b9bd68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:43.062778 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0fdc21-b5f4-4cff-b943-229df8b9bd68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:43.064385 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0fdc21-b5f4-4cff-b943-229df8b9bd68 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:43.065403 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d2768-b252-4719-91e1-4c82de51c78a admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:43.070367 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408604f-5fa0-486f-aee1-afe9f2dfb2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:43.071187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408604f-5fa0-486f-aee1-afe9f2dfb2d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:43.071520 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408604f-5fa0-486f-aee1-afe9f2dfb2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:43.072019 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408604f-5fa0-486f-aee1-afe9f2dfb2d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:43.072750 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c408604f-5fa0-486f-aee1-afe9f2dfb2d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:43.074665 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c408604f-5fa0-486f-aee1-afe9f2dfb2d9 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:43.075191 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 783/1574] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:55:43.078387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0fdc21-b5f4-4cff-b943-229df8b9bd68 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:43.089135 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0fdc21-b5f4-4cff-b943-229df8b9bd68 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:43.093999 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22991652-65d2-45ea-b212-7d60af478b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:43.094597 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22991652-65d2-45ea-b212-7d60af478b03 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:43.094872 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22991652-65d2-45ea-b212-7d60af478b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:43.095139 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22991652-65d2-45ea-b212-7d60af478b03 admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:43.095765 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22991652-65d2-45ea-b212-7d60af478b03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:43.097714 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22991652-65d2-45ea-b212-7d60af478b03 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:43.104462 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 792/1575] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:55:43 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:55:43.105288 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408604f-5fa0-486f-aee1-afe9f2dfb2d9 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:43.121377 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 784/1576] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:55:43 2022] POST /identity/v3/users => generated 287 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:55:43.122303 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22991652-65d2-45ea-b212-7d60af478b03 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:43.132739 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22991652-65d2-45ea-b212-7d60af478b03 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:43.175597 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408604f-5fa0-486f-aee1-afe9f2dfb2d9 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:43.180142 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:43.181143 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589aaedd-0a95-4a4e-a5fb-874f4b291a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:43.181991 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589aaedd-0a95-4a4e-a5fb-874f4b291a34 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:43.182360 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589aaedd-0a95-4a4e-a5fb-874f4b291a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:43.182641 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589aaedd-0a95-4a4e-a5fb-874f4b291a34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:43.183309 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589aaedd-0a95-4a4e-a5fb-874f4b291a34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:43.185333 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589aaedd-0a95-4a4e-a5fb-874f4b291a34 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:43.192340 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da60b3ea-217d-4923-aae1-687f5e11ed13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:43.192945 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60b3ea-217d-4923-aae1-687f5e11ed13 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:43.193254 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60b3ea-217d-4923-aae1-687f5e11ed13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:43.193530 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60b3ea-217d-4923-aae1-687f5e11ed13 admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:43.194275 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da60b3ea-217d-4923-aae1-687f5e11ed13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:43.196337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da60b3ea-217d-4923-aae1-687f5e11ed13 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:43.214568 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 793/1577] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:55:43 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:55:43.215511 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589aaedd-0a95-4a4e-a5fb-874f4b291a34 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:43.219820 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 785/1578] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:55:43 2022] POST /identity/v3/users => generated 282 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:55:43.220640 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da60b3ea-217d-4923-aae1-687f5e11ed13 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:43.230390 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da60b3ea-217d-4923-aae1-687f5e11ed13 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:43.278003 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589aaedd-0a95-4a4e-a5fb-874f4b291a34 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:43.282795 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df0fe2-23e9-441f-9d6f-ccf835cf48fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:43.283401 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df0fe2-23e9-441f-9d6f-ccf835cf48fb admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:43.283684 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df0fe2-23e9-441f-9d6f-ccf835cf48fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:43.283959 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df0fe2-23e9-441f-9d6f-ccf835cf48fb admin admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:43.284588 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df0fe2-23e9-441f-9d6f-ccf835cf48fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:43.286594 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df0fe2-23e9-441f-9d6f-ccf835cf48fb admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:43.288905 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7a6c9-6526-4a8c-b62e-c0d12ea9bf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:43.289765 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7a6c9-6526-4a8c-b62e-c0d12ea9bf97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:43.290047 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7a6c9-6526-4a8c-b62e-c0d12ea9bf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:43.290319 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7a6c9-6526-4a8c-b62e-c0d12ea9bf97 admin admin] PATH_INFO: `/v3/projects/894aa7acb7b748ddbd743ea08383ed88/users/2b3ef3111ca1492abd44a59756c99e22/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:43.306514 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7a6c9-6526-4a8c-b62e-c0d12ea9bf97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=894aa7acb7b748ddbd743ea08383ed88, user_id=2b3ef3111ca1492abd44a59756c99e22, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:43.308469 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 794/1579] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:55:43 2022] POST /identity/v3/users => generated 302 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:55:43.309213 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7a6c9-6526-4a8c-b62e-c0d12ea9bf97 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:43.309464 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df0fe2-23e9-441f-9d6f-ccf835cf48fb admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:43.321519 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df0fe2-23e9-441f-9d6f-ccf835cf48fb admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:43.324585 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 786/1580] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:55:43 2022] PUT /identity/v3/projects/894aa7acb7b748ddbd743ea08383ed88/users/2b3ef3111ca1492abd44a59756c99e22/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:55:43.325681 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7a6c9-6526-4a8c-b62e-c0d12ea9bf97 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:43.353951 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:43.384353 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e5298-0273-4cd0-a657-2fb6238c642c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:43.384964 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e5298-0273-4cd0-a657-2fb6238c642c admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:43.385267 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e5298-0273-4cd0-a657-2fb6238c642c admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:43.385538 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e5298-0273-4cd0-a657-2fb6238c642c admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:43.386170 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e5298-0273-4cd0-a657-2fb6238c642c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:43.388142 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e5298-0273-4cd0-a657-2fb6238c642c admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:43.394537 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7a6c9-6526-4a8c-b62e-c0d12ea9bf97 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:43.399554 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01626c-ede2-4f14-ab22-baf5710e05ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:43.400216 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01626c-ede2-4f14-ab22-baf5710e05ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:43.400491 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01626c-ede2-4f14-ab22-baf5710e05ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:43.400779 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01626c-ede2-4f14-ab22-baf5710e05ca admin admin] PATH_INFO: `/v3/projects/b0373e8b7a114f4784c033fd0dbfd5e7/users/3b67d80c89c24561a57bc9e0fd8af7e6/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:43.416362 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01626c-ede2-4f14-ab22-baf5710e05ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0373e8b7a114f4784c033fd0dbfd5e7, user_id=3b67d80c89c24561a57bc9e0fd8af7e6, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:43.419252 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01626c-ede2-4f14-ab22-baf5710e05ca admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:43.420045 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 795/1581] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:55:43 2022] POST /identity/v3/projects => generated 393 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:55:43.422022 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e5298-0273-4cd0-a657-2fb6238c642c admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:43.433651 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 787/1582] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:55:43 2022] PUT /identity/v3/projects/b0373e8b7a114f4784c033fd0dbfd5e7/users/3b67d80c89c24561a57bc9e0fd8af7e6/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:55:43.434542 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01626c-ede2-4f14-ab22-baf5710e05ca admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:43.482944 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:43.497877 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e5298-0273-4cd0-a657-2fb6238c642c admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:43.499646 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01626c-ede2-4f14-ab22-baf5710e05ca admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:43.503058 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611fcdf8-230f-4ede-bd4d-f4287acf5312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:43.503667 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fcdf8-230f-4ede-bd4d-f4287acf5312 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:43.503945 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fcdf8-230f-4ede-bd4d-f4287acf5312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:43.504180 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d93982-8ca6-4ff0-9877-0f7fdd4e0755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:43.504313 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fcdf8-230f-4ede-bd4d-f4287acf5312 admin admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:43.504774 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d93982-8ca6-4ff0-9877-0f7fdd4e0755 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:43.504883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611fcdf8-230f-4ede-bd4d-f4287acf5312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:43.505077 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d93982-8ca6-4ff0-9877-0f7fdd4e0755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:43.505354 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d93982-8ca6-4ff0-9877-0f7fdd4e0755 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:43.505983 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d93982-8ca6-4ff0-9877-0f7fdd4e0755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:43.506803 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611fcdf8-230f-4ede-bd4d-f4287acf5312 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:43.507836 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d93982-8ca6-4ff0-9877-0f7fdd4e0755 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:43.518275 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 788/1583] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:55:43.519287 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d93982-8ca6-4ff0-9877-0f7fdd4e0755 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:43.529339 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d93982-8ca6-4ff0-9877-0f7fdd4e0755 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:43.532408 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 796/1584] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:55:43 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:55:43.533296 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611fcdf8-230f-4ede-bd4d-f4287acf5312 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:43.534227 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d2228-9a9c-4dab-9cd2-c5b14eb60cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:43.534870 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d2228-9a9c-4dab-9cd2-c5b14eb60cd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:43.535354 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d2228-9a9c-4dab-9cd2-c5b14eb60cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:43.535538 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d2228-9a9c-4dab-9cd2-c5b14eb60cd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:43.536164 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d2228-9a9c-4dab-9cd2-c5b14eb60cd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:43.538323 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d2228-9a9c-4dab-9cd2-c5b14eb60cd8 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:43.543007 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611fcdf8-230f-4ede-bd4d-f4287acf5312 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:43.548149 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8faa57f-136c-43a6-862c-d1f64f9dc29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:43.548736 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8faa57f-136c-43a6-862c-d1f64f9dc29e admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:43.549035 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8faa57f-136c-43a6-862c-d1f64f9dc29e admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:43.549309 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8faa57f-136c-43a6-862c-d1f64f9dc29e admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:43.549936 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8faa57f-136c-43a6-862c-d1f64f9dc29e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:43.551726 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8faa57f-136c-43a6-862c-d1f64f9dc29e admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:43.560483 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 789/1585] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:55:43 2022] POST /identity/v3/users => generated 288 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:55:43.561909 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d2228-9a9c-4dab-9cd2-c5b14eb60cd8 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:43.566692 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 797/1586] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:55:43.566692 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee4745-9cc2-4e64-b80a-29ea8e6c1288 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:43.566692 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee4745-9cc2-4e64-b80a-29ea8e6c1288 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:43.566692 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee4745-9cc2-4e64-b80a-29ea8e6c1288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:43.571964 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d2228-9a9c-4dab-9cd2-c5b14eb60cd8 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:43.576615 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562f837-0b56-4f3a-aa1a-b92cd13b4584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:43.577261 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562f837-0b56-4f3a-aa1a-b92cd13b4584 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:43.577582 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562f837-0b56-4f3a-aa1a-b92cd13b4584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:43.577858 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562f837-0b56-4f3a-aa1a-b92cd13b4584 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:43.578501 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562f837-0b56-4f3a-aa1a-b92cd13b4584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:43.580114 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562f837-0b56-4f3a-aa1a-b92cd13b4584 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:43.584625 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-a8ee4745-9cc2-4e64-b80a-29ea8e6c1288 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:43.585842 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-a8ee4745-9cc2-4e64-b80a-29ea8e6c1288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:43.590890 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 790/1587] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:55:43.591670 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562f837-0b56-4f3a-aa1a-b92cd13b4584 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:43.594151 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 798/1588] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:43.595538 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16adf24-e145-4bc8-82e3-02f348e6b7b8 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:43.595818 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16adf24-e145-4bc8-82e3-02f348e6b7b8 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:43.596134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16adf24-e145-4bc8-82e3-02f348e6b7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:43.602616 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562f837-0b56-4f3a-aa1a-b92cd13b4584 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:43.607773 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bbf84-7588-46b1-9b18-b3795daaa64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:43.608921 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bbf84-7588-46b1-9b18-b3795daaa64a admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:43.609227 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bbf84-7588-46b1-9b18-b3795daaa64a admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:43.609491 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bbf84-7588-46b1-9b18-b3795daaa64a admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:43.610123 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524bbf84-7588-46b1-9b18-b3795daaa64a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:43.612046 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524bbf84-7588-46b1-9b18-b3795daaa64a admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:43.624824 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-f16adf24-e145-4bc8-82e3-02f348e6b7b8 None None] MFA Rules not processed for user `3b67d80c89c24561a57bc9e0fd8af7e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:43.626200 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-f16adf24-e145-4bc8-82e3-02f348e6b7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:43.633772 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 791/1589] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:55:43 2022] POST /identity/v3/users => generated 297 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:55:43.634629 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bbf84-7588-46b1-9b18-b3795daaa64a admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:43.644404 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bbf84-7588-46b1-9b18-b3795daaa64a admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:43.649213 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc525ad-503e-4e33-8b3a-fe2030cf61a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:43.649857 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc525ad-503e-4e33-8b3a-fe2030cf61a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:43.650143 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc525ad-503e-4e33-8b3a-fe2030cf61a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:43.650455 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc525ad-503e-4e33-8b3a-fe2030cf61a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:43.651152 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc525ad-503e-4e33-8b3a-fe2030cf61a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:43.652844 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc525ad-503e-4e33-8b3a-fe2030cf61a8 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:43.663270 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 792/1590] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:55:43.666467 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc525ad-503e-4e33-8b3a-fe2030cf61a8 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:43.676581 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc525ad-503e-4e33-8b3a-fe2030cf61a8 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:43.681168 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acffc361-f69c-42f7-8e4e-36a0dfd24cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:43.681773 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffc361-f69c-42f7-8e4e-36a0dfd24cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:43.682046 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffc361-f69c-42f7-8e4e-36a0dfd24cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:43.682311 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffc361-f69c-42f7-8e4e-36a0dfd24cc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:43.682933 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acffc361-f69c-42f7-8e4e-36a0dfd24cc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:43.684499 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acffc361-f69c-42f7-8e4e-36a0dfd24cc1 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:43.692565 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 799/1591] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:43.695387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 793/1592] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:55:43.696383 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acffc361-f69c-42f7-8e4e-36a0dfd24cc1 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:43.696814 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16adf24-e145-4bc8-82e3-02f348e6b7b8 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:43.706628 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acffc361-f69c-42f7-8e4e-36a0dfd24cc1 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:43.707851 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16adf24-e145-4bc8-82e3-02f348e6b7b8 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:43.711583 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09fb29-71cd-4d32-bdc5-a54302874b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:43.712447 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09fb29-71cd-4d32-bdc5-a54302874b96 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:43.712723 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09fb29-71cd-4d32-bdc5-a54302874b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:43.712822 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ca435-56b0-49b3-92a0-2cbce7ca91ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:43.712990 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09fb29-71cd-4d32-bdc5-a54302874b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:43.713370 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ca435-56b0-49b3-92a0-2cbce7ca91ac admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:43.713632 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ca435-56b0-49b3-92a0-2cbce7ca91ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:43.713733 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09fb29-71cd-4d32-bdc5-a54302874b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:43.713905 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ca435-56b0-49b3-92a0-2cbce7ca91ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:43.714543 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ca435-56b0-49b3-92a0-2cbce7ca91ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:43.715213 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09fb29-71cd-4d32-bdc5-a54302874b96 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:43.716160 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ca435-56b0-49b3-92a0-2cbce7ca91ac admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:43.726440 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 794/1593] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:55:43.727260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09fb29-71cd-4d32-bdc5-a54302874b96 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:43.727806 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 800/1594] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:55:43.728422 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ca435-56b0-49b3-92a0-2cbce7ca91ac admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:43.738331 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:43.739786 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09fb29-71cd-4d32-bdc5-a54302874b96 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:43.745096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce85c0-0188-4b90-82df-5d73dafc774c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:43.745818 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce85c0-0188-4b90-82df-5d73dafc774c admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:43.746094 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce85c0-0188-4b90-82df-5d73dafc774c admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:43.746362 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce85c0-0188-4b90-82df-5d73dafc774c admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:43.746991 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce85c0-0188-4b90-82df-5d73dafc774c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:43.749097 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce85c0-0188-4b90-82df-5d73dafc774c admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:43.759093 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 795/1595] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:55:43.759886 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce85c0-0188-4b90-82df-5d73dafc774c admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:43.769982 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce85c0-0188-4b90-82df-5d73dafc774c admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:43.775071 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ed73c-2a8e-47e1-b6a4-b7a9722558d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:43.775646 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ed73c-2a8e-47e1-b6a4-b7a9722558d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:43.775925 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ed73c-2a8e-47e1-b6a4-b7a9722558d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:43.776194 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ed73c-2a8e-47e1-b6a4-b7a9722558d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:43.776819 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ed73c-2a8e-47e1-b6a4-b7a9722558d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:43.778428 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ed73c-2a8e-47e1-b6a4-b7a9722558d2 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:43.786852 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ca435-56b0-49b3-92a0-2cbce7ca91ac admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:43.788847 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 796/1596] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:55:43.789658 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ed73c-2a8e-47e1-b6a4-b7a9722558d2 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:43.793568 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450bc4e-63d0-427c-bae6-19d4bc09b8f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:43.794248 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450bc4e-63d0-427c-bae6-19d4bc09b8f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:43.794526 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450bc4e-63d0-427c-bae6-19d4bc09b8f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:43.794796 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450bc4e-63d0-427c-bae6-19d4bc09b8f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:43.799010 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ed73c-2a8e-47e1-b6a4-b7a9722558d2 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:43.803532 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c68e9-285a-415e-9799-b55728829476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:43.804159 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c68e9-285a-415e-9799-b55728829476 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:43.804434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c68e9-285a-415e-9799-b55728829476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:43.804704 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c68e9-285a-415e-9799-b55728829476 admin admin] PATH_INFO: `/v3/projects/c21d57e79f5d4008b715a9694dbd6fe9/users/ec5c5dd23aef46d0884499360bc34192/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:43.804872 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450bc4e-63d0-427c-bae6-19d4bc09b8f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:43.806330 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450bc4e-63d0-427c-bae6-19d4bc09b8f0 service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:43.816182 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 801/1597] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:55:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:55:43.816949 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450bc4e-63d0-427c-bae6-19d4bc09b8f0 service neutron] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:43.820114 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4c68e9-285a-415e-9799-b55728829476 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c21d57e79f5d4008b715a9694dbd6fe9, user_id=ec5c5dd23aef46d0884499360bc34192, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:43.822821 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4c68e9-285a-415e-9799-b55728829476 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:43.826297 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450bc4e-63d0-427c-bae6-19d4bc09b8f0 service neutron] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:43.832766 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db21b79-294c-4ce7-bfda-b02ef32c0938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:43.833551 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db21b79-294c-4ce7-bfda-b02ef32c0938 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:43.833815 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db21b79-294c-4ce7-bfda-b02ef32c0938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:43.834285 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db21b79-294c-4ce7-bfda-b02ef32c0938 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:43.834830 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db21b79-294c-4ce7-bfda-b02ef32c0938 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:43.837319 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db21b79-294c-4ce7-bfda-b02ef32c0938 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:43.839734 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 797/1598] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:55:43 2022] PUT /identity/v3/projects/c21d57e79f5d4008b715a9694dbd6fe9/users/ec5c5dd23aef46d0884499360bc34192/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:55:43.840668 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c68e9-285a-415e-9799-b55728829476 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:43.880919 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 802/1599] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:55:43 2022] POST /identity/v3/projects => generated 371 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:55:43.882009 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db21b79-294c-4ce7-bfda-b02ef32c0938 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:43.910433 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c68e9-285a-415e-9799-b55728829476 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:43.933367 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:43.962379 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db21b79-294c-4ce7-bfda-b02ef32c0938 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:43.968264 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17b14c-8c4f-4c0b-92eb-b29d803f9889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:43.968920 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17b14c-8c4f-4c0b-92eb-b29d803f9889 admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:43.969506 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17b14c-8c4f-4c0b-92eb-b29d803f9889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:43.969506 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17b14c-8c4f-4c0b-92eb-b29d803f9889 admin admin] PATH_INFO: `/v3/projects/ed730ea681334713aab91069ffb3a905/users/07e1320968e144a1b74f58b9e9dc2807/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:43.977190 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f962b-2ebe-4d50-922a-c457d6c0d3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:43.977676 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f962b-2ebe-4d50-922a-c457d6c0d3a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:43.978030 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f962b-2ebe-4d50-922a-c457d6c0d3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:43.978536 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f962b-2ebe-4d50-922a-c457d6c0d3a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:43.979076 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f962b-2ebe-4d50-922a-c457d6c0d3a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:43.980923 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f962b-2ebe-4d50-922a-c457d6c0d3a5 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:43.989050 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17b14c-8c4f-4c0b-92eb-b29d803f9889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed730ea681334713aab91069ffb3a905, user_id=07e1320968e144a1b74f58b9e9dc2807, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:43.990189 dv-cinder-859318-1-smb devstack@keystone.service[81277]: WARNING py.warnings [None req-8f17b14c-8c4f-4c0b-92eb-b29d803f9889 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 17:55:43.990189 dv-cinder-859318-1-smb devstack@keystone.service[81277]: warnings.warn(msg) Sep 26 17:55:43.990189 dv-cinder-859318-1-smb devstack@keystone.service[81277]: Sep 26 17:55:43.992574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17b14c-8c4f-4c0b-92eb-b29d803f9889 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:43.994638 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 798/1600] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:55:43.995270 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f962b-2ebe-4d50-922a-c457d6c0d3a5 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:44.006410 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f962b-2ebe-4d50-922a-c457d6c0d3a5 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:44.011728 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 803/1601] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:55:43 2022] PUT /identity/v3/projects/ed730ea681334713aab91069ffb3a905/users/07e1320968e144a1b74f58b9e9dc2807/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:55:44.013246 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17b14c-8c4f-4c0b-92eb-b29d803f9889 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:44.072293 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29baa154-295f-455d-a5a6-d8dd09a3826d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:44.072885 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baa154-295f-455d-a5a6-d8dd09a3826d admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:44.073340 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baa154-295f-455d-a5a6-d8dd09a3826d admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:44.073678 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baa154-295f-455d-a5a6-d8dd09a3826d admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:44.074390 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29baa154-295f-455d-a5a6-d8dd09a3826d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:44.076067 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29baa154-295f-455d-a5a6-d8dd09a3826d admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:44.088476 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 799/1602] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:55:44.089569 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29baa154-295f-455d-a5a6-d8dd09a3826d admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:44.101414 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29baa154-295f-455d-a5a6-d8dd09a3826d admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:44.107190 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490951e0-5d96-4235-a2ac-035d376433a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:44.107787 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490951e0-5d96-4235-a2ac-035d376433a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:44.108606 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490951e0-5d96-4235-a2ac-035d376433a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:44.108881 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490951e0-5d96-4235-a2ac-035d376433a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:44.109545 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490951e0-5d96-4235-a2ac-035d376433a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:44.111147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490951e0-5d96-4235-a2ac-035d376433a1 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:44.113179 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17b14c-8c4f-4c0b-92eb-b29d803f9889 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:44.118883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd40ae9-c810-442b-944c-e1d9b175aea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:44.119579 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd40ae9-c810-442b-944c-e1d9b175aea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:44.120013 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd40ae9-c810-442b-944c-e1d9b175aea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:44.120292 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd40ae9-c810-442b-944c-e1d9b175aea3 admin admin] PATH_INFO: `/v3/projects/a119d5cc2a5d4f32ae457215a704f86e/users/7a948d1b970a4d58ac62311dcc33522f/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:44.125120 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 800/1603] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:55:44.126542 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02ee63-defb-425a-8de3-9a364565ae45 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:44.127005 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02ee63-defb-425a-8de3-9a364565ae45 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:44.127366 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02ee63-defb-425a-8de3-9a364565ae45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:44.141486 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd40ae9-c810-442b-944c-e1d9b175aea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a119d5cc2a5d4f32ae457215a704f86e, user_id=7a948d1b970a4d58ac62311dcc33522f, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:44.144693 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd40ae9-c810-442b-944c-e1d9b175aea3 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:44.148621 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:44.158933 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-da02ee63-defb-425a-8de3-9a364565ae45 None None] MFA Rules not processed for user `ec5c5dd23aef46d0884499360bc34192`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:44.160326 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-da02ee63-defb-425a-8de3-9a364565ae45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:44.164537 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 804/1604] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:55:44 2022] PUT /identity/v3/projects/a119d5cc2a5d4f32ae457215a704f86e/users/7a948d1b970a4d58ac62311dcc33522f/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:55:44.182157 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd40ae9-c810-442b-944c-e1d9b175aea3 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:44.247883 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 801/1605] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:44.249416 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02ee63-defb-425a-8de3-9a364565ae45 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:44.268663 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd40ae9-c810-442b-944c-e1d9b175aea3 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:44.274590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996be73-e34c-4571-b4ea-91d08be88ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:44.274841 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996be73-e34c-4571-b4ea-91d08be88ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:44.275124 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996be73-e34c-4571-b4ea-91d08be88ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:44.275497 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996be73-e34c-4571-b4ea-91d08be88ac2 admin admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:44.276199 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996be73-e34c-4571-b4ea-91d08be88ac2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:44.278563 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996be73-e34c-4571-b4ea-91d08be88ac2 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:44.313703 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 805/1606] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:55:44 2022] POST /identity/v3/users => generated 292 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:55:44.313703 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa99a2-d3a7-4ab2-b0b9-7e3e0f022149 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:44.313703 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa99a2-d3a7-4ab2-b0b9-7e3e0f022149 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:44.313703 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa99a2-d3a7-4ab2-b0b9-7e3e0f022149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:44.351183 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-a7fa99a2-d3a7-4ab2-b0b9-7e3e0f022149 None None] MFA Rules not processed for user `07e1320968e144a1b74f58b9e9dc2807`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:44.352421 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-a7fa99a2-d3a7-4ab2-b0b9-7e3e0f022149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:44.353320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:44.386616 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02ee63-defb-425a-8de3-9a364565ae45 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:44.396034 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c576b-15a5-4e44-8249-f5e78f2b7e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:44.396820 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c576b-15a5-4e44-8249-f5e78f2b7e72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:44.397235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c576b-15a5-4e44-8249-f5e78f2b7e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:44.397570 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c576b-15a5-4e44-8249-f5e78f2b7e72 admin admin] PATH_INFO: `/v3/projects/e0f4f590b1634121a8de1b202c2413ca/users/27be8cad21f54dcd9a71ff99299d9814/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:44.417864 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c576b-15a5-4e44-8249-f5e78f2b7e72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0f4f590b1634121a8de1b202c2413ca, user_id=27be8cad21f54dcd9a71ff99299d9814, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:44.420623 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c576b-15a5-4e44-8249-f5e78f2b7e72 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:44.432603 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 806/1607] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:44.432603 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa99a2-d3a7-4ab2-b0b9-7e3e0f022149 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:44.438975 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 802/1608] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:55:44 2022] PUT /identity/v3/projects/e0f4f590b1634121a8de1b202c2413ca/users/27be8cad21f54dcd9a71ff99299d9814/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:55:44.439682 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c576b-15a5-4e44-8249-f5e78f2b7e72 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:44.448045 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa99a2-d3a7-4ab2-b0b9-7e3e0f022149 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:44.518885 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c576b-15a5-4e44-8249-f5e78f2b7e72 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:44.519293 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361bd67-62be-4a4e-a336-84a8b53a2223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:44.520109 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361bd67-62be-4a4e-a336-84a8b53a2223 admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:44.520261 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361bd67-62be-4a4e-a336-84a8b53a2223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:44.520729 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361bd67-62be-4a4e-a336-84a8b53a2223 admin admin] PATH_INFO: `/v3/projects/3783159882724c00acb1604e806fd127/users/4313fb69eafa45d2a4f8c0ac5ef47de7/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:44.525335 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e00a3-5101-4508-886a-810d63bbfbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:44.526080 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e00a3-5101-4508-886a-810d63bbfbc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:44.526363 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e00a3-5101-4508-886a-810d63bbfbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:44.526636 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e00a3-5101-4508-886a-810d63bbfbc4 admin admin] PATH_INFO: `/v3/projects/982d5b06acd045db881a30eeade94dd3/users/a3e5d3a7379042d4a04a23effdeba6b7/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:44.544095 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e00a3-5101-4508-886a-810d63bbfbc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=982d5b06acd045db881a30eeade94dd3, user_id=a3e5d3a7379042d4a04a23effdeba6b7, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:44.544991 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0361bd67-62be-4a4e-a336-84a8b53a2223 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3783159882724c00acb1604e806fd127, user_id=4313fb69eafa45d2a4f8c0ac5ef47de7, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:44.548465 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0361bd67-62be-4a4e-a336-84a8b53a2223 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:44.548637 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e00a3-5101-4508-886a-810d63bbfbc4 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:44.566120 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:44.573348 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 807/1610] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:55:44 2022] PUT /identity/v3/projects/3783159882724c00acb1604e806fd127/users/4313fb69eafa45d2a4f8c0ac5ef47de7/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:55:44.575288 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd512954-47c5-4b6d-b887-07c019fc3d60 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:44.576165 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd512954-47c5-4b6d-b887-07c019fc3d60 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:44.576616 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd512954-47c5-4b6d-b887-07c019fc3d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:44.577498 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 803/1610] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:55:44 2022] PUT /identity/v3/projects/982d5b06acd045db881a30eeade94dd3/users/a3e5d3a7379042d4a04a23effdeba6b7/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:55:44.580093 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14ea2d-9428-492b-9124-9792c3ef7daf None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:44.580348 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14ea2d-9428-492b-9124-9792c3ef7daf None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:44.580637 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14ea2d-9428-492b-9124-9792c3ef7daf None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:44.582350 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 804/1611] 10.222.0.62 () {54 vars in 961 bytes} [Mon Sep 26 17:55:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:55:44.583076 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14ea2d-9428-492b-9124-9792c3ef7daf None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:44.623451 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-fd512954-47c5-4b6d-b887-07c019fc3d60 None None] MFA Rules not processed for user `7a948d1b970a4d58ac62311dcc33522f`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:44.625439 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-fd512954-47c5-4b6d-b887-07c019fc3d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:44.661002 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14ea2d-9428-492b-9124-9792c3ef7daf None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:44.666833 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d9ae5-21a1-45d2-b589-3ccc885b0e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:44.667425 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d9ae5-21a1-45d2-b589-3ccc885b0e20 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:44.667825 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d9ae5-21a1-45d2-b589-3ccc885b0e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:44.668102 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d9ae5-21a1-45d2-b589-3ccc885b0e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:44.668750 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d9ae5-21a1-45d2-b589-3ccc885b0e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:44.670658 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d9ae5-21a1-45d2-b589-3ccc885b0e20 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:44.688736 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 805/1612] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:55:44.688736 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d9ae5-21a1-45d2-b589-3ccc885b0e20 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:44.704943 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d9ae5-21a1-45d2-b589-3ccc885b0e20 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:44.713295 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 808/1613] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:44 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:44.714908 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c40bad-e34a-4914-aae5-9d870513e734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:44.715261 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8f118-db91-4dee-87f7-785b1da6a971 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:44.715548 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c40bad-e34a-4914-aae5-9d870513e734 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:44.715844 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c40bad-e34a-4914-aae5-9d870513e734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:44.716113 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c40bad-e34a-4914-aae5-9d870513e734 admin admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:44.716476 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8f118-db91-4dee-87f7-785b1da6a971 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:44.716837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c40bad-e34a-4914-aae5-9d870513e734 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:44.717247 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8f118-db91-4dee-87f7-785b1da6a971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:44.719440 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c40bad-e34a-4914-aae5-9d870513e734 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:44.741058 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-e5d8f118-db91-4dee-87f7-785b1da6a971 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:44.742776 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-e5d8f118-db91-4dee-87f7-785b1da6a971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:44.752547 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 809/1614] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:44.754257 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae17c9-de29-4d1b-9f7b-1bf25f8a220e None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:44.754824 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae17c9-de29-4d1b-9f7b-1bf25f8a220e None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:44.755460 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae17c9-de29-4d1b-9f7b-1bf25f8a220e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:44.770006 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 806/1615] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:55:44 2022] POST /identity/v3/projects => generated 365 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:55:44.770006 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbed461-a41e-4a91-9d98-80ddf87cb1ea None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:44.770006 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbed461-a41e-4a91-9d98-80ddf87cb1ea None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:44.770006 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbed461-a41e-4a91-9d98-80ddf87cb1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:44.790624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-1bae17c9-de29-4d1b-9f7b-1bf25f8a220e None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:44.792556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-1bae17c9-de29-4d1b-9f7b-1bf25f8a220e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:44.807501 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-edbed461-a41e-4a91-9d98-80ddf87cb1ea None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:44.809632 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-edbed461-a41e-4a91-9d98-80ddf87cb1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:44.822566 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:44.876038 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 810/1616] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:44.878092 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254703b-c2f2-42c5-b225-5f7a5a36e88b None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:44.878712 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254703b-c2f2-42c5-b225-5f7a5a36e88b None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:44.879093 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254703b-c2f2-42c5-b225-5f7a5a36e88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:44.910928 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 807/1617] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:44.911760 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbed461-a41e-4a91-9d98-80ddf87cb1ea None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:44.922603 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbed461-a41e-4a91-9d98-80ddf87cb1ea None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:44.927282 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d38ad-0141-47fa-be05-838c1a5f0f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:44.928290 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d38ad-0141-47fa-be05-838c1a5f0f74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:44.928931 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d38ad-0141-47fa-be05-838c1a5f0f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:44.929278 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d38ad-0141-47fa-be05-838c1a5f0f74 admin admin] PATH_INFO: `/v3/projects/ef70eed98541417da59fd6bc6a6920ab/users/41574a9e08214a869ea45daa7c13f2dd/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:44.947381 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021d38ad-0141-47fa-be05-838c1a5f0f74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef70eed98541417da59fd6bc6a6920ab, user_id=41574a9e08214a869ea45daa7c13f2dd, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:44.949945 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-0254703b-c2f2-42c5-b225-5f7a5a36e88b None None] MFA Rules not processed for user `1792e79b9c9a47e1923f19bfd2cd495b`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:44.950410 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021d38ad-0141-47fa-be05-838c1a5f0f74 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:44.951435 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-0254703b-c2f2-42c5-b225-5f7a5a36e88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:44.970183 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 808/1618] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:55:44 2022] PUT /identity/v3/projects/ef70eed98541417da59fd6bc6a6920ab/users/41574a9e08214a869ea45daa7c13f2dd/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:55:44.971080 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d38ad-0141-47fa-be05-838c1a5f0f74 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:45.033247 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:45.048669 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 811/1619] 10.222.0.62 () {58 vars in 1058 bytes} [Mon Sep 26 17:55:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:45.050082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0254703b-c2f2-42c5-b225-5f7a5a36e88b None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:45.051989 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-0254703b-c2f2-42c5-b225-5f7a5a36e88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:45.058505 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d38ad-0141-47fa-be05-838c1a5f0f74 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:45.064933 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050b463-6671-4998-9e9f-4f027e7aa8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:45.065629 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050b463-6671-4998-9e9f-4f027e7aa8fa admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:45.065916 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050b463-6671-4998-9e9f-4f027e7aa8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:45.066189 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050b463-6671-4998-9e9f-4f027e7aa8fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:45.066991 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050b463-6671-4998-9e9f-4f027e7aa8fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:45.069162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050b463-6671-4998-9e9f-4f027e7aa8fa admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:45.108430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 809/1620] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:55:44 2022] POST /identity/v3/projects => generated 405 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:55:45.109813 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050b463-6671-4998-9e9f-4f027e7aa8fa admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:45.141173 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0254703b-c2f2-42c5-b225-5f7a5a36e88b None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:45.190369 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050b463-6671-4998-9e9f-4f027e7aa8fa admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:45.197596 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3352caae-8a88-47be-82e9-c522b47fa3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:45.198427 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352caae-8a88-47be-82e9-c522b47fa3de admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:45.198915 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352caae-8a88-47be-82e9-c522b47fa3de admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:45.199342 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352caae-8a88-47be-82e9-c522b47fa3de admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:45.200313 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3352caae-8a88-47be-82e9-c522b47fa3de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:45.203271 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3352caae-8a88-47be-82e9-c522b47fa3de admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:45.218798 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62180a4c-b0cd-4920-84a5-fd38671e99fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:45.220287 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62180a4c-b0cd-4920-84a5-fd38671e99fd service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:45.220559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62180a4c-b0cd-4920-84a5-fd38671e99fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:45.221153 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62180a4c-b0cd-4920-84a5-fd38671e99fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:45.231549 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 810/1621] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:55:45 2022] POST /identity/v3/users => generated 289 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:55:45.232842 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3352caae-8a88-47be-82e9-c522b47fa3de admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:45.236781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62180a4c-b0cd-4920-84a5-fd38671e99fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:45.237949 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62180a4c-b0cd-4920-84a5-fd38671e99fd service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:45.246637 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3352caae-8a88-47be-82e9-c522b47fa3de admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:45.249952 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 812/1622] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:55:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:55:45.253299 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa770596-2c45-4fc7-b934-1b532088bbd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:45.254252 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa770596-2c45-4fc7-b934-1b532088bbd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:45.254884 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa770596-2c45-4fc7-b934-1b532088bbd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:45.255828 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa770596-2c45-4fc7-b934-1b532088bbd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:45.262783 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62180a4c-b0cd-4920-84a5-fd38671e99fd service neutron] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:45.263730 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:45.269215 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa770596-2c45-4fc7-b934-1b532088bbd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:45.271449 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa770596-2c45-4fc7-b934-1b532088bbd7 service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:45.283643 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62180a4c-b0cd-4920-84a5-fd38671e99fd service neutron] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:45.286268 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 811/1623] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:55:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:55:45.288115 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa770596-2c45-4fc7-b934-1b532088bbd7 service neutron] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:45.292399 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9789f762-8ff1-41f0-bca2-cdaf8938de4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:45.296030 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789f762-8ff1-41f0-bca2-cdaf8938de4c service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:45.296327 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789f762-8ff1-41f0-bca2-cdaf8938de4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:45.296606 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789f762-8ff1-41f0-bca2-cdaf8938de4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:45.313198 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa770596-2c45-4fc7-b934-1b532088bbd7 service neutron] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:45.322503 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9789f762-8ff1-41f0-bca2-cdaf8938de4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:45.324640 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c9073-bdb5-4ac2-9e02-8ad376a32da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:45.325269 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c9073-bdb5-4ac2-9e02-8ad376a32da4 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:45.325547 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c9073-bdb5-4ac2-9e02-8ad376a32da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:45.325817 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c9073-bdb5-4ac2-9e02-8ad376a32da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:45.326460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c9073-bdb5-4ac2-9e02-8ad376a32da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:45.328189 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c9073-bdb5-4ac2-9e02-8ad376a32da4 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:45.331963 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9789f762-8ff1-41f0-bca2-cdaf8938de4c service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:45.343484 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 812/1624] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:55:45.343484 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c9073-bdb5-4ac2-9e02-8ad376a32da4 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:45.363958 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 813/1625] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:55:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:55:45.365211 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9789f762-8ff1-41f0-bca2-cdaf8938de4c service neutron] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:45.392235 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9789f762-8ff1-41f0-bca2-cdaf8938de4c service neutron] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:45.403865 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892b197-58b8-4b94-825d-73165e73cd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:45.405255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892b197-58b8-4b94-825d-73165e73cd83 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:45.405576 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892b197-58b8-4b94-825d-73165e73cd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:45.408745 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892b197-58b8-4b94-825d-73165e73cd83 admin admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:45.409513 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892b197-58b8-4b94-825d-73165e73cd83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:45.413208 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892b197-58b8-4b94-825d-73165e73cd83 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:45.456712 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 814/1626] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:55:45 2022] POST /identity/v3/users => generated 309 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:55:45.457505 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892b197-58b8-4b94-825d-73165e73cd83 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:45.458686 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c9073-bdb5-4ac2-9e02-8ad376a32da4 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:45.481443 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892b197-58b8-4b94-825d-73165e73cd83 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:45.483940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809696e4-9dd1-4b83-94a4-7e78109435d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:45.484866 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809696e4-9dd1-4b83-94a4-7e78109435d1 service nova] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:45.485199 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809696e4-9dd1-4b83-94a4-7e78109435d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:45.485549 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809696e4-9dd1-4b83-94a4-7e78109435d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:45.497999 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f0d6b-c573-4a7d-95ef-3eef4c02f0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:45.499272 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f0d6b-c573-4a7d-95ef-3eef4c02f0c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:45.499614 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f0d6b-c573-4a7d-95ef-3eef4c02f0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:45.499949 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f0d6b-c573-4a7d-95ef-3eef4c02f0c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:45.501472 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f0d6b-c573-4a7d-95ef-3eef4c02f0c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:45.518587 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f0d6b-c573-4a7d-95ef-3eef4c02f0c0 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:45.541971 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 815/1627] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:55:45.543182 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f0d6b-c573-4a7d-95ef-3eef4c02f0c0 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:45.562055 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f0d6b-c573-4a7d-95ef-3eef4c02f0c0 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:45.571458 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f82f8-da55-4c43-bc8b-bfaf8dc214ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:45.572477 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f82f8-da55-4c43-bc8b-bfaf8dc214ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:45.573637 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f82f8-da55-4c43-bc8b-bfaf8dc214ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:45.574588 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f82f8-da55-4c43-bc8b-bfaf8dc214ec admin admin] PATH_INFO: `/v3/projects/ef70eed98541417da59fd6bc6a6920ab/users/41574a9e08214a869ea45daa7c13f2dd/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:45.575799 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809696e4-9dd1-4b83-94a4-7e78109435d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:45.579087 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809696e4-9dd1-4b83-94a4-7e78109435d1 service nova] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:45.580156 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f82f8-da55-4c43-bc8b-bfaf8dc214ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef70eed98541417da59fd6bc6a6920ab, user_id=41574a9e08214a869ea45daa7c13f2dd, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:45.585452 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f82f8-da55-4c43-bc8b-bfaf8dc214ec admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:45.592462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 813/1628] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:55:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:55:45.593586 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809696e4-9dd1-4b83-94a4-7e78109435d1 service nova] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:45.605150 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809696e4-9dd1-4b83-94a4-7e78109435d1 service nova] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:45.606270 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 816/1629] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:55:45 2022] PUT /identity/v3/projects/ef70eed98541417da59fd6bc6a6920ab/users/41574a9e08214a869ea45daa7c13f2dd/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:55:45.607738 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f82f8-da55-4c43-bc8b-bfaf8dc214ec admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:45.721695 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9990aff-6fdc-4067-a19f-3b09dcc8b68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:45.722520 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9990aff-6fdc-4067-a19f-3b09dcc8b68b admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:45.722877 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9990aff-6fdc-4067-a19f-3b09dcc8b68b admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:45.723394 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9990aff-6fdc-4067-a19f-3b09dcc8b68b admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:45.724174 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9990aff-6fdc-4067-a19f-3b09dcc8b68b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:45.726155 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9990aff-6fdc-4067-a19f-3b09dcc8b68b admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:45.731469 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f82f8-da55-4c43-bc8b-bfaf8dc214ec admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:45.741649 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 814/1630] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:55:45.747168 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23043486-ce1e-43fb-9054-6b87f2c42947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:45.748033 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23043486-ce1e-43fb-9054-6b87f2c42947 admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:45.748225 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23043486-ce1e-43fb-9054-6b87f2c42947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:45.748533 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23043486-ce1e-43fb-9054-6b87f2c42947 admin admin] PATH_INFO: `/v3/projects/dd15f05948b94d85b1b35b37c99bf45f/users/553facdb2f30419a9659311e65dcae47/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:45.753899 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f6078-b769-4251-afab-622a47d41e20 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:45.755769 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f6078-b769-4251-afab-622a47d41e20 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:45.755769 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f6078-b769-4251-afab-622a47d41e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:45.763512 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:45.870160 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23043486-ce1e-43fb-9054-6b87f2c42947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd15f05948b94d85b1b35b37c99bf45f, user_id=553facdb2f30419a9659311e65dcae47, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:45.870160 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23043486-ce1e-43fb-9054-6b87f2c42947 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:45.876730 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-c23f6078-b769-4251-afab-622a47d41e20 None None] MFA Rules not processed for user `41574a9e08214a869ea45daa7c13f2dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:45.876730 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-c23f6078-b769-4251-afab-622a47d41e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:45.877483 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 817/1631] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:55:45 2022] PUT /identity/v3/projects/dd15f05948b94d85b1b35b37c99bf45f/users/553facdb2f30419a9659311e65dcae47/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:55:45.877483 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23043486-ce1e-43fb-9054-6b87f2c42947 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:45.878496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:45.981751 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23043486-ce1e-43fb-9054-6b87f2c42947 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:45.988356 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1688dc-fe91-4e64-9adc-fa22a8df013f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:45.989142 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1688dc-fe91-4e64-9adc-fa22a8df013f admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:45.989723 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1688dc-fe91-4e64-9adc-fa22a8df013f admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:45.989974 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1688dc-fe91-4e64-9adc-fa22a8df013f admin admin] PATH_INFO: `/v3/projects/a3ac35ebeb0b4f689a9e2707ea939e1a/users/188cc531d31f497289db4557078c52aa/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:46.029451 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1688dc-fe91-4e64-9adc-fa22a8df013f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3ac35ebeb0b4f689a9e2707ea939e1a, user_id=188cc531d31f497289db4557078c52aa, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:46.033642 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1688dc-fe91-4e64-9adc-fa22a8df013f admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:46.048115 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 815/1632] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:46.049813 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f6078-b769-4251-afab-622a47d41e20 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:46.060461 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 818/1633] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:55:45 2022] PUT /identity/v3/projects/a3ac35ebeb0b4f689a9e2707ea939e1a/users/188cc531d31f497289db4557078c52aa/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:55:46.062459 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee1721-7e07-48b9-82a7-21291478b469 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:46.062839 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee1721-7e07-48b9-82a7-21291478b469 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:46.063207 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee1721-7e07-48b9-82a7-21291478b469 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:46.065424 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 819/1634] 10.222.0.62 () {54 vars in 912 bytes} [Mon Sep 26 17:55:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:55:46.066386 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee1721-7e07-48b9-82a7-21291478b469 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:46.083466 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f6078-b769-4251-afab-622a47d41e20 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:46.158585 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee1721-7e07-48b9-82a7-21291478b469 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:46.161983 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63f762-0480-4c55-aa9b-ba709eb42dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:46.162682 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63f762-0480-4c55-aa9b-ba709eb42dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:46.163071 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63f762-0480-4c55-aa9b-ba709eb42dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:46.163212 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ada1e-fb33-447f-9b08-8b80a28dd7bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:46.163391 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63f762-0480-4c55-aa9b-ba709eb42dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:46.163962 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ada1e-fb33-447f-9b08-8b80a28dd7bc service cinder] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:46.164093 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63f762-0480-4c55-aa9b-ba709eb42dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:46.164411 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ada1e-fb33-447f-9b08-8b80a28dd7bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:46.164852 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ada1e-fb33-447f-9b08-8b80a28dd7bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:46.166289 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63f762-0480-4c55-aa9b-ba709eb42dc0 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:46.182464 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 816/1635] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:55:46.183000 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63f762-0480-4c55-aa9b-ba709eb42dc0 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:46.194174 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63f762-0480-4c55-aa9b-ba709eb42dc0 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:46.200351 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdec486-4bc1-47bb-bda8-fbc777a65df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:46.201278 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdec486-4bc1-47bb-bda8-fbc777a65df5 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:46.202179 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdec486-4bc1-47bb-bda8-fbc777a65df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:46.202433 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdec486-4bc1-47bb-bda8-fbc777a65df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:46.203264 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdec486-4bc1-47bb-bda8-fbc777a65df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:46.209118 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdec486-4bc1-47bb-bda8-fbc777a65df5 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:46.231068 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 817/1636] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:55:46.232510 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13a06d-dea3-43b4-ab96-e480548bb81a None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:46.232938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13a06d-dea3-43b4-ab96-e480548bb81a None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:46.233765 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13a06d-dea3-43b4-ab96-e480548bb81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:46.261663 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-7c13a06d-dea3-43b4-ab96-e480548bb81a None None] MFA Rules not processed for user `1792e79b9c9a47e1923f19bfd2cd495b`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:46.263326 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-7c13a06d-dea3-43b4-ab96-e480548bb81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:46.299344 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ada1e-fb33-447f-9b08-8b80a28dd7bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:46.301612 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ada1e-fb33-447f-9b08-8b80a28dd7bc service cinder] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:46.318615 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 820/1637] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:55:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:55:46.319732 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ada1e-fb33-447f-9b08-8b80a28dd7bc service cinder] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:46.335965 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ada1e-fb33-447f-9b08-8b80a28dd7bc service cinder] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:46.353664 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d707f-716b-43fb-b7a1-469e483f389f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:46.354942 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d707f-716b-43fb-b7a1-469e483f389f admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:46.357324 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d707f-716b-43fb-b7a1-469e483f389f admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:46.358012 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d707f-716b-43fb-b7a1-469e483f389f admin admin] PATH_INFO: `/v3/projects/dd15f05948b94d85b1b35b37c99bf45f/users/553facdb2f30419a9659311e65dcae47/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:46.364084 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d707f-716b-43fb-b7a1-469e483f389f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd15f05948b94d85b1b35b37c99bf45f, user_id=553facdb2f30419a9659311e65dcae47, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:46.370264 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d707f-716b-43fb-b7a1-469e483f389f admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:46.399252 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 821/1638] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:55:46 2022] PUT /identity/v3/projects/dd15f05948b94d85b1b35b37c99bf45f/users/553facdb2f30419a9659311e65dcae47/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:55:46.400274 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d707f-716b-43fb-b7a1-469e483f389f admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:46.414234 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:46.437503 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 818/1639] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Sep 26 17:55:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:46.438794 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115f15e-c270-410d-a3f6-c92228b8427b None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:46.439078 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115f15e-c270-410d-a3f6-c92228b8427b None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:46.439350 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115f15e-c270-410d-a3f6-c92228b8427b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:46.525236 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-c115f15e-c270-410d-a3f6-c92228b8427b None None] MFA Rules not processed for user `553facdb2f30419a9659311e65dcae47`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:46.528910 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-c115f15e-c270-410d-a3f6-c92228b8427b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:46.539472 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d707f-716b-43fb-b7a1-469e483f389f admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:46.543663 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:46.554734 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2f84c-c2fb-4534-9768-c3d8159e9d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:46.556813 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2f84c-c2fb-4534-9768-c3d8159e9d4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:46.558019 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2f84c-c2fb-4534-9768-c3d8159e9d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:46.559126 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2f84c-c2fb-4534-9768-c3d8159e9d4b admin admin] PATH_INFO: `/v3/projects/a3ac35ebeb0b4f689a9e2707ea939e1a/users/188cc531d31f497289db4557078c52aa/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:46.565749 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd2f84c-c2fb-4534-9768-c3d8159e9d4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3ac35ebeb0b4f689a9e2707ea939e1a, user_id=188cc531d31f497289db4557078c52aa, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:46.578041 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd2f84c-c2fb-4534-9768-c3d8159e9d4b admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:46.610771 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 822/1640] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:55:46 2022] PUT /identity/v3/projects/a3ac35ebeb0b4f689a9e2707ea939e1a/users/188cc531d31f497289db4557078c52aa/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:55:46.612281 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2f84c-c2fb-4534-9768-c3d8159e9d4b admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:46.739432 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 819/1641] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:46 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:46.741135 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abc626-7de2-42f2-9ea3-6020b6fa3f82 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:46.741426 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abc626-7de2-42f2-9ea3-6020b6fa3f82 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:46.742195 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abc626-7de2-42f2-9ea3-6020b6fa3f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:46.749480 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2f84c-c2fb-4534-9768-c3d8159e9d4b admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:46.763449 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b0890-8a8e-47f1-a6df-6a17a67ed1dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:46.764115 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b0890-8a8e-47f1-a6df-6a17a67ed1dc service cinder] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:46.764399 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b0890-8a8e-47f1-a6df-6a17a67ed1dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:46.764667 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b0890-8a8e-47f1-a6df-6a17a67ed1dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:46.814443 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-92abc626-7de2-42f2-9ea3-6020b6fa3f82 None None] MFA Rules not processed for user `188cc531d31f497289db4557078c52aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:46.815998 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-92abc626-7de2-42f2-9ea3-6020b6fa3f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:46.921595 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4b0890-8a8e-47f1-a6df-6a17a67ed1dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:46.923269 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4b0890-8a8e-47f1-a6df-6a17a67ed1dc service cinder] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:46.946346 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 820/1642] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:46 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:46.947289 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92abc626-7de2-42f2-9ea3-6020b6fa3f82 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:46.948252 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 823/1643] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:55:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:55:46.961393 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92abc626-7de2-42f2-9ea3-6020b6fa3f82 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:46.965827 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f20ae-9c08-4422-82f8-6169f280b18a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:46.966507 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f20ae-9c08-4422-82f8-6169f280b18a service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:46.966784 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f20ae-9c08-4422-82f8-6169f280b18a service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:46.967059 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f20ae-9c08-4422-82f8-6169f280b18a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:47.075253 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5f20ae-9c08-4422-82f8-6169f280b18a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:47.078062 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5f20ae-9c08-4422-82f8-6169f280b18a service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:47.092316 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 821/1644] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:55:46 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:55:47.214533 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b0890-8a8e-47f1-a6df-6a17a67ed1dc service cinder] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:47.226435 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b0890-8a8e-47f1-a6df-6a17a67ed1dc service cinder] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:47.237634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223ee7f-dcc2-4c4b-b831-08c40ad8f781 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:47.238527 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223ee7f-dcc2-4c4b-b831-08c40ad8f781 service cinder] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:47.240228 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223ee7f-dcc2-4c4b-b831-08c40ad8f781 service cinder] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:47.240524 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223ee7f-dcc2-4c4b-b831-08c40ad8f781 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:47.266895 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223ee7f-dcc2-4c4b-b831-08c40ad8f781 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:47.271066 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223ee7f-dcc2-4c4b-b831-08c40ad8f781 service cinder] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:47.294727 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 824/1645] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:55:47 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:55:47.562740 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f20ae-9c08-4422-82f8-6169f280b18a service cinder] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:47.572846 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f20ae-9c08-4422-82f8-6169f280b18a service cinder] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:47.584311 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1ccc4-0b75-4e06-9390-08cb5b487b09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:47.585855 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1ccc4-0b75-4e06-9390-08cb5b487b09 service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:47.586137 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1ccc4-0b75-4e06-9390-08cb5b487b09 service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:47.586408 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1ccc4-0b75-4e06-9390-08cb5b487b09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:47.665811 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:47.771221 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1ccc4-0b75-4e06-9390-08cb5b487b09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:47.774545 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1ccc4-0b75-4e06-9390-08cb5b487b09 service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:47.795936 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 822/1646] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:55:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:55:48.226276 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223ee7f-dcc2-4c4b-b831-08c40ad8f781 service cinder] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:48.300257 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:48.395970 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223ee7f-dcc2-4c4b-b831-08c40ad8f781 service cinder] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:48.411827 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c9758-ffd3-4116-bf00-43f17726b513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:48.412734 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c9758-ffd3-4116-bf00-43f17726b513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:48.413610 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c9758-ffd3-4116-bf00-43f17726b513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:48.414711 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c9758-ffd3-4116-bf00-43f17726b513 admin admin] PATH_INFO: `/v3/users/7a948d1b970a4d58ac62311dcc33522f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:48.417067 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037c9758-ffd3-4116-bf00-43f17726b513 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a948d1b970a4d58ac62311dcc33522f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:48.421023 dv-cinder-859318-1-smb devstack@keystone.service[81277]: WARNING py.warnings [None req-037c9758-ffd3-4116-bf00-43f17726b513 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 17:55:48.421023 dv-cinder-859318-1-smb devstack@keystone.service[81277]: warnings.warn(msg) Sep 26 17:55:48.421023 dv-cinder-859318-1-smb devstack@keystone.service[81277]: Sep 26 17:55:48.425685 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037c9758-ffd3-4116-bf00-43f17726b513 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:48.598421 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-037c9758-ffd3-4116-bf00-43f17726b513 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a948d1b970a4d58ac62311dcc33522f'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:48.611022 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-037c9758-ffd3-4116-bf00-43f17726b513 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a948d1b970a4d58ac62311dcc33522f'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:48.611774 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-037c9758-ffd3-4116-bf00-43f17726b513 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a948d1b970a4d58ac62311dcc33522f'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:48.612850 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-037c9758-ffd3-4116-bf00-43f17726b513 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a948d1b970a4d58ac62311dcc33522f'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:48.638675 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5a56b-c117-45a1-b2f3-74f000a6529c None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:48.640596 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5a56b-c117-45a1-b2f3-74f000a6529c None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:48.640596 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5a56b-c117-45a1-b2f3-74f000a6529c None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:48.643464 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 823/1647] 10.222.0.62 () {54 vars in 961 bytes} [Mon Sep 26 17:55:48 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:55:48.656510 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-037c9758-ffd3-4116-bf00-43f17726b513 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a948d1b970a4d58ac62311dcc33522f'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:48.659693 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ae49a-0268-4bda-9393-0e7c1298a23b None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:48.660440 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ae49a-0268-4bda-9393-0e7c1298a23b None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:48.660724 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ae49a-0268-4bda-9393-0e7c1298a23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:48.711037 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-0f1ae49a-0268-4bda-9393-0e7c1298a23b None None] MFA Rules not processed for user `1792e79b9c9a47e1923f19bfd2cd495b`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:48.714333 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-0f1ae49a-0268-4bda-9393-0e7c1298a23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:48.736020 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 824/1648] 10.222.0.62 () {58 vars in 1058 bytes} [Mon Sep 26 17:55:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 26 17:55:48.737344 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ae49a-0268-4bda-9393-0e7c1298a23b None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:48.738960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-0f1ae49a-0268-4bda-9393-0e7c1298a23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:48.741539 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 825/1649] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:55:48 2022] DELETE /identity/v3/users/7a948d1b970a4d58ac62311dcc33522f => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:55:48.746641 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2d286-6795-4faf-818b-78dfc6bf77c9 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:48.747113 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2d286-6795-4faf-818b-78dfc6bf77c9 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:48.747594 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2d286-6795-4faf-818b-78dfc6bf77c9 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:48.753660 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 826/1650] 10.222.0.62 () {54 vars in 912 bytes} [Mon Sep 26 17:55:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:55:48.755481 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe809823-6470-4357-bd74-7941a4e3fe2c None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:48.755964 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe809823-6470-4357-bd74-7941a4e3fe2c None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:48.756437 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe809823-6470-4357-bd74-7941a4e3fe2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:48.760780 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ae49a-0268-4bda-9393-0e7c1298a23b None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:48.806319 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-fe809823-6470-4357-bd74-7941a4e3fe2c None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:48.808992 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-fe809823-6470-4357-bd74-7941a4e3fe2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:48.850047 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e728e-4f9c-4dbb-acec-4d1637b62f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:48.850929 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e728e-4f9c-4dbb-acec-4d1637b62f93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:48.851153 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e728e-4f9c-4dbb-acec-4d1637b62f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:48.851414 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e728e-4f9c-4dbb-acec-4d1637b62f93 admin admin] PATH_INFO: `/v3/users/3b67d80c89c24561a57bc9e0fd8af7e6` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:48.852762 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e728e-4f9c-4dbb-acec-4d1637b62f93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b67d80c89c24561a57bc9e0fd8af7e6)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:48.855026 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e728e-4f9c-4dbb-acec-4d1637b62f93 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:48.991176 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-7d4e728e-4f9c-4dbb-acec-4d1637b62f93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b67d80c89c24561a57bc9e0fd8af7e6'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:48.991176 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-7d4e728e-4f9c-4dbb-acec-4d1637b62f93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b67d80c89c24561a57bc9e0fd8af7e6'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:48.991176 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-7d4e728e-4f9c-4dbb-acec-4d1637b62f93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b67d80c89c24561a57bc9e0fd8af7e6'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:48.991772 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 827/1651] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:48.991772 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf240b0-cb79-418f-a8ff-27d49ea5b4dc None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:48.991772 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf240b0-cb79-418f-a8ff-27d49ea5b4dc None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:48.991772 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf240b0-cb79-418f-a8ff-27d49ea5b4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:48.993839 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-7d4e728e-4f9c-4dbb-acec-4d1637b62f93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b67d80c89c24561a57bc9e0fd8af7e6'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:49.022344 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-7d4e728e-4f9c-4dbb-acec-4d1637b62f93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b67d80c89c24561a57bc9e0fd8af7e6'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:49.035811 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-cbf240b0-cb79-418f-a8ff-27d49ea5b4dc None None] MFA Rules not processed for user `1792e79b9c9a47e1923f19bfd2cd495b`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:49.037377 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-cbf240b0-cb79-418f-a8ff-27d49ea5b4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:49.071529 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 825/1652] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:55:48 2022] DELETE /identity/v3/users/3b67d80c89c24561a57bc9e0fd8af7e6 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:55:49.075914 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43740ea5-e783-4ec9-a667-c3a471a562ff None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:49.076397 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43740ea5-e783-4ec9-a667-c3a471a562ff None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:49.076910 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43740ea5-e783-4ec9-a667-c3a471a562ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:49.121610 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:49.122420 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-43740ea5-e783-4ec9-a667-c3a471a562ff None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:49.127086 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-43740ea5-e783-4ec9-a667-c3a471a562ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:49.154255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 828/1653] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Sep 26 17:55:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:49.156289 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf240b0-cb79-418f-a8ff-27d49ea5b4dc None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:49.158606 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-cbf240b0-cb79-418f-a8ff-27d49ea5b4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:49.203676 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:49.271334 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 826/1654] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:49.272665 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43740ea5-e783-4ec9-a667-c3a471a562ff None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:49.274127 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf240b0-cb79-418f-a8ff-27d49ea5b4dc None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:49.277083 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-43740ea5-e783-4ec9-a667-c3a471a562ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:49.418904 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0267575-b477-40e3-9c86-fee452fc46cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:49.422952 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0267575-b477-40e3-9c86-fee452fc46cb service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:49.423376 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0267575-b477-40e3-9c86-fee452fc46cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:49.423876 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0267575-b477-40e3-9c86-fee452fc46cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:49.428556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-f0267575-b477-40e3-9c86-fee452fc46cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:49.436841 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43740ea5-e783-4ec9-a667-c3a471a562ff None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:49.441655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4325a1-3b60-4b50-b60a-4789a221c0ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:49.442340 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4325a1-3b60-4b50-b60a-4789a221c0ed service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:49.442708 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4325a1-3b60-4b50-b60a-4789a221c0ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:49.443046 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4325a1-3b60-4b50-b60a-4789a221c0ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:49.452121 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0267575-b477-40e3-9c86-fee452fc46cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:49.454837 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0267575-b477-40e3-9c86-fee452fc46cb service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:49.480570 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 829/1655] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:55:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:55:49.484889 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0267575-b477-40e3-9c86-fee452fc46cb service neutron] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:49.488278 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-f0267575-b477-40e3-9c86-fee452fc46cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:49.503837 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0267575-b477-40e3-9c86-fee452fc46cb service neutron] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:49.511180 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e404375-3c9a-42c8-a681-dce49aa57d31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:49.512290 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e404375-3c9a-42c8-a681-dce49aa57d31 service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:49.512956 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e404375-3c9a-42c8-a681-dce49aa57d31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:49.513369 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e404375-3c9a-42c8-a681-dce49aa57d31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:49.526622 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e404375-3c9a-42c8-a681-dce49aa57d31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:49.529362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e404375-3c9a-42c8-a681-dce49aa57d31 service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:49.543534 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 830/1656] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:55:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:55:49.572303 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4325a1-3b60-4b50-b60a-4789a221c0ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:49.576799 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4325a1-3b60-4b50-b60a-4789a221c0ed service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:49.615491 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 827/1657] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:55:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:55:50.256874 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e404375-3c9a-42c8-a681-dce49aa57d31 service neutron] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:50.259552 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-2e404375-3c9a-42c8-a681-dce49aa57d31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:50.302499 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e404375-3c9a-42c8-a681-dce49aa57d31 service neutron] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:50.328091 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde8fe0-70c9-4ab0-9a35-71247e145efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:50.329878 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde8fe0-70c9-4ab0-9a35-71247e145efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:50.331546 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde8fe0-70c9-4ab0-9a35-71247e145efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:50.332749 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde8fe0-70c9-4ab0-9a35-71247e145efe admin admin] PATH_INFO: `/v3/projects/b0373e8b7a114f4784c033fd0dbfd5e7` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:50.335529 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde8fe0-70c9-4ab0-9a35-71247e145efe admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0373e8b7a114f4784c033fd0dbfd5e7)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:50.344430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde8fe0-70c9-4ab0-9a35-71247e145efe admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:50.472690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-0dde8fe0-70c9-4ab0-9a35-71247e145efe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0373e8b7a114f4784c033fd0dbfd5e7', 'request_id': 'req-0dde8fe0-70c9-4ab0-9a35-71247e145efe'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:50.488428 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-0dde8fe0-70c9-4ab0-9a35-71247e145efe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0373e8b7a114f4784c033fd0dbfd5e7', 'request_id': 'req-0dde8fe0-70c9-4ab0-9a35-71247e145efe'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:50.502231 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-0dde8fe0-70c9-4ab0-9a35-71247e145efe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0373e8b7a114f4784c033fd0dbfd5e7', 'request_id': 'req-0dde8fe0-70c9-4ab0-9a35-71247e145efe'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:50.528795 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-0dde8fe0-70c9-4ab0-9a35-71247e145efe admin admin] The token cache is being invalidate because project b0373e8b7a114f4784c033fd0dbfd5e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:55:50.529341 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-0dde8fe0-70c9-4ab0-9a35-71247e145efe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:50.530293 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-0dde8fe0-70c9-4ab0-9a35-71247e145efe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:50.537679 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4325a1-3b60-4b50-b60a-4789a221c0ed service cinder] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:50.543042 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 831/1658] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:55:50 2022] DELETE /identity/v3/projects/b0373e8b7a114f4784c033fd0dbfd5e7 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:55:50.554507 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4325a1-3b60-4b50-b60a-4789a221c0ed service cinder] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:50.700391 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fab8a7-73be-4719-8076-c5021f118b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:50.701417 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fab8a7-73be-4719-8076-c5021f118b2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:50.701842 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fab8a7-73be-4719-8076-c5021f118b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:50.702250 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fab8a7-73be-4719-8076-c5021f118b2b admin admin] PATH_INFO: `/v3/users/41574a9e08214a869ea45daa7c13f2dd` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:50.704601 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fab8a7-73be-4719-8076-c5021f118b2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=41574a9e08214a869ea45daa7c13f2dd)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:50.707087 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fab8a7-73be-4719-8076-c5021f118b2b admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:50.754363 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:50.823634 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-f4fab8a7-73be-4719-8076-c5021f118b2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41574a9e08214a869ea45daa7c13f2dd'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:50.826484 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-f4fab8a7-73be-4719-8076-c5021f118b2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41574a9e08214a869ea45daa7c13f2dd'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:50.827363 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-f4fab8a7-73be-4719-8076-c5021f118b2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41574a9e08214a869ea45daa7c13f2dd'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:50.844188 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-f4fab8a7-73be-4719-8076-c5021f118b2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41574a9e08214a869ea45daa7c13f2dd'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:50.859760 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-f4fab8a7-73be-4719-8076-c5021f118b2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41574a9e08214a869ea45daa7c13f2dd'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:50.925280 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 828/1659] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:55:50 2022] DELETE /identity/v3/users/41574a9e08214a869ea45daa7c13f2dd => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:55:51.235149 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde8fe0-70c9-4ab0-9a35-71247e145efe admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:51.242188 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-0dde8fe0-70c9-4ab0-9a35-71247e145efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:51.288314 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde8fe0-70c9-4ab0-9a35-71247e145efe admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:51.307372 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:51.496296 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec0868-9723-4f82-a762-e08aaf55bdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:51.500105 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec0868-9723-4f82-a762-e08aaf55bdea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:51.500729 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec0868-9723-4f82-a762-e08aaf55bdea admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:51.501808 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec0868-9723-4f82-a762-e08aaf55bdea admin admin] PATH_INFO: `/v3/users/ec5c5dd23aef46d0884499360bc34192` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:51.505816 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec0868-9723-4f82-a762-e08aaf55bdea admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec5c5dd23aef46d0884499360bc34192)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:51.508103 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec0868-9723-4f82-a762-e08aaf55bdea admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:51.638015 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-e9ec0868-9723-4f82-a762-e08aaf55bdea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec5c5dd23aef46d0884499360bc34192'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:51.665900 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-e9ec0868-9723-4f82-a762-e08aaf55bdea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec5c5dd23aef46d0884499360bc34192'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:51.667015 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-e9ec0868-9723-4f82-a762-e08aaf55bdea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec5c5dd23aef46d0884499360bc34192'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:51.668243 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-e9ec0868-9723-4f82-a762-e08aaf55bdea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec5c5dd23aef46d0884499360bc34192'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:51.696934 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-e9ec0868-9723-4f82-a762-e08aaf55bdea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec5c5dd23aef46d0884499360bc34192'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:51.743355 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 832/1660] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:55:51 2022] DELETE /identity/v3/users/ec5c5dd23aef46d0884499360bc34192 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:55:51.744641 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffdb183-0fe6-4cc3-8837-2c170352106d None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:51.745166 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffdb183-0fe6-4cc3-8837-2c170352106d None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:51.745455 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffdb183-0fe6-4cc3-8837-2c170352106d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:51.788766 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-cffdb183-0fe6-4cc3-8837-2c170352106d None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:51.793966 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-cffdb183-0fe6-4cc3-8837-2c170352106d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:51.926956 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 829/1661] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:55:51.967811 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec0868-9723-4f82-a762-e08aaf55bdea admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:51.973457 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-e9ec0868-9723-4f82-a762-e08aaf55bdea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:52.173697 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec0868-9723-4f82-a762-e08aaf55bdea admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:52.187136 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d2fb6-1347-4e4c-8a21-be10a3957544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:52.188792 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d2fb6-1347-4e4c-8a21-be10a3957544 service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:52.189111 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d2fb6-1347-4e4c-8a21-be10a3957544 service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:52.189390 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d2fb6-1347-4e4c-8a21-be10a3957544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:52.213640 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d2fb6-1347-4e4c-8a21-be10a3957544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:52.220966 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d2fb6-1347-4e4c-8a21-be10a3957544 service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:52.260256 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 833/1662] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:55:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:55:53.157647 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffdb183-0fe6-4cc3-8837-2c170352106d None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:53.159820 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-cffdb183-0fe6-4cc3-8837-2c170352106d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:53.191675 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffdb183-0fe6-4cc3-8837-2c170352106d None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:53.205403 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85980ae-24ca-4b5d-a39f-9cfcdd9c71cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:53.206135 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85980ae-24ca-4b5d-a39f-9cfcdd9c71cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:53.206668 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85980ae-24ca-4b5d-a39f-9cfcdd9c71cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:53.207043 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85980ae-24ca-4b5d-a39f-9cfcdd9c71cd admin admin] PATH_INFO: `/v3/projects/ef70eed98541417da59fd6bc6a6920ab` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:53.208466 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85980ae-24ca-4b5d-a39f-9cfcdd9c71cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef70eed98541417da59fd6bc6a6920ab)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:53.214777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: WARNING py.warnings [None req-c85980ae-24ca-4b5d-a39f-9cfcdd9c71cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 17:55:53.214777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: warnings.warn(msg) Sep 26 17:55:53.214777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: Sep 26 17:55:53.216510 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85980ae-24ca-4b5d-a39f-9cfcdd9c71cd admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:53.394116 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-c85980ae-24ca-4b5d-a39f-9cfcdd9c71cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef70eed98541417da59fd6bc6a6920ab', 'request_id': 'req-c85980ae-24ca-4b5d-a39f-9cfcdd9c71cd'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:53.401767 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-c85980ae-24ca-4b5d-a39f-9cfcdd9c71cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef70eed98541417da59fd6bc6a6920ab', 'request_id': 'req-c85980ae-24ca-4b5d-a39f-9cfcdd9c71cd'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:53.425949 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-c85980ae-24ca-4b5d-a39f-9cfcdd9c71cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef70eed98541417da59fd6bc6a6920ab', 'request_id': 'req-c85980ae-24ca-4b5d-a39f-9cfcdd9c71cd'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:53.454859 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-c85980ae-24ca-4b5d-a39f-9cfcdd9c71cd admin admin] The token cache is being invalidate because project ef70eed98541417da59fd6bc6a6920ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:55:53.455423 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-c85980ae-24ca-4b5d-a39f-9cfcdd9c71cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:53.456376 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-c85980ae-24ca-4b5d-a39f-9cfcdd9c71cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:53.458585 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 830/1663] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:55:53 2022] DELETE /identity/v3/projects/ef70eed98541417da59fd6bc6a6920ab => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:55:53.464131 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce3060-7955-45c9-ac6d-c15701946f4b None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:53.464559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce3060-7955-45c9-ac6d-c15701946f4b None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:53.464798 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce3060-7955-45c9-ac6d-c15701946f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:53.470690 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85980ae-24ca-4b5d-a39f-9cfcdd9c71cd admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:53.478455 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-c85980ae-24ca-4b5d-a39f-9cfcdd9c71cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:53.514547 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-66ce3060-7955-45c9-ac6d-c15701946f4b None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:53.515857 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-66ce3060-7955-45c9-ac6d-c15701946f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:53.520625 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:53.603492 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:53.630906 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85980ae-24ca-4b5d-a39f-9cfcdd9c71cd admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:53.642884 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302d3ff-734e-4f20-989b-a5faba0c3439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:53.643575 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302d3ff-734e-4f20-989b-a5faba0c3439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:53.643888 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302d3ff-734e-4f20-989b-a5faba0c3439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:53.644165 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302d3ff-734e-4f20-989b-a5faba0c3439 admin admin] PATH_INFO: `/v3/projects/a119d5cc2a5d4f32ae457215a704f86e` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:53.646248 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302d3ff-734e-4f20-989b-a5faba0c3439 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a119d5cc2a5d4f32ae457215a704f86e)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:53.648356 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302d3ff-734e-4f20-989b-a5faba0c3439 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:53.712576 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 834/1664] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:55:53.725074 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7b58a-012d-4deb-a4e7-cdd7cb0018fb None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:53.725074 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7b58a-012d-4deb-a4e7-cdd7cb0018fb None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:53.725074 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7b58a-012d-4deb-a4e7-cdd7cb0018fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:53.767694 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-83b7b58a-012d-4deb-a4e7-cdd7cb0018fb None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:53.768875 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-83b7b58a-012d-4deb-a4e7-cdd7cb0018fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:53.781611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-8302d3ff-734e-4f20-989b-a5faba0c3439 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a119d5cc2a5d4f32ae457215a704f86e', 'request_id': 'req-8302d3ff-734e-4f20-989b-a5faba0c3439'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:53.805410 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-8302d3ff-734e-4f20-989b-a5faba0c3439 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a119d5cc2a5d4f32ae457215a704f86e', 'request_id': 'req-8302d3ff-734e-4f20-989b-a5faba0c3439'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:53.822416 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-8302d3ff-734e-4f20-989b-a5faba0c3439 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a119d5cc2a5d4f32ae457215a704f86e', 'request_id': 'req-8302d3ff-734e-4f20-989b-a5faba0c3439'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:53.847100 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-8302d3ff-734e-4f20-989b-a5faba0c3439 admin admin] The token cache is being invalidate because project a119d5cc2a5d4f32ae457215a704f86e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:55:53.847484 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-8302d3ff-734e-4f20-989b-a5faba0c3439 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:53.848448 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-8302d3ff-734e-4f20-989b-a5faba0c3439 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:53.850595 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 831/1665] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:55:53 2022] DELETE /identity/v3/projects/a119d5cc2a5d4f32ae457215a704f86e => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:55:53.855008 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302d3ff-734e-4f20-989b-a5faba0c3439 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:53.857466 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-8302d3ff-734e-4f20-989b-a5faba0c3439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:53.921095 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 835/1666] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:53.925516 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7b58a-012d-4deb-a4e7-cdd7cb0018fb None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:53.945929 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7b58a-012d-4deb-a4e7-cdd7cb0018fb None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:53.968736 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6ffdd-baca-4f58-b61b-f522d5029edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:53.969255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6ffdd-baca-4f58-b61b-f522d5029edf admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:53.969534 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6ffdd-baca-4f58-b61b-f522d5029edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:53.969801 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6ffdd-baca-4f58-b61b-f522d5029edf admin admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:53.970461 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c6ffdd-baca-4f58-b61b-f522d5029edf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:55:53.970758 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c6ffdd-baca-4f58-b61b-f522d5029edf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:53.980200 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c6ffdd-baca-4f58-b61b-f522d5029edf admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:54.016851 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 836/1667] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:55:54.019762 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302d3ff-734e-4f20-989b-a5faba0c3439 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:54.021573 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6ffdd-baca-4f58-b61b-f522d5029edf admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:54.034508 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709564e-31a5-4033-b0d0-91f81edea0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:54.035332 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709564e-31a5-4033-b0d0-91f81edea0df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:54.035619 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709564e-31a5-4033-b0d0-91f81edea0df admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:54.035892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709564e-31a5-4033-b0d0-91f81edea0df admin admin] PATH_INFO: `/v3/users/188cc531d31f497289db4557078c52aa` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:54.040539 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709564e-31a5-4033-b0d0-91f81edea0df admin admin] RBAC: Authorizing `identity:delete_user(user_id=188cc531d31f497289db4557078c52aa)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:54.044497 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6ffdd-baca-4f58-b61b-f522d5029edf admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:54.047363 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709564e-31a5-4033-b0d0-91f81edea0df admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:54.057565 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84f035-1958-414c-a227-e6ba69e40414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:54.059738 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84f035-1958-414c-a227-e6ba69e40414 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:54.060026 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84f035-1958-414c-a227-e6ba69e40414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:54.060306 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84f035-1958-414c-a227-e6ba69e40414 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:54.066669 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e84f035-1958-414c-a227-e6ba69e40414 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:54.073362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e84f035-1958-414c-a227-e6ba69e40414 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:54.153951 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 837/1668] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:55:54 2022] POST /identity/v3/projects => generated 357 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:55:54.156573 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84f035-1958-414c-a227-e6ba69e40414 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:54.171253 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b709564e-31a5-4033-b0d0-91f81edea0df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '188cc531d31f497289db4557078c52aa'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:54.172668 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b709564e-31a5-4033-b0d0-91f81edea0df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '188cc531d31f497289db4557078c52aa'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:54.173756 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b709564e-31a5-4033-b0d0-91f81edea0df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '188cc531d31f497289db4557078c52aa'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:54.178638 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:54.192693 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b709564e-31a5-4033-b0d0-91f81edea0df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '188cc531d31f497289db4557078c52aa'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:54.204499 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b709564e-31a5-4033-b0d0-91f81edea0df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '188cc531d31f497289db4557078c52aa'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:54.246893 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 832/1669] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:55:53 2022] DELETE /identity/v3/users/188cc531d31f497289db4557078c52aa => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:55:54.389378 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84f035-1958-414c-a227-e6ba69e40414 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:54.487371 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:54.528780 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4e35c-a0b3-45d9-bbf5-c900efd3e2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:54.529999 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4e35c-a0b3-45d9-bbf5-c900efd3e2c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:54.530282 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4e35c-a0b3-45d9-bbf5-c900efd3e2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:54.530558 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4e35c-a0b3-45d9-bbf5-c900efd3e2c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:54.531270 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4e35c-a0b3-45d9-bbf5-c900efd3e2c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:54.533249 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4e35c-a0b3-45d9-bbf5-c900efd3e2c6 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:54.611843 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 838/1670] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:55:54 2022] POST /identity/v3/users => generated 279 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:55:54.616207 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709564e-31a5-4033-b0d0-91f81edea0df admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:54.617990 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-b709564e-31a5-4033-b0d0-91f81edea0df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:54.646836 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709564e-31a5-4033-b0d0-91f81edea0df admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:54.660419 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d36ae-0494-44dc-8ad4-88bed247abca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:54.660985 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d36ae-0494-44dc-8ad4-88bed247abca admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:54.661296 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d36ae-0494-44dc-8ad4-88bed247abca admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:54.661567 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d36ae-0494-44dc-8ad4-88bed247abca admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:54.662220 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d36ae-0494-44dc-8ad4-88bed247abca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:54.663870 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d36ae-0494-44dc-8ad4-88bed247abca admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:54.706617 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 833/1671] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:55:54.710665 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4e35c-a0b3-45d9-bbf5-c900efd3e2c6 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:54.726888 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4e35c-a0b3-45d9-bbf5-c900efd3e2c6 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:54.757560 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4a608-e243-4cd5-8a1b-d3ae9d20d3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:54.758212 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4a608-e243-4cd5-8a1b-d3ae9d20d3f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:54.758782 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4a608-e243-4cd5-8a1b-d3ae9d20d3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:54.759008 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4a608-e243-4cd5-8a1b-d3ae9d20d3f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:54.759677 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4a608-e243-4cd5-8a1b-d3ae9d20d3f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:54.761514 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4a608-e243-4cd5-8a1b-d3ae9d20d3f4 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:54.796371 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 839/1672] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:55:54.801080 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d36ae-0494-44dc-8ad4-88bed247abca admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:54.829703 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d36ae-0494-44dc-8ad4-88bed247abca admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:54.846607 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee779854-e44a-4125-8dc1-0768d6370e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:54.847229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee779854-e44a-4125-8dc1-0768d6370e75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:54.847510 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee779854-e44a-4125-8dc1-0768d6370e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:54.847805 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee779854-e44a-4125-8dc1-0768d6370e75 admin admin] PATH_INFO: `/v3/projects/fdd493d7b2f849b9b351f2f75d83cb0a/users/4c8063ad188f4d1da5ff0d9053b22b39/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:54.894954 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee779854-e44a-4125-8dc1-0768d6370e75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdd493d7b2f849b9b351f2f75d83cb0a, user_id=4c8063ad188f4d1da5ff0d9053b22b39, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:54.900324 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee779854-e44a-4125-8dc1-0768d6370e75 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:54.935270 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 834/1673] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:55:54 2022] PUT /identity/v3/projects/fdd493d7b2f849b9b351f2f75d83cb0a/users/4c8063ad188f4d1da5ff0d9053b22b39/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:55:54.945706 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03520fe6-5b85-45d0-ac52-8b09c7e17d77 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:54.945999 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03520fe6-5b85-45d0-ac52-8b09c7e17d77 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:54.946277 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03520fe6-5b85-45d0-ac52-8b09c7e17d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:55.031456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-03520fe6-5b85-45d0-ac52-8b09c7e17d77 None None] MFA Rules not processed for user `4c8063ad188f4d1da5ff0d9053b22b39`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:55.033100 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-03520fe6-5b85-45d0-ac52-8b09c7e17d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:55.168733 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee779854-e44a-4125-8dc1-0768d6370e75 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:55.174277 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-ee779854-e44a-4125-8dc1-0768d6370e75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:55.189416 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 840/1674] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:54 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:55.194147 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03520fe6-5b85-45d0-ac52-8b09c7e17d77 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:55.349616 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03520fe6-5b85-45d0-ac52-8b09c7e17d77 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:55.361561 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30eb53-90bb-44e6-ba2e-627ddabdf6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:55.362231 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30eb53-90bb-44e6-ba2e-627ddabdf6f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:55.362520 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30eb53-90bb-44e6-ba2e-627ddabdf6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:55.363129 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30eb53-90bb-44e6-ba2e-627ddabdf6f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:55.363834 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b30eb53-90bb-44e6-ba2e-627ddabdf6f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:55.365950 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b30eb53-90bb-44e6-ba2e-627ddabdf6f1 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:55.384138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee779854-e44a-4125-8dc1-0768d6370e75 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:55.390373 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea09f27-3d82-4171-9fe4-241031beb5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:55.391036 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea09f27-3d82-4171-9fe4-241031beb5ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:55.391452 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea09f27-3d82-4171-9fe4-241031beb5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:55.391767 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea09f27-3d82-4171-9fe4-241031beb5ff admin admin] PATH_INFO: `/v3/users/07e1320968e144a1b74f58b9e9dc2807` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:55.393154 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea09f27-3d82-4171-9fe4-241031beb5ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=07e1320968e144a1b74f58b9e9dc2807)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:55.395428 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea09f27-3d82-4171-9fe4-241031beb5ff admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:55.418456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 841/1675] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:55:55 2022] POST /identity/v3/projects => generated 357 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:55:55.418456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30eb53-90bb-44e6-ba2e-627ddabdf6f1 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:55.421814 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-1b30eb53-90bb-44e6-ba2e-627ddabdf6f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:55.567444 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-eea09f27-3d82-4171-9fe4-241031beb5ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07e1320968e144a1b74f58b9e9dc2807'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:55.568144 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-eea09f27-3d82-4171-9fe4-241031beb5ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07e1320968e144a1b74f58b9e9dc2807'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:55.568763 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-eea09f27-3d82-4171-9fe4-241031beb5ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07e1320968e144a1b74f58b9e9dc2807'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:55.579220 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:55.589759 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-eea09f27-3d82-4171-9fe4-241031beb5ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07e1320968e144a1b74f58b9e9dc2807'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:55.618593 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-eea09f27-3d82-4171-9fe4-241031beb5ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07e1320968e144a1b74f58b9e9dc2807'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:55.656054 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30eb53-90bb-44e6-ba2e-627ddabdf6f1 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:55.659465 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 835/1676] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:55:55 2022] DELETE /identity/v3/users/07e1320968e144a1b74f58b9e9dc2807 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:55:55.659465 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea09f27-3d82-4171-9fe4-241031beb5ff admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:55.662756 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-eea09f27-3d82-4171-9fe4-241031beb5ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:55.689769 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=84,keystone:INSERT=3,keystone:DELETE=13 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:55.781780 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41518943-8a6f-4e0f-b0ad-d2b639a243f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:55.782713 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41518943-8a6f-4e0f-b0ad-d2b639a243f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:55.783000 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41518943-8a6f-4e0f-b0ad-d2b639a243f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:55.783278 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41518943-8a6f-4e0f-b0ad-d2b639a243f3 admin admin] PATH_INFO: `/v3/projects/c21d57e79f5d4008b715a9694dbd6fe9` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:55.784883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41518943-8a6f-4e0f-b0ad-d2b639a243f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c21d57e79f5d4008b715a9694dbd6fe9)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:55.786435 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea09f27-3d82-4171-9fe4-241031beb5ff admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:55.786976 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41518943-8a6f-4e0f-b0ad-d2b639a243f3 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:55.792610 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92d82f-2f84-47ac-b0dc-33a783e60506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:55.793327 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92d82f-2f84-47ac-b0dc-33a783e60506 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:55.794150 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92d82f-2f84-47ac-b0dc-33a783e60506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:55.794150 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92d82f-2f84-47ac-b0dc-33a783e60506 admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:55.794525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea92d82f-2f84-47ac-b0dc-33a783e60506 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:55.796633 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea92d82f-2f84-47ac-b0dc-33a783e60506 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:55.843549 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 836/1677] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:55:55 2022] POST /identity/v3/users => generated 285 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:55:55.849143 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b08b15-e2c7-4c36-9f92-c9419b57abb6 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:55.849557 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b08b15-e2c7-4c36-9f92-c9419b57abb6 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:55.849885 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b08b15-e2c7-4c36-9f92-c9419b57abb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:55.871628 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-41518943-8a6f-4e0f-b0ad-d2b639a243f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c21d57e79f5d4008b715a9694dbd6fe9', 'request_id': 'req-41518943-8a6f-4e0f-b0ad-d2b639a243f3'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:55.898007 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-54b08b15-e2c7-4c36-9f92-c9419b57abb6 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:55.899292 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-54b08b15-e2c7-4c36-9f92-c9419b57abb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:55.911422 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-41518943-8a6f-4e0f-b0ad-d2b639a243f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c21d57e79f5d4008b715a9694dbd6fe9', 'request_id': 'req-41518943-8a6f-4e0f-b0ad-d2b639a243f3'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:55.926703 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-41518943-8a6f-4e0f-b0ad-d2b639a243f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c21d57e79f5d4008b715a9694dbd6fe9', 'request_id': 'req-41518943-8a6f-4e0f-b0ad-d2b639a243f3'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:55.958362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-41518943-8a6f-4e0f-b0ad-d2b639a243f3 admin admin] The token cache is being invalidate because project c21d57e79f5d4008b715a9694dbd6fe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:55:55.958657 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-41518943-8a6f-4e0f-b0ad-d2b639a243f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:55.960440 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-41518943-8a6f-4e0f-b0ad-d2b639a243f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:55.965205 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 842/1678] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:55:55 2022] DELETE /identity/v3/projects/c21d57e79f5d4008b715a9694dbd6fe9 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:55:55.966324 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41518943-8a6f-4e0f-b0ad-d2b639a243f3 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:55.968083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-41518943-8a6f-4e0f-b0ad-d2b639a243f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:56.047811 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 837/1679] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:56.050949 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf696b1-94ec-40bf-909d-e67b2647f046 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:56.050949 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf696b1-94ec-40bf-909d-e67b2647f046 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:56.050949 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf696b1-94ec-40bf-909d-e67b2647f046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:56.084653 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41518943-8a6f-4e0f-b0ad-d2b639a243f3 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:56.090161 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac0d6c-ba8f-4b96-bfaa-5490681fa2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:56.090941 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac0d6c-ba8f-4b96-bfaa-5490681fa2b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:56.091226 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac0d6c-ba8f-4b96-bfaa-5490681fa2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:56.091495 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac0d6c-ba8f-4b96-bfaa-5490681fa2b0 admin admin] PATH_INFO: `/v3/projects/a3ac35ebeb0b4f689a9e2707ea939e1a` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:56.092844 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac0d6c-ba8f-4b96-bfaa-5490681fa2b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3ac35ebeb0b4f689a9e2707ea939e1a)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:56.104196 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac0d6c-ba8f-4b96-bfaa-5490681fa2b0 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:56.135805 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-2cf696b1-94ec-40bf-909d-e67b2647f046 None None] MFA Rules not processed for user `a3e5d3a7379042d4a04a23effdeba6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:56.139467 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:56.140766 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-2cf696b1-94ec-40bf-909d-e67b2647f046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:56.211846 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-2eac0d6c-ba8f-4b96-bfaa-5490681fa2b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3ac35ebeb0b4f689a9e2707ea939e1a', 'request_id': 'req-2eac0d6c-ba8f-4b96-bfaa-5490681fa2b0'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:56.220354 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-2eac0d6c-ba8f-4b96-bfaa-5490681fa2b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3ac35ebeb0b4f689a9e2707ea939e1a', 'request_id': 'req-2eac0d6c-ba8f-4b96-bfaa-5490681fa2b0'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:56.229088 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-2eac0d6c-ba8f-4b96-bfaa-5490681fa2b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3ac35ebeb0b4f689a9e2707ea939e1a', 'request_id': 'req-2eac0d6c-ba8f-4b96-bfaa-5490681fa2b0'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:56.246049 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-2eac0d6c-ba8f-4b96-bfaa-5490681fa2b0 admin admin] The token cache is being invalidate because project a3ac35ebeb0b4f689a9e2707ea939e1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:55:56.247236 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-2eac0d6c-ba8f-4b96-bfaa-5490681fa2b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:56.248919 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-2eac0d6c-ba8f-4b96-bfaa-5490681fa2b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:56.256249 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 843/1680] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:55:55 2022] DELETE /identity/v3/projects/a3ac35ebeb0b4f689a9e2707ea939e1a => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:55:56.257539 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac0d6c-ba8f-4b96-bfaa-5490681fa2b0 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:56.259056 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-2eac0d6c-ba8f-4b96-bfaa-5490681fa2b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:56.320173 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 838/1681] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:56.322760 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6493653-584c-472b-82a4-25b2086ce0ac None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:56.323046 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6493653-584c-472b-82a4-25b2086ce0ac None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:56.323319 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6493653-584c-472b-82a4-25b2086ce0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:56.368721 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-b6493653-584c-472b-82a4-25b2086ce0ac None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:56.369989 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-b6493653-584c-472b-82a4-25b2086ce0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:56.429099 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:56.456975 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac0d6c-ba8f-4b96-bfaa-5490681fa2b0 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:56.462619 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adbf1d-ef13-47ef-aa22-c0dfb029a07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:56.463090 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adbf1d-ef13-47ef-aa22-c0dfb029a07e admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:56.463367 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adbf1d-ef13-47ef-aa22-c0dfb029a07e admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:56.463634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adbf1d-ef13-47ef-aa22-c0dfb029a07e admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:56.464348 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28adbf1d-ef13-47ef-aa22-c0dfb029a07e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:56.466114 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28adbf1d-ef13-47ef-aa22-c0dfb029a07e admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:56.502594 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 844/1682] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:55:56.506821 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adbf1d-ef13-47ef-aa22-c0dfb029a07e admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:56.510964 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-28adbf1d-ef13-47ef-aa22-c0dfb029a07e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:56.524156 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 839/1683] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:56.526989 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b4733-fa97-48b0-817e-ae54f60f23e9 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:56.527412 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b4733-fa97-48b0-817e-ae54f60f23e9 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:56.527790 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b4733-fa97-48b0-817e-ae54f60f23e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:56.578671 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-417b4733-fa97-48b0-817e-ae54f60f23e9 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:56.580171 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-417b4733-fa97-48b0-817e-ae54f60f23e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:56.615510 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 840/1684] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:56.617389 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c8884-ebd1-471a-ba52-307a5ca9269e None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:56.617776 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c8884-ebd1-471a-ba52-307a5ca9269e None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:56.618533 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c8884-ebd1-471a-ba52-307a5ca9269e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:56.672383 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adbf1d-ef13-47ef-aa22-c0dfb029a07e admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:56.673257 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-107c8884-ebd1-471a-ba52-307a5ca9269e None None] MFA Rules not processed for user `a3e5d3a7379042d4a04a23effdeba6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:56.674795 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-107c8884-ebd1-471a-ba52-307a5ca9269e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:56.682709 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25331436-76c1-4ba8-8dd6-fb820d7031e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:56.683496 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25331436-76c1-4ba8-8dd6-fb820d7031e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:56.683859 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25331436-76c1-4ba8-8dd6-fb820d7031e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:56.684150 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25331436-76c1-4ba8-8dd6-fb820d7031e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:56.689416 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-25331436-76c1-4ba8-8dd6-fb820d7031e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:56.719918 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25331436-76c1-4ba8-8dd6-fb820d7031e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:56.721463 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25331436-76c1-4ba8-8dd6-fb820d7031e1 service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:56.750186 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 845/1685] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:55:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:55:56.751146 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25331436-76c1-4ba8-8dd6-fb820d7031e1 service neutron] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:56.773048 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25331436-76c1-4ba8-8dd6-fb820d7031e1 service neutron] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:56.783482 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83799961-bd08-469e-9bd7-7d3e1b11336d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:56.784179 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83799961-bd08-469e-9bd7-7d3e1b11336d admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:56.784464 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83799961-bd08-469e-9bd7-7d3e1b11336d admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:56.784742 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83799961-bd08-469e-9bd7-7d3e1b11336d admin admin] PATH_INFO: `/v3/projects/506b2a042375460d94bd89b1a2aaacb1/users/e671cd2f11b545d48f9336efb2f119de/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:56.787607 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 841/1686] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:56.789157 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9e1cb-4771-4371-a435-9c40acd5ab52 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:56.789683 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9e1cb-4771-4371-a435-9c40acd5ab52 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:56.790192 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9e1cb-4771-4371-a435-9c40acd5ab52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:56.825362 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-11b9e1cb-4771-4371-a435-9c40acd5ab52 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:56.829953 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-11b9e1cb-4771-4371-a435-9c40acd5ab52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:56.831135 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83799961-bd08-469e-9bd7-7d3e1b11336d admin admin] RBAC: Authorizing `identity:create_grant(project_id=506b2a042375460d94bd89b1a2aaacb1, user_id=e671cd2f11b545d48f9336efb2f119de, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:56.834203 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83799961-bd08-469e-9bd7-7d3e1b11336d admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:56.849496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 842/1687] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:56.851149 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f333f7c-7460-4684-821e-f327f9078108 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:56.852166 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f333f7c-7460-4684-821e-f327f9078108 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:56.852940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f333f7c-7460-4684-821e-f327f9078108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:56.862915 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 846/1688] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:55:56 2022] PUT /identity/v3/projects/506b2a042375460d94bd89b1a2aaacb1/users/e671cd2f11b545d48f9336efb2f119de/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:55:56.868309 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83799961-bd08-469e-9bd7-7d3e1b11336d admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:56.872715 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-83799961-bd08-469e-9bd7-7d3e1b11336d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:56.885185 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-5f333f7c-7460-4684-821e-f327f9078108 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:56.887330 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-5f333f7c-7460-4684-821e-f327f9078108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:56.925503 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:56.999695 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 843/1689] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:57.000611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f333f7c-7460-4684-821e-f327f9078108 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:57.026189 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f333f7c-7460-4684-821e-f327f9078108 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:57.037589 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b98b3a-6e05-4296-84db-f18bb0bac280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:57.038890 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b98b3a-6e05-4296-84db-f18bb0bac280 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:57.038890 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b98b3a-6e05-4296-84db-f18bb0bac280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:57.038890 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b98b3a-6e05-4296-84db-f18bb0bac280 admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:57.039809 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b98b3a-6e05-4296-84db-f18bb0bac280 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:55:57.041233 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b98b3a-6e05-4296-84db-f18bb0bac280 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:57.045398 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b98b3a-6e05-4296-84db-f18bb0bac280 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:57.048659 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83799961-bd08-469e-9bd7-7d3e1b11336d admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:57.063191 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9df515-868f-4505-83bb-489ffa99d992 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:57.064862 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9df515-868f-4505-83bb-489ffa99d992 service nova] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:57.065271 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9df515-868f-4505-83bb-489ffa99d992 service nova] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:57.065643 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9df515-868f-4505-83bb-489ffa99d992 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:57.073894 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 844/1690] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:55:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:55:57.075179 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b98b3a-6e05-4296-84db-f18bb0bac280 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:57.106683 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b98b3a-6e05-4296-84db-f18bb0bac280 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:57.116921 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabc13e-4a9a-44b6-a25b-bf8434c1f889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:57.117704 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabc13e-4a9a-44b6-a25b-bf8434c1f889 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:57.118615 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabc13e-4a9a-44b6-a25b-bf8434c1f889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:57.118964 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabc13e-4a9a-44b6-a25b-bf8434c1f889 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:57.121646 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabc13e-4a9a-44b6-a25b-bf8434c1f889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:57.123887 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabc13e-4a9a-44b6-a25b-bf8434c1f889 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:57.151959 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 845/1691] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:55:57.158653 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabc13e-4a9a-44b6-a25b-bf8434c1f889 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:57.182132 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9df515-868f-4505-83bb-489ffa99d992 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:57.182605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabc13e-4a9a-44b6-a25b-bf8434c1f889 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:57.185322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9df515-868f-4505-83bb-489ffa99d992 service nova] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:57.196156 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee0b0b-0fe3-437e-adc5-d838e1936f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:57.196894 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee0b0b-0fe3-437e-adc5-d838e1936f2c admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:57.197297 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee0b0b-0fe3-437e-adc5-d838e1936f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:57.197666 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee0b0b-0fe3-437e-adc5-d838e1936f2c admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:57.198423 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee0b0b-0fe3-437e-adc5-d838e1936f2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:55:57.199835 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee0b0b-0fe3-437e-adc5-d838e1936f2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:57.204679 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee0b0b-0fe3-437e-adc5-d838e1936f2c admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:57.210227 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 847/1692] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:55:56 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:55:57.210946 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9df515-868f-4505-83bb-489ffa99d992 service nova] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:57.270307 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 846/1693] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:55:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:55:57.270307 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee0b0b-0fe3-437e-adc5-d838e1936f2c admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:57.280566 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9df515-868f-4505-83bb-489ffa99d992 service nova] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:57.283883 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee0b0b-0fe3-437e-adc5-d838e1936f2c admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:57.299011 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa83de3-c0a1-44e6-950e-66cd2ac374fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:57.299707 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa83de3-c0a1-44e6-950e-66cd2ac374fa admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:57.299985 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa83de3-c0a1-44e6-950e-66cd2ac374fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:57.300257 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa83de3-c0a1-44e6-950e-66cd2ac374fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:57.301196 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa83de3-c0a1-44e6-950e-66cd2ac374fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:57.303586 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa83de3-c0a1-44e6-950e-66cd2ac374fa admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:57.319259 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524451b-dddd-4ddf-b7ac-f36e82b290d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:57.320460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524451b-dddd-4ddf-b7ac-f36e82b290d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:57.320973 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524451b-dddd-4ddf-b7ac-f36e82b290d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:57.321818 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524451b-dddd-4ddf-b7ac-f36e82b290d8 admin admin] PATH_INFO: `/v3/projects/506b2a042375460d94bd89b1a2aaacb1/users/e671cd2f11b545d48f9336efb2f119de/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:57.335350 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524451b-dddd-4ddf-b7ac-f36e82b290d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=506b2a042375460d94bd89b1a2aaacb1, user_id=e671cd2f11b545d48f9336efb2f119de, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:57.340563 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524451b-dddd-4ddf-b7ac-f36e82b290d8 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:57.401307 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 847/1694] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:55:57 2022] PUT /identity/v3/projects/506b2a042375460d94bd89b1a2aaacb1/users/e671cd2f11b545d48f9336efb2f119de/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:55:57.402455 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524451b-dddd-4ddf-b7ac-f36e82b290d8 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:57.424177 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 848/1695] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:55:57 2022] POST /identity/v3/projects => generated 367 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:55:57.425375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7ad75-92d4-464f-8433-7d7a1d57aa2a None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:57.425660 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7ad75-92d4-464f-8433-7d7a1d57aa2a None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:57.425932 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7ad75-92d4-464f-8433-7d7a1d57aa2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:57.446623 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:57.532032 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-cbe7ad75-92d4-464f-8433-7d7a1d57aa2a None None] MFA Rules not processed for user `e671cd2f11b545d48f9336efb2f119de`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:57.533397 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-cbe7ad75-92d4-464f-8433-7d7a1d57aa2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:57.636919 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524451b-dddd-4ddf-b7ac-f36e82b290d8 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:57.750271 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 849/1696] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:57 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:57.750963 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7ad75-92d4-464f-8433-7d7a1d57aa2a None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:57.807001 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1ae46-4a91-4b4c-8956-334ecdbf0041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:57.807927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1ae46-4a91-4b4c-8956-334ecdbf0041 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:57.808663 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1ae46-4a91-4b4c-8956-334ecdbf0041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:57.809186 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1ae46-4a91-4b4c-8956-334ecdbf0041 admin admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:57.810021 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b1ae46-4a91-4b4c-8956-334ecdbf0041 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:57.812923 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b1ae46-4a91-4b4c-8956-334ecdbf0041 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:57.835445 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:57.879652 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 848/1697] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:55:57 2022] POST /identity/v3/projects => generated 387 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:55:57.879652 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1ae46-4a91-4b4c-8956-334ecdbf0041 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:57.887243 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-a8b1ae46-4a91-4b4c-8956-334ecdbf0041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:57.957251 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7ad75-92d4-464f-8433-7d7a1d57aa2a None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:58.056518 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1ae46-4a91-4b4c-8956-334ecdbf0041 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:58.068375 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84286506-2f67-4671-99c0-63bcc364d62d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:58.069044 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84286506-2f67-4671-99c0-63bcc364d62d service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:58.070937 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84286506-2f67-4671-99c0-63bcc364d62d service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:58.071211 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84286506-2f67-4671-99c0-63bcc364d62d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:58.074485 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a746bc5-6686-4109-b555-db63403f1cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:58.075418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a746bc5-6686-4109-b555-db63403f1cb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:58.076468 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a746bc5-6686-4109-b555-db63403f1cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:58.076960 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a746bc5-6686-4109-b555-db63403f1cb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:58.077936 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a746bc5-6686-4109-b555-db63403f1cb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:58.081111 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a746bc5-6686-4109-b555-db63403f1cb9 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:58.143530 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 850/1698] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:55:57 2022] POST /identity/v3/users => generated 284 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:55:58.147196 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a746bc5-6686-4109-b555-db63403f1cb9 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:58.169214 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a746bc5-6686-4109-b555-db63403f1cb9 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:58.185220 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba280d-56d6-4caf-96ce-2071f1ab7088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:58.185896 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba280d-56d6-4caf-96ce-2071f1ab7088 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:58.186171 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba280d-56d6-4caf-96ce-2071f1ab7088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:58.186448 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba280d-56d6-4caf-96ce-2071f1ab7088 admin admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:58.187582 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba280d-56d6-4caf-96ce-2071f1ab7088 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:58.193930 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba280d-56d6-4caf-96ce-2071f1ab7088 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:58.234090 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:58.245620 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84286506-2f67-4671-99c0-63bcc364d62d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:58.252101 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 851/1699] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:55:58 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:55:58.252101 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba280d-56d6-4caf-96ce-2071f1ab7088 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:58.252388 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84286506-2f67-4671-99c0-63bcc364d62d service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:58.277636 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 849/1700] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:55:57 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:55:58.278757 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84286506-2f67-4671-99c0-63bcc364d62d service cinder] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:58.288600 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba280d-56d6-4caf-96ce-2071f1ab7088 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:58.292979 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84286506-2f67-4671-99c0-63bcc364d62d service cinder] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:58.300057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b9650-874b-4ee4-9115-ad07e9727e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:58.301002 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b9650-874b-4ee4-9115-ad07e9727e57 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:58.301474 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b9650-874b-4ee4-9115-ad07e9727e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:58.301890 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b9650-874b-4ee4-9115-ad07e9727e57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:58.302679 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b9650-874b-4ee4-9115-ad07e9727e57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:58.305372 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b9650-874b-4ee4-9115-ad07e9727e57 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:58.316075 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99320310-8ea0-4fe9-8971-1d9d21e59a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:58.316936 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99320310-8ea0-4fe9-8971-1d9d21e59a8f admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:58.317255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99320310-8ea0-4fe9-8971-1d9d21e59a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:58.317505 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99320310-8ea0-4fe9-8971-1d9d21e59a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:58.318366 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99320310-8ea0-4fe9-8971-1d9d21e59a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:58.321996 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99320310-8ea0-4fe9-8971-1d9d21e59a8f admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:58.334282 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 850/1701] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:55:58.345787 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b9650-874b-4ee4-9115-ad07e9727e57 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:58.360407 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 852/1702] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:55:58.375301 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99320310-8ea0-4fe9-8971-1d9d21e59a8f admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:58.385222 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b9650-874b-4ee4-9115-ad07e9727e57 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:58.398552 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c106728-fc60-4dbc-beef-098d69fc21e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:58.401347 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c106728-fc60-4dbc-beef-098d69fc21e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:58.401802 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c106728-fc60-4dbc-beef-098d69fc21e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:58.402144 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c106728-fc60-4dbc-beef-098d69fc21e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:58.403327 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c106728-fc60-4dbc-beef-098d69fc21e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:58.406824 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c106728-fc60-4dbc-beef-098d69fc21e6 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:58.409051 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99320310-8ea0-4fe9-8971-1d9d21e59a8f admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:58.430223 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 851/1703] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:55:58.431574 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c106728-fc60-4dbc-beef-098d69fc21e6 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:58.439541 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888ad97-4176-4134-8095-dac21375795b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:58.440862 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888ad97-4176-4134-8095-dac21375795b admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:58.441182 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888ad97-4176-4134-8095-dac21375795b admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:58.441523 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888ad97-4176-4134-8095-dac21375795b admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:58.442452 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888ad97-4176-4134-8095-dac21375795b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:58.447783 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888ad97-4176-4134-8095-dac21375795b admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:58.457185 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c106728-fc60-4dbc-beef-098d69fc21e6 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:58.464128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7161e80-b39a-4182-b697-c1e93f3aee2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:58.464868 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7161e80-b39a-4182-b697-c1e93f3aee2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:58.465249 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7161e80-b39a-4182-b697-c1e93f3aee2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:58.465531 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7161e80-b39a-4182-b697-c1e93f3aee2e admin admin] PATH_INFO: `/v3/projects/3bbb7d347d3848b0bc58c0cbaaa31a8a/users/ed17a5979c4141e5ac6f5a92c7c3514a/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:58.486964 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 853/1704] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:55:58.490158 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888ad97-4176-4134-8095-dac21375795b admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:58.500914 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7161e80-b39a-4182-b697-c1e93f3aee2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bbb7d347d3848b0bc58c0cbaaa31a8a, user_id=ed17a5979c4141e5ac6f5a92c7c3514a, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:58.508039 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7161e80-b39a-4182-b697-c1e93f3aee2e admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:58.519539 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888ad97-4176-4134-8095-dac21375795b admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:58.526313 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dee284-5a3f-45b3-bb3a-4e0503447c7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:58.527218 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dee284-5a3f-45b3-bb3a-4e0503447c7f service cinder] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:58.535248 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dee284-5a3f-45b3-bb3a-4e0503447c7f service cinder] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:58.536090 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dee284-5a3f-45b3-bb3a-4e0503447c7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:58.543379 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-13dee284-5a3f-45b3-bb3a-4e0503447c7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:58.555808 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 852/1705] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:55:58 2022] PUT /identity/v3/projects/3bbb7d347d3848b0bc58c0cbaaa31a8a/users/ed17a5979c4141e5ac6f5a92c7c3514a/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:55:58.558438 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42b571-655b-41e2-8b1a-7894e5e3f6a6 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:58.561066 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42b571-655b-41e2-8b1a-7894e5e3f6a6 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:58.563835 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42b571-655b-41e2-8b1a-7894e5e3f6a6 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:58.568314 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 853/1706] 10.222.0.62 () {54 vars in 912 bytes} [Mon Sep 26 17:55:58 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:55:58.576900 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42b571-655b-41e2-8b1a-7894e5e3f6a6 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:58.750581 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dee284-5a3f-45b3-bb3a-4e0503447c7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:58.758371 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dee284-5a3f-45b3-bb3a-4e0503447c7f service cinder] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:58.789638 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 854/1707] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:55:58 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:55:58.791746 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6897635-e380-4af9-81d4-da038eee6974 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:58.792811 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6897635-e380-4af9-81d4-da038eee6974 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:58.793324 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6897635-e380-4af9-81d4-da038eee6974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:58.799273 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42b571-655b-41e2-8b1a-7894e5e3f6a6 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:58.819998 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c760c4d-427d-4516-99d9-3aba19ce3f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:58.822777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c760c4d-427d-4516-99d9-3aba19ce3f6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:58.823061 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c760c4d-427d-4516-99d9-3aba19ce3f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:58.823404 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c760c4d-427d-4516-99d9-3aba19ce3f6f admin admin] PATH_INFO: `/v3/projects/9e3ba9ac902148eea76898a44d5628bf/users/49de4d5bee044ce295b05819546e1dc5/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:58.858460 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-f6897635-e380-4af9-81d4-da038eee6974 None None] MFA Rules not processed for user `ed17a5979c4141e5ac6f5a92c7c3514a`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:58.860582 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-f6897635-e380-4af9-81d4-da038eee6974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:58.868235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c760c4d-427d-4516-99d9-3aba19ce3f6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e3ba9ac902148eea76898a44d5628bf, user_id=49de4d5bee044ce295b05819546e1dc5, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:58.870040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:58.876844 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c760c4d-427d-4516-99d9-3aba19ce3f6f admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:58.928513 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 854/1708] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:55:58 2022] PUT /identity/v3/projects/9e3ba9ac902148eea76898a44d5628bf/users/49de4d5bee044ce295b05819546e1dc5/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:55:58.930403 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627068a-8318-40c2-bf0e-a585b51c7c3e None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:58.930689 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627068a-8318-40c2-bf0e-a585b51c7c3e None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:58.931063 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627068a-8318-40c2-bf0e-a585b51c7c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:59.053858 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 855/1709] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:59.066609 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6897635-e380-4af9-81d4-da038eee6974 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:59.074015 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-f6897635-e380-4af9-81d4-da038eee6974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:59.093130 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-f627068a-8318-40c2-bf0e-a585b51c7c3e None None] MFA Rules not processed for user `a0ed50f4edcf468192a053b1e0fd6910`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:59.094434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-f627068a-8318-40c2-bf0e-a585b51c7c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:59.137628 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6897635-e380-4af9-81d4-da038eee6974 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:59.252818 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 855/1710] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Sep 26 17:55:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:59.254402 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5514d11-1f76-4553-9fb9-58d6d14d7bcb None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:59.254801 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5514d11-1f76-4553-9fb9-58d6d14d7bcb None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:59.255210 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5514d11-1f76-4553-9fb9-58d6d14d7bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:59.299722 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-b5514d11-1f76-4553-9fb9-58d6d14d7bcb None None] MFA Rules not processed for user `49de4d5bee044ce295b05819546e1dc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:59.301979 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-b5514d11-1f76-4553-9fb9-58d6d14d7bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:59.323157 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ddec9-5cc4-44c6-a531-c69e64d4eca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:59.324079 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ddec9-5cc4-44c6-a531-c69e64d4eca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:59.324514 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ddec9-5cc4-44c6-a531-c69e64d4eca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:59.324947 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ddec9-5cc4-44c6-a531-c69e64d4eca0 admin admin] PATH_INFO: `/v3/projects/ed730ea681334713aab91069ffb3a905` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:59.326871 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ddec9-5cc4-44c6-a531-c69e64d4eca0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed730ea681334713aab91069ffb3a905)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:59.332958 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ddec9-5cc4-44c6-a531-c69e64d4eca0 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:59.335907 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:59.466029 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-007ddec9-5cc4-44c6-a531-c69e64d4eca0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed730ea681334713aab91069ffb3a905', 'request_id': 'req-007ddec9-5cc4-44c6-a531-c69e64d4eca0'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:59.485739 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-007ddec9-5cc4-44c6-a531-c69e64d4eca0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed730ea681334713aab91069ffb3a905', 'request_id': 'req-007ddec9-5cc4-44c6-a531-c69e64d4eca0'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:59.503510 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 856/1711] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:55:59.503510 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5514d11-1f76-4553-9fb9-58d6d14d7bcb None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:59.521502 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-007ddec9-5cc4-44c6-a531-c69e64d4eca0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed730ea681334713aab91069ffb3a905', 'request_id': 'req-007ddec9-5cc4-44c6-a531-c69e64d4eca0'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:59.528907 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5514d11-1f76-4553-9fb9-58d6d14d7bcb None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:59.556617 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-007ddec9-5cc4-44c6-a531-c69e64d4eca0 admin admin] The token cache is being invalidate because project ed730ea681334713aab91069ffb3a905 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:55:59.556617 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-007ddec9-5cc4-44c6-a531-c69e64d4eca0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:59.564210 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-007ddec9-5cc4-44c6-a531-c69e64d4eca0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:55:59.567266 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 856/1712] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:55:59 2022] DELETE /identity/v3/projects/ed730ea681334713aab91069ffb3a905 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:55:59.568439 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ddec9-5cc4-44c6-a531-c69e64d4eca0 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:59.582514 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-007ddec9-5cc4-44c6-a531-c69e64d4eca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:59.675361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:55:59.703795 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a8f0ba-17c5-48e0-8dc2-6a47bf4c6528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:59.704434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8f0ba-17c5-48e0-8dc2-6a47bf4c6528 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:59.704710 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8f0ba-17c5-48e0-8dc2-6a47bf4c6528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:59.704986 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8f0ba-17c5-48e0-8dc2-6a47bf4c6528 admin admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:59.714328 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a8f0ba-17c5-48e0-8dc2-6a47bf4c6528 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:59.718265 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a8f0ba-17c5-48e0-8dc2-6a47bf4c6528 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:59.734621 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ddec9-5cc4-44c6-a531-c69e64d4eca0 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:59.743994 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef036f-eea2-4752-a2aa-c5de62446d1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:59.744635 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef036f-eea2-4752-a2aa-c5de62446d1f service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:59.744914 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef036f-eea2-4752-a2aa-c5de62446d1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:59.745212 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef036f-eea2-4752-a2aa-c5de62446d1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:59.755048 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-c0ef036f-eea2-4752-a2aa-c5de62446d1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:59.776940 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef036f-eea2-4752-a2aa-c5de62446d1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:59.778693 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef036f-eea2-4752-a2aa-c5de62446d1f service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:55:59.795483 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 857/1713] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:55:59 2022] POST /identity/v3/projects => generated 387 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:55:59.796350 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a8f0ba-17c5-48e0-8dc2-6a47bf4c6528 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:55:59.801669 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 857/1714] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:55:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:55:59.802998 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da41ce-f424-4b3b-bbd8-b65a7704bca9 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:59.803280 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da41ce-f424-4b3b-bbd8-b65a7704bca9 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:59.803549 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da41ce-f424-4b3b-bbd8-b65a7704bca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:59.807522 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-48a8f0ba-17c5-48e0-8dc2-6a47bf4c6528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:59.874356 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-f8da41ce-f424-4b3b-bbd8-b65a7704bca9 None None] MFA Rules not processed for user `2b3ef3111ca1492abd44a59756c99e22`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:55:59.875606 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-f8da41ce-f424-4b3b-bbd8-b65a7704bca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:55:59.978111 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a8f0ba-17c5-48e0-8dc2-6a47bf4c6528 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:55:59.989784 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925a380-f4f1-4527-ad4d-bb23e048dea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:55:59.990925 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925a380-f4f1-4527-ad4d-bb23e048dea7 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:55:59.990925 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925a380-f4f1-4527-ad4d-bb23e048dea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:55:59.991117 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925a380-f4f1-4527-ad4d-bb23e048dea7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:55:59.991616 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925a380-f4f1-4527-ad4d-bb23e048dea7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:55:59.993715 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925a380-f4f1-4527-ad4d-bb23e048dea7 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:00.017514 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 858/1715] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:55:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:00.020071 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da41ce-f424-4b3b-bbd8-b65a7704bca9 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:00.029991 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-f8da41ce-f424-4b3b-bbd8-b65a7704bca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:00.062122 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da41ce-f424-4b3b-bbd8-b65a7704bca9 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:00.066985 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7d197-90fe-45db-bb86-a7680c1dd313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:00.068429 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7d197-90fe-45db-bb86-a7680c1dd313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:00.068429 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7d197-90fe-45db-bb86-a7680c1dd313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:00.068767 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7d197-90fe-45db-bb86-a7680c1dd313 admin admin] PATH_INFO: `/v3/users/553facdb2f30419a9659311e65dcae47` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:00.070015 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7d197-90fe-45db-bb86-a7680c1dd313 admin admin] RBAC: Authorizing `identity:delete_user(user_id=553facdb2f30419a9659311e65dcae47)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:00.072166 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7d197-90fe-45db-bb86-a7680c1dd313 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:00.111816 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 858/1716] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:55:59 2022] POST /identity/v3/projects => generated 367 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:00.112690 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925a380-f4f1-4527-ad4d-bb23e048dea7 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:00.118022 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-4925a380-f4f1-4527-ad4d-bb23e048dea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:00.170537 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-8ef7d197-90fe-45db-bb86-a7680c1dd313 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '553facdb2f30419a9659311e65dcae47'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:00.188612 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-8ef7d197-90fe-45db-bb86-a7680c1dd313 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '553facdb2f30419a9659311e65dcae47'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:00.189504 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-8ef7d197-90fe-45db-bb86-a7680c1dd313 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '553facdb2f30419a9659311e65dcae47'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:00.191413 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-8ef7d197-90fe-45db-bb86-a7680c1dd313 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '553facdb2f30419a9659311e65dcae47'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:00.210256 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-8ef7d197-90fe-45db-bb86-a7680c1dd313 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '553facdb2f30419a9659311e65dcae47'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:00.227717 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:00.283224 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 859/1717] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:56:00 2022] DELETE /identity/v3/users/553facdb2f30419a9659311e65dcae47 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:00.286894 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7d197-90fe-45db-bb86-a7680c1dd313 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:00.299725 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-8ef7d197-90fe-45db-bb86-a7680c1dd313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:00.352971 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925a380-f4f1-4527-ad4d-bb23e048dea7 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:00.454142 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:00.503950 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17459c47-03bc-4678-bbab-7428f3579f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:00.504632 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17459c47-03bc-4678-bbab-7428f3579f67 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:00.504855 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17459c47-03bc-4678-bbab-7428f3579f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:00.505157 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17459c47-03bc-4678-bbab-7428f3579f67 admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:00.505814 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17459c47-03bc-4678-bbab-7428f3579f67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:00.511020 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17459c47-03bc-4678-bbab-7428f3579f67 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:00.546889 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7d197-90fe-45db-bb86-a7680c1dd313 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:00.561549 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 859/1718] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:56:00 2022] POST /identity/v3/users => generated 300 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:00.565058 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17459c47-03bc-4678-bbab-7428f3579f67 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:00.566492 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4ca3b-3485-46b3-adca-5b0e743e216b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:00.567246 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4ca3b-3485-46b3-adca-5b0e743e216b service nova] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:00.567358 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4ca3b-3485-46b3-adca-5b0e743e216b service nova] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:00.567993 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4ca3b-3485-46b3-adca-5b0e743e216b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:00.569964 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-17459c47-03bc-4678-bbab-7428f3579f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:00.575540 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-22e4ca3b-3485-46b3-adca-5b0e743e216b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:00.602522 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17459c47-03bc-4678-bbab-7428f3579f67 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:00.618051 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63816e07-770b-4607-af46-0b7743103ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:00.618679 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63816e07-770b-4607-af46-0b7743103ab5 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:00.618999 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63816e07-770b-4607-af46-0b7743103ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:00.619224 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63816e07-770b-4607-af46-0b7743103ab5 admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:00.619869 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63816e07-770b-4607-af46-0b7743103ab5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:00.622174 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63816e07-770b-4607-af46-0b7743103ab5 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:00.698233 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 860/1719] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:56:00 2022] POST /identity/v3/users => generated 290 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:00.699079 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63816e07-770b-4607-af46-0b7743103ab5 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:00.720158 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-63816e07-770b-4607-af46-0b7743103ab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:00.756648 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4ca3b-3485-46b3-adca-5b0e743e216b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:00.760785 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4ca3b-3485-46b3-adca-5b0e743e216b service nova] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:00.781049 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63816e07-770b-4607-af46-0b7743103ab5 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:00.796568 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f36881-7102-4419-9e31-c164485f1c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:00.797415 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 860/1720] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:00 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:00.798502 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4ca3b-3485-46b3-adca-5b0e743e216b service nova] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:00.810938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f36881-7102-4419-9e31-c164485f1c95 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:00.811266 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f36881-7102-4419-9e31-c164485f1c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:00.811540 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f36881-7102-4419-9e31-c164485f1c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:00.812333 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f36881-7102-4419-9e31-c164485f1c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:00.813887 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f36881-7102-4419-9e31-c164485f1c95 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:00.826304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4ca3b-3485-46b3-adca-5b0e743e216b service nova] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:00.844197 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567822b5-b95a-42ee-90db-b1fc0192e735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:00.844818 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567822b5-b95a-42ee-90db-b1fc0192e735 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:00.845137 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567822b5-b95a-42ee-90db-b1fc0192e735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:00.845412 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567822b5-b95a-42ee-90db-b1fc0192e735 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:00.846058 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567822b5-b95a-42ee-90db-b1fc0192e735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:00.847856 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567822b5-b95a-42ee-90db-b1fc0192e735 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:00.878002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 861/1721] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:56:00.884291 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567822b5-b95a-42ee-90db-b1fc0192e735 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:00.902263 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 861/1722] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:56:00.909828 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f36881-7102-4419-9e31-c164485f1c95 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:00.913341 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567822b5-b95a-42ee-90db-b1fc0192e735 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:00.940629 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f36881-7102-4419-9e31-c164485f1c95 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:00.941536 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ee8fc-b237-46b0-8339-e7a3c8f334d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:00.942334 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ee8fc-b237-46b0-8339-e7a3c8f334d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:00.942868 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ee8fc-b237-46b0-8339-e7a3c8f334d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:00.943118 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ee8fc-b237-46b0-8339-e7a3c8f334d3 admin admin] PATH_INFO: `/v3/projects/0679720c2675467b9b3499ee731c2bb4/users/7c2f75fe21d74c5f8c526b8ba116e578/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:00.960188 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c43b7-0c26-4bf7-9838-7498d6dbf6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:00.961134 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c43b7-0c26-4bf7-9838-7498d6dbf6c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:00.961833 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c43b7-0c26-4bf7-9838-7498d6dbf6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:00.962261 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c43b7-0c26-4bf7-9838-7498d6dbf6c5 admin admin] PATH_INFO: `/v3/projects/1fde5983dff94f388d9fe98b1770ad8c/users/c1d378ee7ef147a69d6edd2290cf0515/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:00.987687 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ee8fc-b237-46b0-8339-e7a3c8f334d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0679720c2675467b9b3499ee731c2bb4, user_id=7c2f75fe21d74c5f8c526b8ba116e578, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:00.994527 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ee8fc-b237-46b0-8339-e7a3c8f334d3 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:01.025863 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 862/1723] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:56:00 2022] PUT /identity/v3/projects/0679720c2675467b9b3499ee731c2bb4/users/7c2f75fe21d74c5f8c526b8ba116e578/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:01.032774 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ee8fc-b237-46b0-8339-e7a3c8f334d3 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:01.063897 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c43b7-0c26-4bf7-9838-7498d6dbf6c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fde5983dff94f388d9fe98b1770ad8c, user_id=c1d378ee7ef147a69d6edd2290cf0515, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:01.095063 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c43b7-0c26-4bf7-9838-7498d6dbf6c5 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:01.138998 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 862/1724] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:56:00 2022] PUT /identity/v3/projects/1fde5983dff94f388d9fe98b1770ad8c/users/c1d378ee7ef147a69d6edd2290cf0515/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:01.143505 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c43b7-0c26-4bf7-9838-7498d6dbf6c5 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:01.271515 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ee8fc-b237-46b0-8339-e7a3c8f334d3 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:01.316628 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c43b7-0c26-4bf7-9838-7498d6dbf6c5 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:01.322567 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f6129-ea17-4fa9-af74-3bd92ae960e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:01.323219 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f6129-ea17-4fa9-af74-3bd92ae960e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:01.323500 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f6129-ea17-4fa9-af74-3bd92ae960e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:01.323775 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f6129-ea17-4fa9-af74-3bd92ae960e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:01.324456 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f6129-ea17-4fa9-af74-3bd92ae960e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:01.326393 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f6129-ea17-4fa9-af74-3bd92ae960e2 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:01.351152 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 863/1725] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 17:56:01.355674 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f6129-ea17-4fa9-af74-3bd92ae960e2 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:01.403148 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f6129-ea17-4fa9-af74-3bd92ae960e2 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:01.425803 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a634e3-0170-405d-8f6b-2f9867abf33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:01.427155 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a634e3-0170-405d-8f6b-2f9867abf33c admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:01.428373 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a634e3-0170-405d-8f6b-2f9867abf33c admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:01.429118 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a634e3-0170-405d-8f6b-2f9867abf33c admin admin] PATH_INFO: `/v3/projects/1fde5983dff94f388d9fe98b1770ad8c/users/c1d378ee7ef147a69d6edd2290cf0515/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:01.432388 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:01.432958 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a634e3-0170-405d-8f6b-2f9867abf33c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fde5983dff94f388d9fe98b1770ad8c, user_id=c1d378ee7ef147a69d6edd2290cf0515, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:01.440336 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a634e3-0170-405d-8f6b-2f9867abf33c admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:01.446887 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:01.470611 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec2df9-d9e9-4016-9140-5b7853e85eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:01.471021 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 864/1726] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:56:01 2022] PUT /identity/v3/projects/1fde5983dff94f388d9fe98b1770ad8c/users/c1d378ee7ef147a69d6edd2290cf0515/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:01.472221 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec2df9-d9e9-4016-9140-5b7853e85eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:01.473416 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250879c6-83f2-4709-b0af-a04eebd1977b None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:01.473694 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250879c6-83f2-4709-b0af-a04eebd1977b None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:01.473924 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec2df9-d9e9-4016-9140-5b7853e85eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:01.474208 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec2df9-d9e9-4016-9140-5b7853e85eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:01.480377 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ec2df9-d9e9-4016-9140-5b7853e85eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:01.480774 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250879c6-83f2-4709-b0af-a04eebd1977b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:01.483817 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ec2df9-d9e9-4016-9140-5b7853e85eb1 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:01.510585 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 863/1727] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 481 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 17:56:01.527653 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51193501-04dc-45eb-9e0c-c21af73cc2cf None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:01.528404 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51193501-04dc-45eb-9e0c-c21af73cc2cf None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:01.529530 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51193501-04dc-45eb-9e0c-c21af73cc2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:01.605718 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-250879c6-83f2-4709-b0af-a04eebd1977b None None] MFA Rules not processed for user `4313fb69eafa45d2a4f8c0ac5ef47de7`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:01.609647 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-250879c6-83f2-4709-b0af-a04eebd1977b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:01.656841 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-51193501-04dc-45eb-9e0c-c21af73cc2cf None None] MFA Rules not processed for user `c1d378ee7ef147a69d6edd2290cf0515`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:01.658210 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-51193501-04dc-45eb-9e0c-c21af73cc2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:01.840548 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 865/1728] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:01.842156 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250879c6-83f2-4709-b0af-a04eebd1977b None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:01.948413 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 864/1729] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:01 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:01.955019 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51193501-04dc-45eb-9e0c-c21af73cc2cf None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:01.962445 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-51193501-04dc-45eb-9e0c-c21af73cc2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:01.979874 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250879c6-83f2-4709-b0af-a04eebd1977b None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:01.992981 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deead778-6829-4187-9210-7a11d622dbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:01.993697 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deead778-6829-4187-9210-7a11d622dbc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:01.993972 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deead778-6829-4187-9210-7a11d622dbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:01.994296 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deead778-6829-4187-9210-7a11d622dbc1 admin admin] PATH_INFO: `/v3/projects/0679720c2675467b9b3499ee731c2bb4/users/7c2f75fe21d74c5f8c526b8ba116e578/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:01.997109 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deead778-6829-4187-9210-7a11d622dbc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0679720c2675467b9b3499ee731c2bb4, user_id=7c2f75fe21d74c5f8c526b8ba116e578, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:02.004575 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deead778-6829-4187-9210-7a11d622dbc1 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:02.041679 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 866/1730] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:56:01 2022] PUT /identity/v3/projects/0679720c2675467b9b3499ee731c2bb4/users/7c2f75fe21d74c5f8c526b8ba116e578/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:02.041679 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deead778-6829-4187-9210-7a11d622dbc1 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:02.047325 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-deead778-6829-4187-9210-7a11d622dbc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:02.114068 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51193501-04dc-45eb-9e0c-c21af73cc2cf None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:02.244836 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deead778-6829-4187-9210-7a11d622dbc1 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:02.265892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadea76c-bf07-4cc4-97de-50a8f2b734b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:02.266437 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadea76c-bf07-4cc4-97de-50a8f2b734b4 service nova] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:02.266757 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadea76c-bf07-4cc4-97de-50a8f2b734b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:02.266991 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadea76c-bf07-4cc4-97de-50a8f2b734b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:02.281436 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f34dd-627b-4365-866b-2f9fea78b608 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5043d835c08458c9f3911a4741bdaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:02.281436 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f34dd-627b-4365-866b-2f9fea78b608 service placement] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:02.283055 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f34dd-627b-4365-866b-2f9fea78b608 service placement] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:02.283349 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f34dd-627b-4365-866b-2f9fea78b608 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:02.289215 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-4f6f34dd-627b-4365-866b-2f9fea78b608 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:02.305424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:02.320162 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f34dd-627b-4365-866b-2f9fea78b608 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:02.324041 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f34dd-627b-4365-866b-2f9fea78b608 service placement] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:02.373933 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 865/1731] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:02.377042 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f34dd-627b-4365-866b-2f9fea78b608 service placement] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:02.383106 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-4f6f34dd-627b-4365-866b-2f9fea78b608 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:02.400134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:02.422238 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadea76c-bf07-4cc4-97de-50a8f2b734b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:02.424107 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadea76c-bf07-4cc4-97de-50a8f2b734b4 service nova] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:02.465655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 867/1732] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:02.467419 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1cdca8-bf9b-4bbf-ac63-c718f4176a10 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:02.467759 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1cdca8-bf9b-4bbf-ac63-c718f4176a10 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:02.467984 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1cdca8-bf9b-4bbf-ac63-c718f4176a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:02.559079 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-5e1cdca8-bf9b-4bbf-ac63-c718f4176a10 None None] MFA Rules not processed for user `a3e5d3a7379042d4a04a23effdeba6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:02.560714 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-5e1cdca8-bf9b-4bbf-ac63-c718f4176a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:02.605845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f34dd-627b-4365-866b-2f9fea78b608 service placement] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:02.624337 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c9290-9448-4083-aa2f-2fd9c4ed84ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:02.624985 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c9290-9448-4083-aa2f-2fd9c4ed84ca service cinder] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:02.625335 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c9290-9448-4083-aa2f-2fd9c4ed84ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:02.625690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c9290-9448-4083-aa2f-2fd9c4ed84ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:02.752969 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 868/1733] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:02.753561 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f1fac-6053-42e0-a7d5-12c0141a5454 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:02.753760 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f1fac-6053-42e0-a7d5-12c0141a5454 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:02.754027 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f1fac-6053-42e0-a7d5-12c0141a5454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:02.829681 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-869f1fac-6053-42e0-a7d5-12c0141a5454 None None] MFA Rules not processed for user `7c2f75fe21d74c5f8c526b8ba116e578`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:02.832903 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-869f1fac-6053-42e0-a7d5-12c0141a5454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:02.892652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c9290-9448-4083-aa2f-2fd9c4ed84ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:02.894254 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c9290-9448-4083-aa2f-2fd9c4ed84ca service cinder] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:02.929212 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 866/1734] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:02 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:02.930525 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c9290-9448-4083-aa2f-2fd9c4ed84ca service cinder] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:02.932085 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-935c9290-9448-4083-aa2f-2fd9c4ed84ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:03.053679 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 869/1735] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:02 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:03.055574 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f1fac-6053-42e0-a7d5-12c0141a5454 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:03.165340 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:03.188977 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c9290-9448-4083-aa2f-2fd9c4ed84ca service cinder] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:03.193730 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f1fac-6053-42e0-a7d5-12c0141a5454 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:03.196388 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266d201-aaf2-498c-b73e-5282c3f0d21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:03.197490 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266d201-aaf2-498c-b73e-5282c3f0d21e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:03.198260 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266d201-aaf2-498c-b73e-5282c3f0d21e admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:03.204047 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266d201-aaf2-498c-b73e-5282c3f0d21e admin admin] PATH_INFO: `/v3/projects/dd15f05948b94d85b1b35b37c99bf45f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:03.205139 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e741633-9a15-417e-afc7-1055539f64bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:03.205824 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e741633-9a15-417e-afc7-1055539f64bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:03.206133 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e741633-9a15-417e-afc7-1055539f64bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:03.206399 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e741633-9a15-417e-afc7-1055539f64bf admin admin] PATH_INFO: `/v3/users/ed17a5979c4141e5ac6f5a92c7c3514a` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:03.209824 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e741633-9a15-417e-afc7-1055539f64bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed17a5979c4141e5ac6f5a92c7c3514a)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:03.211932 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266d201-aaf2-498c-b73e-5282c3f0d21e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd15f05948b94d85b1b35b37c99bf45f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:03.212057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e741633-9a15-417e-afc7-1055539f64bf admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:03.217134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266d201-aaf2-498c-b73e-5282c3f0d21e admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:03.316055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-1e741633-9a15-417e-afc7-1055539f64bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed17a5979c4141e5ac6f5a92c7c3514a'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:03.316381 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-1e741633-9a15-417e-afc7-1055539f64bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed17a5979c4141e5ac6f5a92c7c3514a'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:03.317645 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-1e741633-9a15-417e-afc7-1055539f64bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed17a5979c4141e5ac6f5a92c7c3514a'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:03.334462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-1e741633-9a15-417e-afc7-1055539f64bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed17a5979c4141e5ac6f5a92c7c3514a'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:03.340968 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-6266d201-aaf2-498c-b73e-5282c3f0d21e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd15f05948b94d85b1b35b37c99bf45f', 'request_id': 'req-6266d201-aaf2-498c-b73e-5282c3f0d21e'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:03.348026 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-1e741633-9a15-417e-afc7-1055539f64bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed17a5979c4141e5ac6f5a92c7c3514a'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:03.354323 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:03.362721 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-6266d201-aaf2-498c-b73e-5282c3f0d21e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd15f05948b94d85b1b35b37c99bf45f', 'request_id': 'req-6266d201-aaf2-498c-b73e-5282c3f0d21e'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:03.382189 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-6266d201-aaf2-498c-b73e-5282c3f0d21e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd15f05948b94d85b1b35b37c99bf45f', 'request_id': 'req-6266d201-aaf2-498c-b73e-5282c3f0d21e'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:03.395254 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 870/1736] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:56:03 2022] DELETE /identity/v3/users/ed17a5979c4141e5ac6f5a92c7c3514a => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:03.395254 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e741633-9a15-417e-afc7-1055539f64bf admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:03.401568 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-1e741633-9a15-417e-afc7-1055539f64bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:03.405637 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-6266d201-aaf2-498c-b73e-5282c3f0d21e admin admin] The token cache is being invalidate because project dd15f05948b94d85b1b35b37c99bf45f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:56:03.405931 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-6266d201-aaf2-498c-b73e-5282c3f0d21e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:03.407908 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-6266d201-aaf2-498c-b73e-5282c3f0d21e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:03.412451 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 867/1737] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:56:02 2022] DELETE /identity/v3/projects/dd15f05948b94d85b1b35b37c99bf45f => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:03.413636 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec5e51-fd3c-4559-81a7-ef821e5af56e None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:03.415964 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec5e51-fd3c-4559-81a7-ef821e5af56e None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:03.416256 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec5e51-fd3c-4559-81a7-ef821e5af56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:03.461662 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-c9ec5e51-fd3c-4559-81a7-ef821e5af56e None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:03.468657 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-c9ec5e51-fd3c-4559-81a7-ef821e5af56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:03.510449 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e741633-9a15-417e-afc7-1055539f64bf admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:03.519621 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f243b-2239-4793-829b-129aec35074d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:03.520255 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f243b-2239-4793-829b-129aec35074d service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:03.520533 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f243b-2239-4793-829b-129aec35074d service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:03.520800 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f243b-2239-4793-829b-129aec35074d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:03.525868 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-228f243b-2239-4793-829b-129aec35074d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:03.553120 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 868/1738] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:03.560310 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18dc99-6596-47f6-9830-4649e5cb7970 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:03.561149 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18dc99-6596-47f6-9830-4649e5cb7970 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:03.561661 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18dc99-6596-47f6-9830-4649e5cb7970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:03.587480 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-cf18dc99-6596-47f6-9830-4649e5cb7970 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:03.590359 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-cf18dc99-6596-47f6-9830-4649e5cb7970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:03.609085 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 869/1739] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:03.616577 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251aaff-f754-4bda-a1fb-1433d4989658 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:03.617458 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251aaff-f754-4bda-a1fb-1433d4989658 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:03.617739 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251aaff-f754-4bda-a1fb-1433d4989658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:03.646423 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-d251aaff-f754-4bda-a1fb-1433d4989658 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:03.647828 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-d251aaff-f754-4bda-a1fb-1433d4989658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:03.662317 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 870/1740] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:03.662317 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251aaff-f754-4bda-a1fb-1433d4989658 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:03.662317 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-d251aaff-f754-4bda-a1fb-1433d4989658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:03.707988 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f243b-2239-4793-829b-129aec35074d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:03.709508 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f243b-2239-4793-829b-129aec35074d service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:03.756842 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 871/1741] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:03 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:03.757893 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f243b-2239-4793-829b-129aec35074d service cinder] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:03.769973 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251aaff-f754-4bda-a1fb-1433d4989658 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:03.774467 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416afe0-a304-4f69-830c-ec6e267e7d93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:03.775235 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416afe0-a304-4f69-830c-ec6e267e7d93 service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:03.775520 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416afe0-a304-4f69-830c-ec6e267e7d93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:03.775924 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416afe0-a304-4f69-830c-ec6e267e7d93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:03.790523 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416afe0-a304-4f69-830c-ec6e267e7d93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:03.794548 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416afe0-a304-4f69-830c-ec6e267e7d93 service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:03.794745 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f243b-2239-4793-829b-129aec35074d service cinder] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:03.810506 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b554fb-fc67-424d-b552-8f0aca6eab54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:03.811168 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b554fb-fc67-424d-b552-8f0aca6eab54 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:03.811446 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b554fb-fc67-424d-b552-8f0aca6eab54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:03.811715 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b554fb-fc67-424d-b552-8f0aca6eab54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:03.812408 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b554fb-fc67-424d-b552-8f0aca6eab54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:56:03.812707 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b554fb-fc67-424d-b552-8f0aca6eab54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:03.813031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 871/1742] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:03.814527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b554fb-fc67-424d-b552-8f0aca6eab54 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:03.852996 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 872/1743] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:56:03.857453 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416afe0-a304-4f69-830c-ec6e267e7d93 service neutron] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:03.872973 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416afe0-a304-4f69-830c-ec6e267e7d93 service neutron] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:03.889598 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c758b89-5a12-4112-80e6-ec4f78addd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:03.890242 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c758b89-5a12-4112-80e6-ec4f78addd9e admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:03.891659 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c758b89-5a12-4112-80e6-ec4f78addd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:03.891951 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c758b89-5a12-4112-80e6-ec4f78addd9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:03.893385 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c758b89-5a12-4112-80e6-ec4f78addd9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:03.897156 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c758b89-5a12-4112-80e6-ec4f78addd9e admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:03.969160 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 872/1744] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:56:03 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:03.974339 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b554fb-fc67-424d-b552-8f0aca6eab54 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:03.986799 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:04.009585 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b554fb-fc67-424d-b552-8f0aca6eab54 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:04.167256 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d4b2e-8562-42e8-bb72-bb2de1c4c4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:04.188740 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d4b2e-8562-42e8-bb72-bb2de1c4c4d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:04.189225 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d4b2e-8562-42e8-bb72-bb2de1c4c4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:04.191183 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d4b2e-8562-42e8-bb72-bb2de1c4c4d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:04.194359 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d4b2e-8562-42e8-bb72-bb2de1c4c4d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:04.200930 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d4b2e-8562-42e8-bb72-bb2de1c4c4d0 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:04.254886 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 873/1745] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:56:03 2022] POST /identity/v3/users => generated 293 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:04.258986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c758b89-5a12-4112-80e6-ec4f78addd9e admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:04.272191 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c758b89-5a12-4112-80e6-ec4f78addd9e admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:04.281043 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb668307-046c-435e-8c52-19ec7736dac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:04.282856 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb668307-046c-435e-8c52-19ec7736dac9 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:04.283328 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb668307-046c-435e-8c52-19ec7736dac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:04.283808 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb668307-046c-435e-8c52-19ec7736dac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:04.284645 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb668307-046c-435e-8c52-19ec7736dac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:04.287634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb668307-046c-435e-8c52-19ec7736dac9 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:04.307571 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 873/1746] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:56:04.308753 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d4b2e-8562-42e8-bb72-bb2de1c4c4d0 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:04.327622 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d4b2e-8562-42e8-bb72-bb2de1c4c4d0 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:04.357058 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e303f-bb70-431f-a65b-545fc56ae8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:04.357058 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e303f-bb70-431f-a65b-545fc56ae8b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:04.357058 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e303f-bb70-431f-a65b-545fc56ae8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:04.357058 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e303f-bb70-431f-a65b-545fc56ae8b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:04.357395 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e303f-bb70-431f-a65b-545fc56ae8b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:04.357395 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e303f-bb70-431f-a65b-545fc56ae8b4 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:04.404383 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb668307-046c-435e-8c52-19ec7736dac9 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:04.408360 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 874/1747] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:56:04.431284 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb668307-046c-435e-8c52-19ec7736dac9 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:04.457302 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3543656-ae49-44e1-949c-050df5681c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:04.457994 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3543656-ae49-44e1-949c-050df5681c0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:04.463763 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3543656-ae49-44e1-949c-050df5681c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:04.464202 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3543656-ae49-44e1-949c-050df5681c0b admin admin] PATH_INFO: `/v3/projects/9186d31d602e405faba5630311bd0ded/users/0869284206ef447ea87baf968807b6f1/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:04.514217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3543656-ae49-44e1-949c-050df5681c0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9186d31d602e405faba5630311bd0ded, user_id=0869284206ef447ea87baf968807b6f1, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:04.524502 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3543656-ae49-44e1-949c-050df5681c0b admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:04.565403 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 874/1748] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:56:04 2022] PUT /identity/v3/projects/9186d31d602e405faba5630311bd0ded/users/0869284206ef447ea87baf968807b6f1/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:04.576387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdbddf-468a-4b73-b5f8-43a155057c27 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:04.577044 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdbddf-468a-4b73-b5f8-43a155057c27 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:04.577461 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdbddf-468a-4b73-b5f8-43a155057c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:04.639014 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-20cdbddf-468a-4b73-b5f8-43a155057c27 None None] MFA Rules not processed for user `0869284206ef447ea87baf968807b6f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:04.640263 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-20cdbddf-468a-4b73-b5f8-43a155057c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:04.850901 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 875/1749] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:56:04.855422 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3543656-ae49-44e1-949c-050df5681c0b admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:04.883842 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:04.993477 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3543656-ae49-44e1-949c-050df5681c0b admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:05.008163 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300aae02-5470-4d88-a36a-11fdbae51452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:05.009366 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300aae02-5470-4d88-a36a-11fdbae51452 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:05.009647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300aae02-5470-4d88-a36a-11fdbae51452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:05.010026 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300aae02-5470-4d88-a36a-11fdbae51452 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:05.010556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300aae02-5470-4d88-a36a-11fdbae51452 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:05.027467 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300aae02-5470-4d88-a36a-11fdbae51452 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:05.150206 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 875/1750] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:56:04 2022] POST /identity/v3/projects => generated 383 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:05.154549 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdbddf-468a-4b73-b5f8-43a155057c27 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:05.178405 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdbddf-468a-4b73-b5f8-43a155057c27 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:05.386760 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d052b-b494-49d5-be06-6bdb92b61e3e None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:05.387516 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d052b-b494-49d5-be06-6bdb92b61e3e None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:05.387906 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d052b-b494-49d5-be06-6bdb92b61e3e None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:05.389892 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 876/1751] 10.222.0.62 () {54 vars in 912 bytes} [Mon Sep 26 17:56:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:56:05.410325 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95ff86-9c9a-477f-8f29-8c54aae8792e None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:05.410795 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95ff86-9c9a-477f-8f29-8c54aae8792e None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:05.411319 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95ff86-9c9a-477f-8f29-8c54aae8792e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:05.496989 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-5b95ff86-9c9a-477f-8f29-8c54aae8792e None None] MFA Rules not processed for user `a0ed50f4edcf468192a053b1e0fd6910`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:05.499082 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17da75-dce3-4cbc-bf2d-6b18b6009c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:05.499724 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17da75-dce3-4cbc-bf2d-6b18b6009c1a admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:05.500008 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17da75-dce3-4cbc-bf2d-6b18b6009c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:05.500270 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17da75-dce3-4cbc-bf2d-6b18b6009c1a admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:05.500919 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a17da75-dce3-4cbc-bf2d-6b18b6009c1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:05.502915 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a17da75-dce3-4cbc-bf2d-6b18b6009c1a admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:05.509386 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-5b95ff86-9c9a-477f-8f29-8c54aae8792e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:05.615693 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:05.628275 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 876/1752] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:56:05 2022] POST /identity/v3/users => generated 298 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:05.637330 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873636f-c801-46b7-b39f-ec171f4f0772 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:05.639073 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873636f-c801-46b7-b39f-ec171f4f0772 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:05.646392 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873636f-c801-46b7-b39f-ec171f4f0772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:05.818240 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-4873636f-c801-46b7-b39f-ec171f4f0772 None None] MFA Rules not processed for user `27be8cad21f54dcd9a71ff99299d9814`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:05.824869 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-4873636f-c801-46b7-b39f-ec171f4f0772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:05.832891 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 877/1753] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Sep 26 17:56:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:56:05.833920 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95ff86-9c9a-477f-8f29-8c54aae8792e None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:05.846876 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-5b95ff86-9c9a-477f-8f29-8c54aae8792e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:05.925911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95ff86-9c9a-477f-8f29-8c54aae8792e None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:05.941116 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696b57e-bb1a-4b66-a2fd-affbff25b118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:05.941950 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696b57e-bb1a-4b66-a2fd-affbff25b118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:05.942225 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696b57e-bb1a-4b66-a2fd-affbff25b118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:05.942499 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696b57e-bb1a-4b66-a2fd-affbff25b118 admin admin] PATH_INFO: `/v3/projects/3bbb7d347d3848b0bc58c0cbaaa31a8a` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:05.947815 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8696b57e-bb1a-4b66-a2fd-affbff25b118 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bbb7d347d3848b0bc58c0cbaaa31a8a)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:05.951534 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8696b57e-bb1a-4b66-a2fd-affbff25b118 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:06.041715 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 877/1754] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:06.044999 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873636f-c801-46b7-b39f-ec171f4f0772 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:06.084754 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-8696b57e-bb1a-4b66-a2fd-affbff25b118 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bbb7d347d3848b0bc58c0cbaaa31a8a', 'request_id': 'req-8696b57e-bb1a-4b66-a2fd-affbff25b118'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:06.093023 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-8696b57e-bb1a-4b66-a2fd-affbff25b118 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bbb7d347d3848b0bc58c0cbaaa31a8a', 'request_id': 'req-8696b57e-bb1a-4b66-a2fd-affbff25b118'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:06.106058 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873636f-c801-46b7-b39f-ec171f4f0772 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:06.114632 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-8696b57e-bb1a-4b66-a2fd-affbff25b118 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bbb7d347d3848b0bc58c0cbaaa31a8a', 'request_id': 'req-8696b57e-bb1a-4b66-a2fd-affbff25b118'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:06.188998 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-8696b57e-bb1a-4b66-a2fd-affbff25b118 admin admin] The token cache is being invalidate because project 3bbb7d347d3848b0bc58c0cbaaa31a8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:56:06.189459 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-8696b57e-bb1a-4b66-a2fd-affbff25b118 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:06.193587 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-8696b57e-bb1a-4b66-a2fd-affbff25b118 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:06.198795 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 878/1755] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:56:05 2022] DELETE /identity/v3/projects/3bbb7d347d3848b0bc58c0cbaaa31a8a => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:06.199936 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696b57e-bb1a-4b66-a2fd-affbff25b118 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:06.202824 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-8696b57e-bb1a-4b66-a2fd-affbff25b118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:06.283626 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:06.343986 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8f0f5-9de3-4d15-8955-cf56302a4642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:06.344456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696b57e-bb1a-4b66-a2fd-affbff25b118 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:06.344618 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8f0f5-9de3-4d15-8955-cf56302a4642 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:06.344904 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8f0f5-9de3-4d15-8955-cf56302a4642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:06.345219 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8f0f5-9de3-4d15-8955-cf56302a4642 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:06.345880 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8f0f5-9de3-4d15-8955-cf56302a4642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:06.347536 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8f0f5-9de3-4d15-8955-cf56302a4642 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:06.355690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ae1c5-50ae-45f5-acb5-69dcdf3d5205 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:06.356584 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ae1c5-50ae-45f5-acb5-69dcdf3d5205 service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:06.357130 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ae1c5-50ae-45f5-acb5-69dcdf3d5205 service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:06.357543 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ae1c5-50ae-45f5-acb5-69dcdf3d5205 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:06.360974 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-176ae1c5-50ae-45f5-acb5-69dcdf3d5205 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:06.394791 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ae1c5-50ae-45f5-acb5-69dcdf3d5205 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:06.396861 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ae1c5-50ae-45f5-acb5-69dcdf3d5205 service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:06.410197 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 878/1756] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:56:06.410197 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46f42c-ff20-4b47-94f5-7816ea372ba4 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:06.410197 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46f42c-ff20-4b47-94f5-7816ea372ba4 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:06.410197 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46f42c-ff20-4b47-94f5-7816ea372ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:06.415772 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 879/1757] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:06.416888 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ae1c5-50ae-45f5-acb5-69dcdf3d5205 service neutron] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:06.418473 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-176ae1c5-50ae-45f5-acb5-69dcdf3d5205 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:06.458667 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ae1c5-50ae-45f5-acb5-69dcdf3d5205 service neutron] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:06.468314 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-8b46f42c-ff20-4b47-94f5-7816ea372ba4 None None] MFA Rules not processed for user `27be8cad21f54dcd9a71ff99299d9814`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:06.469621 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-8b46f42c-ff20-4b47-94f5-7816ea372ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:06.472747 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f690f-84b9-41f1-be91-5f3c59c0d02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:06.473692 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f690f-84b9-41f1-be91-5f3c59c0d02c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:06.474258 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f690f-84b9-41f1-be91-5f3c59c0d02c admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:06.475048 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f690f-84b9-41f1-be91-5f3c59c0d02c admin admin] PATH_INFO: `/v3/users/c1d378ee7ef147a69d6edd2290cf0515` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:06.477528 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f690f-84b9-41f1-be91-5f3c59c0d02c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1d378ee7ef147a69d6edd2290cf0515)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:06.481202 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f690f-84b9-41f1-be91-5f3c59c0d02c admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:06.694489 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-f14f690f-84b9-41f1-be91-5f3c59c0d02c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1d378ee7ef147a69d6edd2290cf0515'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:06.698639 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 879/1758] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:06.712695 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46f42c-ff20-4b47-94f5-7816ea372ba4 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:06.717802 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-8b46f42c-ff20-4b47-94f5-7816ea372ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:06.727055 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-f14f690f-84b9-41f1-be91-5f3c59c0d02c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1d378ee7ef147a69d6edd2290cf0515'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:06.727223 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-f14f690f-84b9-41f1-be91-5f3c59c0d02c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1d378ee7ef147a69d6edd2290cf0515'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:06.728362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-f14f690f-84b9-41f1-be91-5f3c59c0d02c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1d378ee7ef147a69d6edd2290cf0515'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:06.767043 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-f14f690f-84b9-41f1-be91-5f3c59c0d02c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1d378ee7ef147a69d6edd2290cf0515'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:06.780739 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46f42c-ff20-4b47-94f5-7816ea372ba4 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:06.798740 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374668f-3e3b-4c01-bef7-2be1277b9351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:06.800038 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374668f-3e3b-4c01-bef7-2be1277b9351 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:06.800321 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374668f-3e3b-4c01-bef7-2be1277b9351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:06.800598 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374668f-3e3b-4c01-bef7-2be1277b9351 admin admin] PATH_INFO: `/v3/projects/7be4299e0cc841d1bcccd92cb972ccb9/users/813c33f9ebc441dca3bbecbcb06f9a13/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:06.845242 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7374668f-3e3b-4c01-bef7-2be1277b9351 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7be4299e0cc841d1bcccd92cb972ccb9, user_id=813c33f9ebc441dca3bbecbcb06f9a13, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:06.850150 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7374668f-3e3b-4c01-bef7-2be1277b9351 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:06.873277 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 880/1759] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:56:06 2022] DELETE /identity/v3/users/c1d378ee7ef147a69d6edd2290cf0515 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:06.873277 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f690f-84b9-41f1-be91-5f3c59c0d02c admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:06.874115 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-f14f690f-84b9-41f1-be91-5f3c59c0d02c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:06.886004 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 880/1760] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:56:06 2022] PUT /identity/v3/projects/7be4299e0cc841d1bcccd92cb972ccb9/users/813c33f9ebc441dca3bbecbcb06f9a13/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:06.897697 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374668f-3e3b-4c01-bef7-2be1277b9351 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:06.899547 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-7374668f-3e3b-4c01-bef7-2be1277b9351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:06.947170 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:07.140773 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f690f-84b9-41f1-be91-5f3c59c0d02c admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:07.178784 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374668f-3e3b-4c01-bef7-2be1277b9351 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:07.199602 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd4bfa-4902-48b8-893a-2b8e025abb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:07.200205 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd4bfa-4902-48b8-893a-2b8e025abb15 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:07.202589 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd4bfa-4902-48b8-893a-2b8e025abb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:07.202589 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd4bfa-4902-48b8-893a-2b8e025abb15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:07.207055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd4bfa-4902-48b8-893a-2b8e025abb15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:07.208634 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd4bfa-4902-48b8-893a-2b8e025abb15 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:07.239118 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 881/1761] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:56:07.243496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbf9e2-455c-419e-b9bc-b4591b0d65f5 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:07.247948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbf9e2-455c-419e-b9bc-b4591b0d65f5 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:07.248526 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbf9e2-455c-419e-b9bc-b4591b0d65f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:07.314927 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:07.412220 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-94dbf9e2-455c-419e-b9bc-b4591b0d65f5 None None] MFA Rules not processed for user `8475122232ef4d8893f2a9b98768396e`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:07.414863 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-94dbf9e2-455c-419e-b9bc-b4591b0d65f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:07.424827 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9f6a4-fbee-4b58-baa3-c8ab3d23dfc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:07.425487 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9f6a4-fbee-4b58-baa3-c8ab3d23dfc9 service nova] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:07.425761 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9f6a4-fbee-4b58-baa3-c8ab3d23dfc9 service nova] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:07.426076 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9f6a4-fbee-4b58-baa3-c8ab3d23dfc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:07.431216 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-45a9f6a4-fbee-4b58-baa3-c8ab3d23dfc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:07.541585 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9f6a4-fbee-4b58-baa3-c8ab3d23dfc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:07.543865 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9f6a4-fbee-4b58-baa3-c8ab3d23dfc9 service nova] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:07.557049 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 881/1762] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 686 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:07.558342 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9f6a4-fbee-4b58-baa3-c8ab3d23dfc9 service nova] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:07.581768 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9f6a4-fbee-4b58-baa3-c8ab3d23dfc9 service nova] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:07.589307 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b170b0-a830-47c0-afaf-0758e63f3715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:07.590532 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b170b0-a830-47c0-afaf-0758e63f3715 admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:07.591826 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b170b0-a830-47c0-afaf-0758e63f3715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:07.592311 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b170b0-a830-47c0-afaf-0758e63f3715 admin admin] PATH_INFO: `/v3/projects/7be4299e0cc841d1bcccd92cb972ccb9/users/813c33f9ebc441dca3bbecbcb06f9a13/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:07.596872 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b170b0-a830-47c0-afaf-0758e63f3715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7be4299e0cc841d1bcccd92cb972ccb9, user_id=813c33f9ebc441dca3bbecbcb06f9a13, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:07.601823 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b170b0-a830-47c0-afaf-0758e63f3715 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:07.622015 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 882/1763] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:56:07 2022] PUT /identity/v3/projects/7be4299e0cc841d1bcccd92cb972ccb9/users/813c33f9ebc441dca3bbecbcb06f9a13/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:07.632858 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b170b0-a830-47c0-afaf-0758e63f3715 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:07.641175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-42b170b0-a830-47c0-afaf-0758e63f3715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:07.692567 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 882/1764] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Sep 26 17:56:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:07.693978 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5a277-0fcf-48fb-8f9b-46514dcf25e4 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:07.694333 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5a277-0fcf-48fb-8f9b-46514dcf25e4 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:07.695165 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5a277-0fcf-48fb-8f9b-46514dcf25e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:07.771365 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-28a5a277-0fcf-48fb-8f9b-46514dcf25e4 None None] MFA Rules not processed for user `813c33f9ebc441dca3bbecbcb06f9a13`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:07.775163 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-28a5a277-0fcf-48fb-8f9b-46514dcf25e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:07.861690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b170b0-a830-47c0-afaf-0758e63f3715 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:07.875189 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe54239-7c46-4531-a558-ce797d281474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:07.875862 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe54239-7c46-4531-a558-ce797d281474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:07.877950 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe54239-7c46-4531-a558-ce797d281474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:07.878253 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe54239-7c46-4531-a558-ce797d281474 admin admin] PATH_INFO: `/v3/users/49de4d5bee044ce295b05819546e1dc5` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:07.881517 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe54239-7c46-4531-a558-ce797d281474 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49de4d5bee044ce295b05819546e1dc5)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:07.885956 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe54239-7c46-4531-a558-ce797d281474 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:07.910366 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:07.918830 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 883/1765] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:07.930074 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5a277-0fcf-48fb-8f9b-46514dcf25e4 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:07.931902 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-28a5a277-0fcf-48fb-8f9b-46514dcf25e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:07.993446 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-0fe54239-7c46-4531-a558-ce797d281474 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49de4d5bee044ce295b05819546e1dc5'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:08.015608 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-0fe54239-7c46-4531-a558-ce797d281474 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49de4d5bee044ce295b05819546e1dc5'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:08.016488 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-0fe54239-7c46-4531-a558-ce797d281474 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49de4d5bee044ce295b05819546e1dc5'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:08.017060 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-0fe54239-7c46-4531-a558-ce797d281474 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49de4d5bee044ce295b05819546e1dc5'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:08.043217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-0fe54239-7c46-4531-a558-ce797d281474 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49de4d5bee044ce295b05819546e1dc5'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:08.062743 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:08.089866 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 883/1766] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:56:07 2022] DELETE /identity/v3/users/49de4d5bee044ce295b05819546e1dc5 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:08.091276 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe54239-7c46-4531-a558-ce797d281474 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:08.092835 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-0fe54239-7c46-4531-a558-ce797d281474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:08.110950 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5a277-0fcf-48fb-8f9b-46514dcf25e4 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:08.206404 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acac92f-13e2-401d-8902-6c6d212a7b12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:08.207166 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acac92f-13e2-401d-8902-6c6d212a7b12 service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:08.207639 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acac92f-13e2-401d-8902-6c6d212a7b12 service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:08.207913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acac92f-13e2-401d-8902-6c6d212a7b12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:08.210043 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-4acac92f-13e2-401d-8902-6c6d212a7b12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:08.229103 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe54239-7c46-4531-a558-ce797d281474 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:08.235515 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6261fba-8297-4636-ab41-d17771a83947 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea49cd9839474232a0cbe66ccffbf082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:08.237216 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6261fba-8297-4636-ab41-d17771a83947 service swift] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:08.237671 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6261fba-8297-4636-ab41-d17771a83947 service swift] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:08.238233 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6261fba-8297-4636-ab41-d17771a83947 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:08.240422 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-e6261fba-8297-4636-ab41-d17771a83947 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:08.300162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acac92f-13e2-401d-8902-6c6d212a7b12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:08.301889 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acac92f-13e2-401d-8902-6c6d212a7b12 service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:08.338424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 884/1767] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 17:56:08.342452 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace931e-4a61-4b35-b814-1f1fa217af96 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:08.342741 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace931e-4a61-4b35-b814-1f1fa217af96 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:08.343014 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace931e-4a61-4b35-b814-1f1fa217af96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:08.383956 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6261fba-8297-4636-ab41-d17771a83947 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:08.385881 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6261fba-8297-4636-ab41-d17771a83947 service swift] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:08.419863 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-9ace931e-4a61-4b35-b814-1f1fa217af96 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:08.421276 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-9ace931e-4a61-4b35-b814-1f1fa217af96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:08.428094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 884/1768] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Sep 26 17:56:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 17:56:08.619155 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 885/1769] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:08.731363 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6261fba-8297-4636-ab41-d17771a83947 service swift] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:08.734567 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-e6261fba-8297-4636-ab41-d17771a83947 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:08.914280 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6261fba-8297-4636-ab41-d17771a83947 service swift] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:08.926665 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6dd2d0-4e3d-45ba-acc6-8231c1de2ca2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:08.927556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6dd2d0-4e3d-45ba-acc6-8231c1de2ca2 service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:08.927998 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6dd2d0-4e3d-45ba-acc6-8231c1de2ca2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:08.928577 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6dd2d0-4e3d-45ba-acc6-8231c1de2ca2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:08.959889 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6dd2d0-4e3d-45ba-acc6-8231c1de2ca2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:08.975730 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6dd2d0-4e3d-45ba-acc6-8231c1de2ca2 service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:09.008620 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 885/1770] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:10.293860 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa4d2f-b469-4480-91a6-00a8d2929ba5 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:10.297656 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa4d2f-b469-4480-91a6-00a8d2929ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:10.297656 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa4d2f-b469-4480-91a6-00a8d2929ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:10.356565 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-17aa4d2f-b469-4480-91a6-00a8d2929ba5 None None] MFA Rules not processed for user `a0ed50f4edcf468192a053b1e0fd6910`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:10.366123 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-17aa4d2f-b469-4480-91a6-00a8d2929ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:10.400710 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 886/1771] 10.222.0.97 () {58 vars in 1015 bytes} [Mon Sep 26 17:56:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:56:10.460080 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6dd2d0-4e3d-45ba-acc6-8231c1de2ca2 service neutron] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:10.476263 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6dd2d0-4e3d-45ba-acc6-8231c1de2ca2 service neutron] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:10.481923 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa4d2f-b469-4480-91a6-00a8d2929ba5 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:10.483545 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-17aa4d2f-b469-4480-91a6-00a8d2929ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:10.487342 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50187f1e-f3b1-4092-bf3b-50564981fc4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:10.490772 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50187f1e-f3b1-4092-bf3b-50564981fc4d service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:10.490984 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50187f1e-f3b1-4092-bf3b-50564981fc4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:10.493947 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50187f1e-f3b1-4092-bf3b-50564981fc4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:10.499697 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:10.509525 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50187f1e-f3b1-4092-bf3b-50564981fc4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:10.511309 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50187f1e-f3b1-4092-bf3b-50564981fc4d service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:10.521118 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa4d2f-b469-4480-91a6-00a8d2929ba5 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:10.524608 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:10.553503 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870edc6-8611-4af2-8af4-b63406876b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:10.554179 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870edc6-8611-4af2-8af4-b63406876b1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:10.554462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870edc6-8611-4af2-8af4-b63406876b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:10.554740 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870edc6-8611-4af2-8af4-b63406876b1a admin admin] PATH_INFO: `/v3/projects/9e3ba9ac902148eea76898a44d5628bf` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:10.556346 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 886/1772] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:10.570129 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f870edc6-8611-4af2-8af4-b63406876b1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e3ba9ac902148eea76898a44d5628bf)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:10.572113 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f870edc6-8611-4af2-8af4-b63406876b1a admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:10.832040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-f870edc6-8611-4af2-8af4-b63406876b1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e3ba9ac902148eea76898a44d5628bf', 'request_id': 'req-f870edc6-8611-4af2-8af4-b63406876b1a'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:10.851600 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-f870edc6-8611-4af2-8af4-b63406876b1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e3ba9ac902148eea76898a44d5628bf', 'request_id': 'req-f870edc6-8611-4af2-8af4-b63406876b1a'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:10.873727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-f870edc6-8611-4af2-8af4-b63406876b1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e3ba9ac902148eea76898a44d5628bf', 'request_id': 'req-f870edc6-8611-4af2-8af4-b63406876b1a'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:10.896687 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-f870edc6-8611-4af2-8af4-b63406876b1a admin admin] The token cache is being invalidate because project 9e3ba9ac902148eea76898a44d5628bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:56:10.901186 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-f870edc6-8611-4af2-8af4-b63406876b1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:10.901186 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-f870edc6-8611-4af2-8af4-b63406876b1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:10.903107 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 887/1773] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:56:10 2022] DELETE /identity/v3/projects/9e3ba9ac902148eea76898a44d5628bf => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:56:10.907839 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50187f1e-f3b1-4092-bf3b-50564981fc4d service neutron] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:10.943391 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50187f1e-f3b1-4092-bf3b-50564981fc4d service neutron] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:11.050609 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4e0c5-c458-41f5-86ed-97c8d5c8add3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:11.051288 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4e0c5-c458-41f5-86ed-97c8d5c8add3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:11.051563 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4e0c5-c458-41f5-86ed-97c8d5c8add3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:11.051833 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4e0c5-c458-41f5-86ed-97c8d5c8add3 admin admin] PATH_INFO: `/v3/users/7c2f75fe21d74c5f8c526b8ba116e578` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:11.060088 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4e0c5-c458-41f5-86ed-97c8d5c8add3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c2f75fe21d74c5f8c526b8ba116e578)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:11.066581 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4e0c5-c458-41f5-86ed-97c8d5c8add3 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:11.214294 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-c4d4e0c5-c458-41f5-86ed-97c8d5c8add3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c2f75fe21d74c5f8c526b8ba116e578'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:11.233386 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-c4d4e0c5-c458-41f5-86ed-97c8d5c8add3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c2f75fe21d74c5f8c526b8ba116e578'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:11.234212 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-c4d4e0c5-c458-41f5-86ed-97c8d5c8add3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c2f75fe21d74c5f8c526b8ba116e578'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:11.239669 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-c4d4e0c5-c458-41f5-86ed-97c8d5c8add3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c2f75fe21d74c5f8c526b8ba116e578'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:11.259921 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-c4d4e0c5-c458-41f5-86ed-97c8d5c8add3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c2f75fe21d74c5f8c526b8ba116e578'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:11.330183 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 887/1774] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:56:10 2022] DELETE /identity/v3/users/7c2f75fe21d74c5f8c526b8ba116e578 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:11.758636 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870edc6-8611-4af2-8af4-b63406876b1a admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:11.760197 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-f870edc6-8611-4af2-8af4-b63406876b1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:11.812260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870edc6-8611-4af2-8af4-b63406876b1a admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:12.168445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6abdccc-4fab-4c6e-a7a7-a2f0de45243a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:12.168445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abdccc-4fab-4c6e-a7a7-a2f0de45243a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:12.168445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abdccc-4fab-4c6e-a7a7-a2f0de45243a admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:12.168811 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abdccc-4fab-4c6e-a7a7-a2f0de45243a admin admin] PATH_INFO: `/v3/projects/1fde5983dff94f388d9fe98b1770ad8c` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:12.173965 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6abdccc-4fab-4c6e-a7a7-a2f0de45243a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fde5983dff94f388d9fe98b1770ad8c)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:12.177551 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6abdccc-4fab-4c6e-a7a7-a2f0de45243a admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:12.333840 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b6abdccc-4fab-4c6e-a7a7-a2f0de45243a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fde5983dff94f388d9fe98b1770ad8c', 'request_id': 'req-b6abdccc-4fab-4c6e-a7a7-a2f0de45243a'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:12.353161 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b6abdccc-4fab-4c6e-a7a7-a2f0de45243a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fde5983dff94f388d9fe98b1770ad8c', 'request_id': 'req-b6abdccc-4fab-4c6e-a7a7-a2f0de45243a'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:12.373473 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b6abdccc-4fab-4c6e-a7a7-a2f0de45243a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fde5983dff94f388d9fe98b1770ad8c', 'request_id': 'req-b6abdccc-4fab-4c6e-a7a7-a2f0de45243a'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:12.413193 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b6abdccc-4fab-4c6e-a7a7-a2f0de45243a admin admin] The token cache is being invalidate because project 1fde5983dff94f388d9fe98b1770ad8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:56:12.413498 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b6abdccc-4fab-4c6e-a7a7-a2f0de45243a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:12.414256 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b6abdccc-4fab-4c6e-a7a7-a2f0de45243a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:12.415815 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 888/1775] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:56:11 2022] DELETE /identity/v3/projects/1fde5983dff94f388d9fe98b1770ad8c => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:12.422766 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f4b03-ec91-4ec5-acfb-c5974f0fe317 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:12.423539 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f4b03-ec91-4ec5-acfb-c5974f0fe317 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:12.423539 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f4b03-ec91-4ec5-acfb-c5974f0fe317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:12.474954 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f597ce-8b4c-45a3-b230-10e9f42b7814 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:12.475559 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f597ce-8b4c-45a3-b230-10e9f42b7814 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:12.476044 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f597ce-8b4c-45a3-b230-10e9f42b7814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:12.526183 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-7d8f4b03-ec91-4ec5-acfb-c5974f0fe317 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:12.534548 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-7d8f4b03-ec91-4ec5-acfb-c5974f0fe317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:12.566052 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-24f597ce-8b4c-45a3-b230-10e9f42b7814 None None] MFA Rules not processed for user `2b3ef3111ca1492abd44a59756c99e22`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:12.572077 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-24f597ce-8b4c-45a3-b230-10e9f42b7814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:12.631347 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:12.833152 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 888/1776] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:12.853434 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb928fd3-7b9d-4a63-88a0-e9b1a6378f37 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:12.853434 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb928fd3-7b9d-4a63-88a0-e9b1a6378f37 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:12.853434 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb928fd3-7b9d-4a63-88a0-e9b1a6378f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:12.901433 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 889/1777] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:56:12.918545 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-cb928fd3-7b9d-4a63-88a0-e9b1a6378f37 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:12.921377 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-cb928fd3-7b9d-4a63-88a0-e9b1a6378f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:12.934643 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 889/1778] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:12.938993 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f597ce-8b4c-45a3-b230-10e9f42b7814 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:12.969965 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f597ce-8b4c-45a3-b230-10e9f42b7814 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:12.999096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5259e-5356-427b-ac6f-99deb9c7ff89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:12.999729 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5259e-5356-427b-ac6f-99deb9c7ff89 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:13.000044 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5259e-5356-427b-ac6f-99deb9c7ff89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:13.000289 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5259e-5356-427b-ac6f-99deb9c7ff89 admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:13.000947 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5259e-5356-427b-ac6f-99deb9c7ff89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:56:13.001278 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5259e-5356-427b-ac6f-99deb9c7ff89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:13.002891 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5259e-5356-427b-ac6f-99deb9c7ff89 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:13.101050 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 890/1779] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:56:13.102697 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb928fd3-7b9d-4a63-88a0-e9b1a6378f37 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:13.113030 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb928fd3-7b9d-4a63-88a0-e9b1a6378f37 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:13.139755 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8bd52e-b3bc-41a8-9ce8-88f3107e4c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:13.140420 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8bd52e-b3bc-41a8-9ce8-88f3107e4c5c admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:13.140705 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8bd52e-b3bc-41a8-9ce8-88f3107e4c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:13.140973 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8bd52e-b3bc-41a8-9ce8-88f3107e4c5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:13.142309 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8bd52e-b3bc-41a8-9ce8-88f3107e4c5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:13.144269 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8bd52e-b3bc-41a8-9ce8-88f3107e4c5c admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:13.192861 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:13.236804 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 890/1780] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:56:13 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:13.241931 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5259e-5356-427b-ac6f-99deb9c7ff89 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:13.256445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5259e-5356-427b-ac6f-99deb9c7ff89 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:13.529529 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8cf59a-50ef-4ec2-ae7d-7d0ae4ca3b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:13.530177 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cf59a-50ef-4ec2-ae7d-7d0ae4ca3b7e admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:13.530453 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cf59a-50ef-4ec2-ae7d-7d0ae4ca3b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:13.530721 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cf59a-50ef-4ec2-ae7d-7d0ae4ca3b7e admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:13.548976 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8cf59a-50ef-4ec2-ae7d-7d0ae4ca3b7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:13.554487 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8cf59a-50ef-4ec2-ae7d-7d0ae4ca3b7e admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:13.625427 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 891/1781] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:56:13 2022] POST /identity/v3/users => generated 287 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:13.627101 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8bd52e-b3bc-41a8-9ce8-88f3107e4c5c admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:13.663973 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8bd52e-b3bc-41a8-9ce8-88f3107e4c5c admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:13.701208 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad9806-c28c-46d2-ac31-4b2eed46fcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:13.707620 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad9806-c28c-46d2-ac31-4b2eed46fcef admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:13.707919 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad9806-c28c-46d2-ac31-4b2eed46fcef admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:13.708253 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad9806-c28c-46d2-ac31-4b2eed46fcef admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:13.712495 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ad9806-c28c-46d2-ac31-4b2eed46fcef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:13.725905 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ad9806-c28c-46d2-ac31-4b2eed46fcef admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:13.794685 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 891/1782] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:56:13.802445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8cf59a-50ef-4ec2-ae7d-7d0ae4ca3b7e admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:13.826476 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8cf59a-50ef-4ec2-ae7d-7d0ae4ca3b7e admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:13.851493 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94c07e-85c6-4337-bf20-49a37ecf2197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:13.852201 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94c07e-85c6-4337-bf20-49a37ecf2197 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:13.855845 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94c07e-85c6-4337-bf20-49a37ecf2197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:13.856237 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94c07e-85c6-4337-bf20-49a37ecf2197 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:13.860540 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94c07e-85c6-4337-bf20-49a37ecf2197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:13.864115 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94c07e-85c6-4337-bf20-49a37ecf2197 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:13.919654 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 892/1783] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:56:13.922431 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad9806-c28c-46d2-ac31-4b2eed46fcef admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:13.934412 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad9806-c28c-46d2-ac31-4b2eed46fcef admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:13.940392 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0203736-3cb3-4b23-9a64-e066dd8d3576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:13.941446 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0203736-3cb3-4b23-9a64-e066dd8d3576 admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:13.941738 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0203736-3cb3-4b23-9a64-e066dd8d3576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:13.942010 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0203736-3cb3-4b23-9a64-e066dd8d3576 admin admin] PATH_INFO: `/v3/projects/92c069ddb4784266961827ef0304840c/users/79701852036c4622aa6f6bde71f7b2b9/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:13.966676 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0203736-3cb3-4b23-9a64-e066dd8d3576 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92c069ddb4784266961827ef0304840c, user_id=79701852036c4622aa6f6bde71f7b2b9, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:13.972189 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0203736-3cb3-4b23-9a64-e066dd8d3576 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:14.010571 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 892/1784] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:56:13 2022] PUT /identity/v3/projects/92c069ddb4784266961827ef0304840c/users/79701852036c4622aa6f6bde71f7b2b9/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:14.016064 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efcdd1-4869-4c85-a3ae-35718d286e5f None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:14.016352 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efcdd1-4869-4c85-a3ae-35718d286e5f None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:14.016679 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efcdd1-4869-4c85-a3ae-35718d286e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:14.089387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-13efcdd1-4869-4c85-a3ae-35718d286e5f None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:14.096460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-13efcdd1-4869-4c85-a3ae-35718d286e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:14.214330 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0203736-3cb3-4b23-9a64-e066dd8d3576 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:14.215835 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-a0203736-3cb3-4b23-9a64-e066dd8d3576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:14.409777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 893/1785] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:14.510213 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0203736-3cb3-4b23-9a64-e066dd8d3576 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:14.521414 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53f144-fc5b-429a-95e6-8d466d52202b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:14.522086 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53f144-fc5b-429a-95e6-8d466d52202b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:14.522372 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53f144-fc5b-429a-95e6-8d466d52202b admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:14.522645 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53f144-fc5b-429a-95e6-8d466d52202b admin admin] PATH_INFO: `/v3/projects/0679720c2675467b9b3499ee731c2bb4` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:14.523830 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53f144-fc5b-429a-95e6-8d466d52202b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0679720c2675467b9b3499ee731c2bb4)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:14.526940 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53f144-fc5b-429a-95e6-8d466d52202b admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:14.543598 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13efcdd1-4869-4c85-a3ae-35718d286e5f None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:14.545323 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-13efcdd1-4869-4c85-a3ae-35718d286e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:14.667905 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-df53f144-fc5b-429a-95e6-8d466d52202b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0679720c2675467b9b3499ee731c2bb4', 'request_id': 'req-df53f144-fc5b-429a-95e6-8d466d52202b'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:14.676280 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-df53f144-fc5b-429a-95e6-8d466d52202b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0679720c2675467b9b3499ee731c2bb4', 'request_id': 'req-df53f144-fc5b-429a-95e6-8d466d52202b'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:14.679854 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:14.701854 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-df53f144-fc5b-429a-95e6-8d466d52202b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0679720c2675467b9b3499ee731c2bb4', 'request_id': 'req-df53f144-fc5b-429a-95e6-8d466d52202b'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:14.725625 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-df53f144-fc5b-429a-95e6-8d466d52202b admin admin] The token cache is being invalidate because project 0679720c2675467b9b3499ee731c2bb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:56:14.726290 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-df53f144-fc5b-429a-95e6-8d466d52202b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:14.727802 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-df53f144-fc5b-429a-95e6-8d466d52202b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:14.730017 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 893/1786] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:56:14 2022] DELETE /identity/v3/projects/0679720c2675467b9b3499ee731c2bb4 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:14.738727 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae5f92-0c66-4a55-8502-4a13f3273aa6 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:14.739003 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae5f92-0c66-4a55-8502-4a13f3273aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:14.739370 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae5f92-0c66-4a55-8502-4a13f3273aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:14.810907 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-a2ae5f92-0c66-4a55-8502-4a13f3273aa6 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:14.812055 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-a2ae5f92-0c66-4a55-8502-4a13f3273aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:14.833851 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13efcdd1-4869-4c85-a3ae-35718d286e5f None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:14.998138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811d801-dad1-4247-b449-dcec2812f9cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:15.000469 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811d801-dad1-4247-b449-dcec2812f9cd service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:15.001034 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811d801-dad1-4247-b449-dcec2812f9cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:15.001521 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811d801-dad1-4247-b449-dcec2812f9cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:15.007342 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-e811d801-dad1-4247-b449-dcec2812f9cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:15.084792 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:15.132648 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 894/1787] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:15.142197 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb4058-c76f-4918-9005-7ae3e4efb7b0 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:15.142632 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb4058-c76f-4918-9005-7ae3e4efb7b0 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:15.143013 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb4058-c76f-4918-9005-7ae3e4efb7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:15.222699 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-cbdb4058-c76f-4918-9005-7ae3e4efb7b0 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:15.230143 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-cbdb4058-c76f-4918-9005-7ae3e4efb7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:15.238938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e811d801-dad1-4247-b449-dcec2812f9cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:15.249790 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e811d801-dad1-4247-b449-dcec2812f9cd service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:15.294611 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 895/1788] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:56:15.295976 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb4058-c76f-4918-9005-7ae3e4efb7b0 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:15.313280 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 894/1789] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 770 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 17:56:15.336476 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb4058-c76f-4918-9005-7ae3e4efb7b0 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:15.352952 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d337b50-e3cf-41d5-9084-b6a5b92ffed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:15.354745 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d337b50-e3cf-41d5-9084-b6a5b92ffed0 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:15.357917 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811d801-dad1-4247-b449-dcec2812f9cd service neutron] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:15.359502 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-e811d801-dad1-4247-b449-dcec2812f9cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:15.365107 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d337b50-e3cf-41d5-9084-b6a5b92ffed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:15.367393 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d337b50-e3cf-41d5-9084-b6a5b92ffed0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:15.373645 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d337b50-e3cf-41d5-9084-b6a5b92ffed0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:56:15.374387 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d337b50-e3cf-41d5-9084-b6a5b92ffed0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:15.378923 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d337b50-e3cf-41d5-9084-b6a5b92ffed0 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:15.420753 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 896/1790] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:56:15.422388 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d337b50-e3cf-41d5-9084-b6a5b92ffed0 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:15.443819 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d337b50-e3cf-41d5-9084-b6a5b92ffed0 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:15.462381 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ca059-9199-46ed-b059-987ae7dd3b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:15.463389 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ca059-9199-46ed-b059-987ae7dd3b29 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:15.463883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ca059-9199-46ed-b059-987ae7dd3b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:15.464364 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ca059-9199-46ed-b059-987ae7dd3b29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:15.466182 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ca059-9199-46ed-b059-987ae7dd3b29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:15.468850 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ca059-9199-46ed-b059-987ae7dd3b29 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:15.536679 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 897/1791] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:56:15 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:15.543027 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ca059-9199-46ed-b059-987ae7dd3b29 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:15.553095 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811d801-dad1-4247-b449-dcec2812f9cd service neutron] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:15.695075 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e4a13-36b1-40b6-b634-aaaacc755304 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:15.695710 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e4a13-36b1-40b6-b634-aaaacc755304 service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:15.695992 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e4a13-36b1-40b6-b634-aaaacc755304 service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:15.696265 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e4a13-36b1-40b6-b634-aaaacc755304 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:15.714267 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-ea1e4a13-36b1-40b6-b634-aaaacc755304 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:15.731923 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:15.751206 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ca059-9199-46ed-b059-987ae7dd3b29 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:15.769096 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f92e1d-4958-41aa-809e-bc6357e7093e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:15.775688 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f92e1d-4958-41aa-809e-bc6357e7093e admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:15.775985 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f92e1d-4958-41aa-809e-bc6357e7093e admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:15.776411 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f92e1d-4958-41aa-809e-bc6357e7093e admin admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:15.783807 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f92e1d-4958-41aa-809e-bc6357e7093e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:15.785734 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f92e1d-4958-41aa-809e-bc6357e7093e admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:15.833712 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 898/1792] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:56:15 2022] POST /identity/v3/users => generated 293 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:15.855911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc44943-644b-406e-9c47-f9c49ed638e3 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:15.856840 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc44943-644b-406e-9c47-f9c49ed638e3 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:15.857151 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc44943-644b-406e-9c47-f9c49ed638e3 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:15.865731 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 899/1793] 10.222.0.62 () {54 vars in 921 bytes} [Mon Sep 26 17:56:15 2022] GET /identity => generated 270 bytes in 31 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:56:15.868810 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736df5a-27f0-4f8a-a80f-25b3de5306da None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:15.869379 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736df5a-27f0-4f8a-a80f-25b3de5306da None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:15.869658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736df5a-27f0-4f8a-a80f-25b3de5306da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:15.874683 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e4a13-36b1-40b6-b634-aaaacc755304 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:15.877956 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e4a13-36b1-40b6-b634-aaaacc755304 service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:15.916099 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 895/1794] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:15 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 17:56:15.917416 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e4a13-36b1-40b6-b634-aaaacc755304 service cinder] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:15.941200 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-9736df5a-27f0-4f8a-a80f-25b3de5306da None None] MFA Rules not processed for user `4313fb69eafa45d2a4f8c0ac5ef47de7`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:15.946980 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-9736df5a-27f0-4f8a-a80f-25b3de5306da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:15.948144 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e4a13-36b1-40b6-b634-aaaacc755304 service cinder] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:15.968764 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1958e8-f99d-411f-a414-1e1c9d8f29b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:15.969839 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1958e8-f99d-411f-a414-1e1c9d8f29b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:15.970273 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1958e8-f99d-411f-a414-1e1c9d8f29b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:15.970680 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1958e8-f99d-411f-a414-1e1c9d8f29b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:15.971622 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1958e8-f99d-411f-a414-1e1c9d8f29b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:15.975816 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1958e8-f99d-411f-a414-1e1c9d8f29b8 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:16.021527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 896/1795] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:56:16.023227 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1958e8-f99d-411f-a414-1e1c9d8f29b8 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:16.057803 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1958e8-f99d-411f-a414-1e1c9d8f29b8 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:16.076010 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e2120e-5aba-4e97-9c66-4fd4af7ed6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:16.076946 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2120e-5aba-4e97-9c66-4fd4af7ed6ab admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:16.077399 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2120e-5aba-4e97-9c66-4fd4af7ed6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:16.077816 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2120e-5aba-4e97-9c66-4fd4af7ed6ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:16.078620 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e2120e-5aba-4e97-9c66-4fd4af7ed6ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:16.083756 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e2120e-5aba-4e97-9c66-4fd4af7ed6ab admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:16.124383 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 897/1796] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:56:16.134177 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aec7cc-391f-4145-bf6d-ec993d89e746 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:16.134462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aec7cc-391f-4145-bf6d-ec993d89e746 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:16.134757 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aec7cc-391f-4145-bf6d-ec993d89e746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:16.165797 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 900/1797] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:16.168452 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736df5a-27f0-4f8a-a80f-25b3de5306da None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:16.198508 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-65aec7cc-391f-4145-bf6d-ec993d89e746 None None] MFA Rules not processed for user `1792e79b9c9a47e1923f19bfd2cd495b`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:16.204567 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-65aec7cc-391f-4145-bf6d-ec993d89e746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:16.239973 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736df5a-27f0-4f8a-a80f-25b3de5306da None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:16.265178 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a21ae-4fd0-4ef5-a273-c923e32647da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:16.266804 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a21ae-4fd0-4ef5-a273-c923e32647da admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:16.266804 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a21ae-4fd0-4ef5-a273-c923e32647da admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:16.271130 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a21ae-4fd0-4ef5-a273-c923e32647da admin admin] PATH_INFO: `/v3/projects/61b5cd302b004202aabc2aca40a17f09/users/7bdff92cd20445a4ae0d095db83d5345/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:16.350444 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a21ae-4fd0-4ef5-a273-c923e32647da admin admin] RBAC: Authorizing `identity:create_grant(project_id=61b5cd302b004202aabc2aca40a17f09, user_id=7bdff92cd20445a4ae0d095db83d5345, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:16.357509 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a21ae-4fd0-4ef5-a273-c923e32647da admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:16.417781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 901/1798] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:56:16 2022] PUT /identity/v3/projects/61b5cd302b004202aabc2aca40a17f09/users/7bdff92cd20445a4ae0d095db83d5345/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:16.420718 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f937f4c-bfd2-4a4f-abd8-ec2bb50f9d34 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:16.421173 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f937f4c-bfd2-4a4f-abd8-ec2bb50f9d34 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:16.421843 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f937f4c-bfd2-4a4f-abd8-ec2bb50f9d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:16.540964 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 898/1799] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Sep 26 17:56:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:16.571136 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-8f937f4c-bfd2-4a4f-abd8-ec2bb50f9d34 None None] MFA Rules not processed for user `7bdff92cd20445a4ae0d095db83d5345`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:16.586324 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-8f937f4c-bfd2-4a4f-abd8-ec2bb50f9d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:16.615715 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:16.939231 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 902/1800] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 520 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:16.943979 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aec7cc-391f-4145-bf6d-ec993d89e746 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:16.960285 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aec7cc-391f-4145-bf6d-ec993d89e746 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:17.112648 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92d603-0537-4948-adba-2811a430adb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:17.113353 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92d603-0537-4948-adba-2811a430adb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:17.113617 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92d603-0537-4948-adba-2811a430adb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:17.113894 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92d603-0537-4948-adba-2811a430adb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:17.114600 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb92d603-0537-4948-adba-2811a430adb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:17.121478 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb92d603-0537-4948-adba-2811a430adb6 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:17.158459 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:17.183437 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 899/1801] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:56:16 2022] POST /identity/v3/projects => generated 383 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:17.185296 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f937f4c-bfd2-4a4f-abd8-ec2bb50f9d34 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:17.203816 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f937f4c-bfd2-4a4f-abd8-ec2bb50f9d34 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:17.283807 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126dfb44-5ab4-42b9-afde-dc8924d9d20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:17.284533 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126dfb44-5ab4-42b9-afde-dc8924d9d20b admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:17.284816 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126dfb44-5ab4-42b9-afde-dc8924d9d20b admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:17.286750 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126dfb44-5ab4-42b9-afde-dc8924d9d20b admin admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:17.287822 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126dfb44-5ab4-42b9-afde-dc8924d9d20b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:17.290106 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126dfb44-5ab4-42b9-afde-dc8924d9d20b admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:17.336489 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 903/1802] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:56:17 2022] POST /identity/v3/users => generated 292 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 17:56:17.340772 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92d603-0537-4948-adba-2811a430adb6 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:17.355768 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92d603-0537-4948-adba-2811a430adb6 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:17.361926 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee834aab-5378-4305-bb69-c4f0d16c809f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:17.362760 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee834aab-5378-4305-bb69-c4f0d16c809f admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:17.363261 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee834aab-5378-4305-bb69-c4f0d16c809f admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:17.363702 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee834aab-5378-4305-bb69-c4f0d16c809f admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:17.365256 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee834aab-5378-4305-bb69-c4f0d16c809f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:17.367515 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee834aab-5378-4305-bb69-c4f0d16c809f admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:17.387692 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 900/1803] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:56:17.392061 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126dfb44-5ab4-42b9-afde-dc8924d9d20b admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:17.408431 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126dfb44-5ab4-42b9-afde-dc8924d9d20b admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:17.423055 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e75117-f5b5-4d9f-8d2e-a335e3271899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:17.424163 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e75117-f5b5-4d9f-8d2e-a335e3271899 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:17.425174 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e75117-f5b5-4d9f-8d2e-a335e3271899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:17.425735 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e75117-f5b5-4d9f-8d2e-a335e3271899 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:17.426558 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e75117-f5b5-4d9f-8d2e-a335e3271899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:17.429588 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e75117-f5b5-4d9f-8d2e-a335e3271899 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:17.445548 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 904/1804] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 17:56:17.450342 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee834aab-5378-4305-bb69-c4f0d16c809f admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:17.491780 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee834aab-5378-4305-bb69-c4f0d16c809f admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:17.500544 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e75117-f5b5-4d9f-8d2e-a335e3271899 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:17.503755 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-19e75117-f5b5-4d9f-8d2e-a335e3271899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:17.518941 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ee76b-9b3d-4a47-81ee-483cbb7b99f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:17.519627 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ee76b-9b3d-4a47-81ee-483cbb7b99f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:17.520222 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ee76b-9b3d-4a47-81ee-483cbb7b99f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:17.520425 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ee76b-9b3d-4a47-81ee-483cbb7b99f8 admin admin] PATH_INFO: `/v3/projects/e1acfd04892644fab3e1f6accd451eb1/users/981591d9162d47038986df4801f8419b/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:17.572922 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ee76b-9b3d-4a47-81ee-483cbb7b99f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1acfd04892644fab3e1f6accd451eb1, user_id=981591d9162d47038986df4801f8419b, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:17.575938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ee76b-9b3d-4a47-81ee-483cbb7b99f8 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:17.602286 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 901/1805] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:56:17 2022] PUT /identity/v3/projects/e1acfd04892644fab3e1f6accd451eb1/users/981591d9162d47038986df4801f8419b/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:17.613003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b055948-a46d-4249-b488-3c5aa0e13c45 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:17.613520 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b055948-a46d-4249-b488-3c5aa0e13c45 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:17.613771 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b055948-a46d-4249-b488-3c5aa0e13c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:17.691479 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e75117-f5b5-4d9f-8d2e-a335e3271899 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:17.726854 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:17.744651 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-6b055948-a46d-4249-b488-3c5aa0e13c45 None None] MFA Rules not processed for user `981591d9162d47038986df4801f8419b`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:17.745918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-6b055948-a46d-4249-b488-3c5aa0e13c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:17.795694 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ef1d0-03a9-4a46-98a2-aec8d3d31e4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:17.796742 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ef1d0-03a9-4a46-98a2-aec8d3d31e4d service nova] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:17.797114 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ef1d0-03a9-4a46-98a2-aec8d3d31e4d service nova] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:17.797591 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ef1d0-03a9-4a46-98a2-aec8d3d31e4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:17.814227 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790ef1d0-03a9-4a46-98a2-aec8d3d31e4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:17.817123 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790ef1d0-03a9-4a46-98a2-aec8d3d31e4d service nova] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:17.834541 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 905/1806] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:17.971656 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 902/1807] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:17.976870 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ef1d0-03a9-4a46-98a2-aec8d3d31e4d service nova] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:18.297272 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ef1d0-03a9-4a46-98a2-aec8d3d31e4d service nova] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:18.318381 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb3862-888d-4c73-afb0-2f0ced66e6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:18.320790 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb3862-888d-4c73-afb0-2f0ced66e6a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:18.322082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb3862-888d-4c73-afb0-2f0ced66e6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:18.322275 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb3862-888d-4c73-afb0-2f0ced66e6a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:18.327003 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb3862-888d-4c73-afb0-2f0ced66e6a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:18.347120 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb3862-888d-4c73-afb0-2f0ced66e6a4 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:18.423580 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 906/1808] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:56:17 2022] POST /identity/v3/projects => generated 387 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:18.426120 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b055948-a46d-4249-b488-3c5aa0e13c45 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:18.444453 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b055948-a46d-4249-b488-3c5aa0e13c45 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:18.720218 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562dca92-0b4c-49bf-b8f5-6cfa44da9516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:18.720612 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dca92-0b4c-49bf-b8f5-6cfa44da9516 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:18.720703 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dca92-0b4c-49bf-b8f5-6cfa44da9516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:18.721052 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dca92-0b4c-49bf-b8f5-6cfa44da9516 admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:18.725903 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562dca92-0b4c-49bf-b8f5-6cfa44da9516 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:18.728725 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562dca92-0b4c-49bf-b8f5-6cfa44da9516 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:18.843089 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb3862-888d-4c73-afb0-2f0ced66e6a4 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:18.844796 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 903/1809] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:56:18 2022] POST /identity/v3/users => generated 300 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:18.858713 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb3862-888d-4c73-afb0-2f0ced66e6a4 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:18.867245 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b9a7b-6c2e-45ae-ab09-9ce1b86a9f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:18.868853 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b9a7b-6c2e-45ae-ab09-9ce1b86a9f99 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:18.869699 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b9a7b-6c2e-45ae-ab09-9ce1b86a9f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:18.871522 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b9a7b-6c2e-45ae-ab09-9ce1b86a9f99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:18.874882 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b9a7b-6c2e-45ae-ab09-9ce1b86a9f99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:18.876605 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b9a7b-6c2e-45ae-ab09-9ce1b86a9f99 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:18.898962 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562dca92-0b4c-49bf-b8f5-6cfa44da9516 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:18.899992 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 907/1810] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:56:18.914576 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562dca92-0b4c-49bf-b8f5-6cfa44da9516 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:18.925369 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282c858-de84-45ee-99b8-4a8bbc87eca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:18.952080 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282c858-de84-45ee-99b8-4a8bbc87eca8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:18.954131 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282c858-de84-45ee-99b8-4a8bbc87eca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:18.955278 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282c858-de84-45ee-99b8-4a8bbc87eca8 admin admin] PATH_INFO: `/v3/projects/1c8f8630a574492bab02ff595570badd/users/0cc6df3017ec4346b8358ec75073645b/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:19.006985 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282c858-de84-45ee-99b8-4a8bbc87eca8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c8f8630a574492bab02ff595570badd, user_id=0cc6df3017ec4346b8358ec75073645b, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:19.014778 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282c858-de84-45ee-99b8-4a8bbc87eca8 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:19.063806 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 904/1811] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:56:18 2022] PUT /identity/v3/projects/1c8f8630a574492bab02ff595570badd/users/0cc6df3017ec4346b8358ec75073645b/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:56:19.069911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b9a7b-6c2e-45ae-ab09-9ce1b86a9f99 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:19.093841 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b9a7b-6c2e-45ae-ab09-9ce1b86a9f99 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:19.251300 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974ccd1-5691-4517-a1ec-d972acd1e7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:19.252040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974ccd1-5691-4517-a1ec-d972acd1e7a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:19.252556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974ccd1-5691-4517-a1ec-d972acd1e7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:19.253452 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974ccd1-5691-4517-a1ec-d972acd1e7a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:19.255499 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4974ccd1-5691-4517-a1ec-d972acd1e7a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:19.262650 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4974ccd1-5691-4517-a1ec-d972acd1e7a8 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:19.300859 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 908/1812] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:56:19.302101 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282c858-de84-45ee-99b8-4a8bbc87eca8 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:19.319835 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282c858-de84-45ee-99b8-4a8bbc87eca8 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:19.351580 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10369ff5-4ccc-44cc-ac62-353f27ffa7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:19.352255 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10369ff5-4ccc-44cc-ac62-353f27ffa7e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:19.352532 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10369ff5-4ccc-44cc-ac62-353f27ffa7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:19.352803 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10369ff5-4ccc-44cc-ac62-353f27ffa7e2 admin admin] PATH_INFO: `/v3/projects/1c8f8630a574492bab02ff595570badd/users/0cc6df3017ec4346b8358ec75073645b/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:19.354772 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10369ff5-4ccc-44cc-ac62-353f27ffa7e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c8f8630a574492bab02ff595570badd, user_id=0cc6df3017ec4346b8358ec75073645b, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:19.357779 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10369ff5-4ccc-44cc-ac62-353f27ffa7e2 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:19.423369 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 905/1813] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:56:19 2022] PUT /identity/v3/projects/1c8f8630a574492bab02ff595570badd/users/0cc6df3017ec4346b8358ec75073645b/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:56:19.441993 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb5447-c576-4b03-9e7a-f57f7d3f3604 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:19.442572 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb5447-c576-4b03-9e7a-f57f7d3f3604 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:19.442967 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb5447-c576-4b03-9e7a-f57f7d3f3604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:19.508876 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-4bfb5447-c576-4b03-9e7a-f57f7d3f3604 None None] MFA Rules not processed for user `0cc6df3017ec4346b8358ec75073645b`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:19.511336 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-4bfb5447-c576-4b03-9e7a-f57f7d3f3604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:19.518382 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:19.701645 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 909/1814] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:19 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:19.716681 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10369ff5-4ccc-44cc-ac62-353f27ffa7e2 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:19.718366 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-10369ff5-4ccc-44cc-ac62-353f27ffa7e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:19.725344 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:19.884637 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10369ff5-4ccc-44cc-ac62-353f27ffa7e2 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:19.894605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224724c-1a5e-4666-846a-a451cf399617 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:19.895238 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224724c-1a5e-4666-846a-a451cf399617 service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:19.895514 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224724c-1a5e-4666-846a-a451cf399617 service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:19.895782 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224724c-1a5e-4666-846a-a451cf399617 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:19.921458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224724c-1a5e-4666-846a-a451cf399617 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:19.922993 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224724c-1a5e-4666-846a-a451cf399617 service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:19.961291 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 906/1815] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:19 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:21.810700 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb5447-c576-4b03-9e7a-f57f7d3f3604 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:21.821858 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb5447-c576-4b03-9e7a-f57f7d3f3604 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:21.831263 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd28f9-55b2-4850-826a-e22f67f5caa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:21.833458 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd28f9-55b2-4850-826a-e22f67f5caa9 service cinder] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:21.835634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd28f9-55b2-4850-826a-e22f67f5caa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:21.836401 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd28f9-55b2-4850-826a-e22f67f5caa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:22.013101 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd28f9-55b2-4850-826a-e22f67f5caa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:22.018797 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd28f9-55b2-4850-826a-e22f67f5caa9 service cinder] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:22.045745 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 910/1816] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:22.315156 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224724c-1a5e-4666-846a-a451cf399617 service cinder] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:22.317699 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-a224724c-1a5e-4666-846a-a451cf399617 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:22.624429 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224724c-1a5e-4666-846a-a451cf399617 service cinder] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:22.671188 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e7f88-95fe-48d1-ae92-a9c271197253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:22.672167 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e7f88-95fe-48d1-ae92-a9c271197253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:22.672537 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e7f88-95fe-48d1-ae92-a9c271197253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:22.672909 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e7f88-95fe-48d1-ae92-a9c271197253 admin admin] PATH_INFO: `/v3/users/0869284206ef447ea87baf968807b6f1` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:22.675634 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e7f88-95fe-48d1-ae92-a9c271197253 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0869284206ef447ea87baf968807b6f1)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:22.677924 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e7f88-95fe-48d1-ae92-a9c271197253 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:22.838528 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-d58e7f88-95fe-48d1-ae92-a9c271197253 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0869284206ef447ea87baf968807b6f1'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:22.841924 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-d58e7f88-95fe-48d1-ae92-a9c271197253 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0869284206ef447ea87baf968807b6f1'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:22.843998 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-d58e7f88-95fe-48d1-ae92-a9c271197253 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0869284206ef447ea87baf968807b6f1'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:22.885240 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-d58e7f88-95fe-48d1-ae92-a9c271197253 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0869284206ef447ea87baf968807b6f1'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:22.919533 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-d58e7f88-95fe-48d1-ae92-a9c271197253 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0869284206ef447ea87baf968807b6f1'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:22.961148 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 907/1817] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:56:22 2022] DELETE /identity/v3/users/0869284206ef447ea87baf968807b6f1 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:22.965720 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a6ddb-822a-4ecd-a5bb-c8aa008d4010 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:22.966270 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a6ddb-822a-4ecd-a5bb-c8aa008d4010 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:22.966270 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a6ddb-822a-4ecd-a5bb-c8aa008d4010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:23.038299 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-668a6ddb-822a-4ecd-a5bb-c8aa008d4010 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:23.039577 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-668a6ddb-822a-4ecd-a5bb-c8aa008d4010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:23.297073 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e7f88-95fe-48d1-ae92-a9c271197253 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:23.298896 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-d58e7f88-95fe-48d1-ae92-a9c271197253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:23.305089 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 911/1818] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:23.327085 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e7f88-95fe-48d1-ae92-a9c271197253 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:23.356928 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3772259-a04e-49eb-920e-2f915a43d65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:23.357989 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3772259-a04e-49eb-920e-2f915a43d65b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:23.358425 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3772259-a04e-49eb-920e-2f915a43d65b admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:23.358849 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3772259-a04e-49eb-920e-2f915a43d65b admin admin] PATH_INFO: `/v3/users/4c8063ad188f4d1da5ff0d9053b22b39` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:23.360260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3772259-a04e-49eb-920e-2f915a43d65b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c8063ad188f4d1da5ff0d9053b22b39)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:23.362417 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3772259-a04e-49eb-920e-2f915a43d65b admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:23.430021 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a6ddb-822a-4ecd-a5bb-c8aa008d4010 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:23.431461 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-668a6ddb-822a-4ecd-a5bb-c8aa008d4010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:23.440890 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:23.518875 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b3772259-a04e-49eb-920e-2f915a43d65b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c8063ad188f4d1da5ff0d9053b22b39'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:23.521345 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b3772259-a04e-49eb-920e-2f915a43d65b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c8063ad188f4d1da5ff0d9053b22b39'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:23.523351 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b3772259-a04e-49eb-920e-2f915a43d65b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c8063ad188f4d1da5ff0d9053b22b39'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:23.545599 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:23.554826 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b3772259-a04e-49eb-920e-2f915a43d65b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c8063ad188f4d1da5ff0d9053b22b39'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:23.575842 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b3772259-a04e-49eb-920e-2f915a43d65b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c8063ad188f4d1da5ff0d9053b22b39'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:23.581000 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a6ddb-822a-4ecd-a5bb-c8aa008d4010 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:23.599636 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4df707-1129-4ff2-80f1-73aba77117d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:23.600446 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4df707-1129-4ff2-80f1-73aba77117d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:23.600722 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4df707-1129-4ff2-80f1-73aba77117d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:23.600994 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4df707-1129-4ff2-80f1-73aba77117d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:23.604584 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 908/1819] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:56:23 2022] DELETE /identity/v3/users/4c8063ad188f4d1da5ff0d9053b22b39 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:23.609474 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c599df-901b-49a3-bf99-d3120e6d72ab None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:23.609754 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c599df-901b-49a3-bf99-d3120e6d72ab None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:23.610090 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c599df-901b-49a3-bf99-d3120e6d72ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:23.614486 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-7e4df707-1129-4ff2-80f1-73aba77117d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:23.640049 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-01c599df-901b-49a3-bf99-d3120e6d72ab None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:23.641669 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-01c599df-901b-49a3-bf99-d3120e6d72ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:23.683492 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4df707-1129-4ff2-80f1-73aba77117d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:23.686853 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4df707-1129-4ff2-80f1-73aba77117d6 service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:23.721706 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 912/1820] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:23.797077 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 909/1821] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:24.268888 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4df707-1129-4ff2-80f1-73aba77117d6 service neutron] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:24.270592 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-7e4df707-1129-4ff2-80f1-73aba77117d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:24.299231 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4df707-1129-4ff2-80f1-73aba77117d6 service neutron] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:24.450580 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016fc83-641d-4d81-9f0b-420f1ed6740d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:24.450905 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016fc83-641d-4d81-9f0b-420f1ed6740d service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:24.451577 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016fc83-641d-4d81-9f0b-420f1ed6740d service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:24.452008 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016fc83-641d-4d81-9f0b-420f1ed6740d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:24.487185 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1016fc83-641d-4d81-9f0b-420f1ed6740d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:24.490868 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1016fc83-641d-4d81-9f0b-420f1ed6740d service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:24.547888 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 913/1822] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:24.926480 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77523834-6635-4232-957b-636eb9fa9f01 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:24.927025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77523834-6635-4232-957b-636eb9fa9f01 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:24.927234 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77523834-6635-4232-957b-636eb9fa9f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:25.016490 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-77523834-6635-4232-957b-636eb9fa9f01 None None] MFA Rules not processed for user `79701852036c4622aa6f6bde71f7b2b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:25.019151 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-77523834-6635-4232-957b-636eb9fa9f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:25.197748 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 910/1823] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:25.202273 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016fc83-641d-4d81-9f0b-420f1ed6740d service neutron] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:25.204655 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-1016fc83-641d-4d81-9f0b-420f1ed6740d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:25.232256 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016fc83-641d-4d81-9f0b-420f1ed6740d service neutron] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:25.242344 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f628511-62cd-4dfd-824d-79631b707d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:25.243220 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f628511-62cd-4dfd-824d-79631b707d38 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:25.243596 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f628511-62cd-4dfd-824d-79631b707d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:25.243978 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f628511-62cd-4dfd-824d-79631b707d38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:25.244814 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f628511-62cd-4dfd-824d-79631b707d38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:25.247101 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f628511-62cd-4dfd-824d-79631b707d38 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:25.318074 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 914/1824] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:56:25 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:25.319651 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77523834-6635-4232-957b-636eb9fa9f01 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:25.343988 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77523834-6635-4232-957b-636eb9fa9f01 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:25.383872 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:25.448312 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81637897-cf01-423e-9918-feeac8fca63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:25.449954 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81637897-cf01-423e-9918-feeac8fca63d admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:25.450399 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81637897-cf01-423e-9918-feeac8fca63d admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:25.450822 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81637897-cf01-423e-9918-feeac8fca63d admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:25.452293 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81637897-cf01-423e-9918-feeac8fca63d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:25.454817 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81637897-cf01-423e-9918-feeac8fca63d admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:25.509647 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 911/1825] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:56:25 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:25.514090 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f628511-62cd-4dfd-824d-79631b707d38 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:25.540179 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f628511-62cd-4dfd-824d-79631b707d38 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:25.550002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59558e85-b1c3-46a5-ac83-6148e5cb3868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:25.551032 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59558e85-b1c3-46a5-ac83-6148e5cb3868 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:25.551820 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59558e85-b1c3-46a5-ac83-6148e5cb3868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:25.552103 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59558e85-b1c3-46a5-ac83-6148e5cb3868 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:25.553287 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59558e85-b1c3-46a5-ac83-6148e5cb3868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:25.559425 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59558e85-b1c3-46a5-ac83-6148e5cb3868 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:25.583484 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81637897-cf01-423e-9918-feeac8fca63d admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:25.593315 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 915/1826] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:56:25.610255 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81637897-cf01-423e-9918-feeac8fca63d admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:25.627009 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98075074-2483-42bb-867c-f01788549394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:25.627149 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98075074-2483-42bb-867c-f01788549394 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:25.627437 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98075074-2483-42bb-867c-f01788549394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:25.627719 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98075074-2483-42bb-867c-f01788549394 admin admin] PATH_INFO: `/v3/projects/ca2163a5cd33422f96a95e4c2c6c23d9/users/8d89e2fcfc5f4025b91653f90ced4af9/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:25.659016 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98075074-2483-42bb-867c-f01788549394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca2163a5cd33422f96a95e4c2c6c23d9, user_id=8d89e2fcfc5f4025b91653f90ced4af9, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:25.664618 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98075074-2483-42bb-867c-f01788549394 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:25.691234 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 912/1827] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:56:25 2022] PUT /identity/v3/projects/ca2163a5cd33422f96a95e4c2c6c23d9/users/8d89e2fcfc5f4025b91653f90ced4af9/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:25.695257 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59558e85-b1c3-46a5-ac83-6148e5cb3868 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:25.713159 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59558e85-b1c3-46a5-ac83-6148e5cb3868 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:25.745791 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c8fb0-b4b6-4a67-819d-8231be8b7346 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:25.747246 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c8fb0-b4b6-4a67-819d-8231be8b7346 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:25.751155 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c8fb0-b4b6-4a67-819d-8231be8b7346 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:25.755612 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 913/1828] 10.222.0.62 () {54 vars in 921 bytes} [Mon Sep 26 17:56:25 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:56:25.813462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c21f3-0679-4c70-a3a0-a77fdb870fda None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:25.814044 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c21f3-0679-4c70-a3a0-a77fdb870fda None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:25.814527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c21f3-0679-4c70-a3a0-a77fdb870fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:25.865514 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb785c-b6b1-4722-9d84-d3726e7d3153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:25.866431 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb785c-b6b1-4722-9d84-d3726e7d3153 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:25.866913 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb785c-b6b1-4722-9d84-d3726e7d3153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:25.867200 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb785c-b6b1-4722-9d84-d3726e7d3153 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:25.868222 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb785c-b6b1-4722-9d84-d3726e7d3153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:25.870448 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb785c-b6b1-4722-9d84-d3726e7d3153 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:25.884182 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 916/1829] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:56:25.888857 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb785c-b6b1-4722-9d84-d3726e7d3153 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:25.899491 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-518c21f3-0679-4c70-a3a0-a77fdb870fda None None] MFA Rules not processed for user `1792e79b9c9a47e1923f19bfd2cd495b`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:25.900894 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-518c21f3-0679-4c70-a3a0-a77fdb870fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:25.909897 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb785c-b6b1-4722-9d84-d3726e7d3153 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:25.922834 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b78f14-beb2-47e7-bd87-73e851913fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:25.923711 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b78f14-beb2-47e7-bd87-73e851913fca admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:25.924287 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b78f14-beb2-47e7-bd87-73e851913fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:25.924420 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b78f14-beb2-47e7-bd87-73e851913fca admin admin] PATH_INFO: `/v3/projects/ca2163a5cd33422f96a95e4c2c6c23d9/users/8d89e2fcfc5f4025b91653f90ced4af9/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:25.926960 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b78f14-beb2-47e7-bd87-73e851913fca admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca2163a5cd33422f96a95e4c2c6c23d9, user_id=8d89e2fcfc5f4025b91653f90ced4af9, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:25.930021 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b78f14-beb2-47e7-bd87-73e851913fca admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:25.943400 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 917/1830] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:56:25 2022] PUT /identity/v3/projects/ca2163a5cd33422f96a95e4c2c6c23d9/users/8d89e2fcfc5f4025b91653f90ced4af9/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:56:25.944897 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b78f14-beb2-47e7-bd87-73e851913fca admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:25.947174 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-82b78f14-beb2-47e7-bd87-73e851913fca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:26.028853 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:26.069129 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b78f14-beb2-47e7-bd87-73e851913fca admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:26.074978 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f34b8-1fc9-4c26-9892-6485833d40bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:26.075213 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f34b8-1fc9-4c26-9892-6485833d40bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:26.076754 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f34b8-1fc9-4c26-9892-6485833d40bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:26.076754 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f34b8-1fc9-4c26-9892-6485833d40bd admin admin] PATH_INFO: `/v3/projects/fdd493d7b2f849b9b351f2f75d83cb0a` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:26.077218 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f34b8-1fc9-4c26-9892-6485833d40bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdd493d7b2f849b9b351f2f75d83cb0a)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:26.079662 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f34b8-1fc9-4c26-9892-6485833d40bd admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:26.083552 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 914/1831] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Sep 26 17:56:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:56:26.110608 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c21f3-0679-4c70-a3a0-a77fdb870fda None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:26.112006 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-518c21f3-0679-4c70-a3a0-a77fdb870fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:26.138906 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c21f3-0679-4c70-a3a0-a77fdb870fda None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:26.166594 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-3c2f34b8-1fc9-4c26-9892-6485833d40bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdd493d7b2f849b9b351f2f75d83cb0a', 'request_id': 'req-3c2f34b8-1fc9-4c26-9892-6485833d40bd'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:26.175038 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-3c2f34b8-1fc9-4c26-9892-6485833d40bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdd493d7b2f849b9b351f2f75d83cb0a', 'request_id': 'req-3c2f34b8-1fc9-4c26-9892-6485833d40bd'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:26.195041 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-3c2f34b8-1fc9-4c26-9892-6485833d40bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdd493d7b2f849b9b351f2f75d83cb0a', 'request_id': 'req-3c2f34b8-1fc9-4c26-9892-6485833d40bd'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:26.259729 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-3c2f34b8-1fc9-4c26-9892-6485833d40bd admin admin] The token cache is being invalidate because project fdd493d7b2f849b9b351f2f75d83cb0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:56:26.260400 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-3c2f34b8-1fc9-4c26-9892-6485833d40bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:26.262915 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-3c2f34b8-1fc9-4c26-9892-6485833d40bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:26.265056 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 918/1832] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:56:25 2022] DELETE /identity/v3/projects/fdd493d7b2f849b9b351f2f75d83cb0a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:26.270216 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f34b8-1fc9-4c26-9892-6485833d40bd admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:26.272403 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-3c2f34b8-1fc9-4c26-9892-6485833d40bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:26.297645 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c042d-15a5-49ed-82a1-640400adbe22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:26.298605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c042d-15a5-49ed-82a1-640400adbe22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:26.299073 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c042d-15a5-49ed-82a1-640400adbe22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:26.300094 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c042d-15a5-49ed-82a1-640400adbe22 admin admin] PATH_INFO: `/v3/projects/9186d31d602e405faba5630311bd0ded` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:26.301846 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c042d-15a5-49ed-82a1-640400adbe22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9186d31d602e405faba5630311bd0ded)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:26.304132 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c042d-15a5-49ed-82a1-640400adbe22 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:26.353963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:26.398259 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-8a5c042d-15a5-49ed-82a1-640400adbe22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9186d31d602e405faba5630311bd0ded', 'request_id': 'req-8a5c042d-15a5-49ed-82a1-640400adbe22'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:26.408349 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-8a5c042d-15a5-49ed-82a1-640400adbe22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9186d31d602e405faba5630311bd0ded', 'request_id': 'req-8a5c042d-15a5-49ed-82a1-640400adbe22'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:26.422300 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-8a5c042d-15a5-49ed-82a1-640400adbe22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9186d31d602e405faba5630311bd0ded', 'request_id': 'req-8a5c042d-15a5-49ed-82a1-640400adbe22'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:26.424658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f34b8-1fc9-4c26-9892-6485833d40bd admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:26.436762 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-8a5c042d-15a5-49ed-82a1-640400adbe22 admin admin] The token cache is being invalidate because project 9186d31d602e405faba5630311bd0ded was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:56:26.437582 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-8a5c042d-15a5-49ed-82a1-640400adbe22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:26.438526 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-8a5c042d-15a5-49ed-82a1-640400adbe22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:26.445973 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 915/1833] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:56:26 2022] DELETE /identity/v3/projects/9186d31d602e405faba5630311bd0ded => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:26.447094 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c042d-15a5-49ed-82a1-640400adbe22 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:26.450368 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-8a5c042d-15a5-49ed-82a1-640400adbe22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:26.550740 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4009d2fd-0ce1-408c-9686-b313f29a64d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:26.551574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009d2fd-0ce1-408c-9686-b313f29a64d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:26.551862 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009d2fd-0ce1-408c-9686-b313f29a64d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:26.552132 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009d2fd-0ce1-408c-9686-b313f29a64d5 admin admin] PATH_INFO: `/v3/users/e671cd2f11b545d48f9336efb2f119de` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:26.553476 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4009d2fd-0ce1-408c-9686-b313f29a64d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e671cd2f11b545d48f9336efb2f119de)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:26.556038 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4009d2fd-0ce1-408c-9686-b313f29a64d5 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:26.593818 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:26.596170 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c042d-15a5-49ed-82a1-640400adbe22 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:26.605518 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb9ebb-3bb9-4f74-bfcb-5c6f88e977a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:26.606997 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb9ebb-3bb9-4f74-bfcb-5c6f88e977a5 service nova] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:26.607274 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb9ebb-3bb9-4f74-bfcb-5c6f88e977a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:26.608349 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb9ebb-3bb9-4f74-bfcb-5c6f88e977a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:26.610587 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-a7cb9ebb-3bb9-4f74-bfcb-5c6f88e977a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:26.625566 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb9ebb-3bb9-4f74-bfcb-5c6f88e977a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:26.627565 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb9ebb-3bb9-4f74-bfcb-5c6f88e977a5 service nova] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:26.644405 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 916/1834] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:26.645649 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb9ebb-3bb9-4f74-bfcb-5c6f88e977a5 service nova] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:26.647893 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-a7cb9ebb-3bb9-4f74-bfcb-5c6f88e977a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:26.664890 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb9ebb-3bb9-4f74-bfcb-5c6f88e977a5 service nova] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:26.670163 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3613921-1e04-4e72-8801-023f1f3ba8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:26.670919 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3613921-1e04-4e72-8801-023f1f3ba8be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:26.671209 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3613921-1e04-4e72-8801-023f1f3ba8be admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:26.671485 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3613921-1e04-4e72-8801-023f1f3ba8be admin admin] PATH_INFO: `/v3/users/813c33f9ebc441dca3bbecbcb06f9a13` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:26.672665 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3613921-1e04-4e72-8801-023f1f3ba8be admin admin] RBAC: Authorizing `identity:delete_user(user_id=813c33f9ebc441dca3bbecbcb06f9a13)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:26.674787 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3613921-1e04-4e72-8801-023f1f3ba8be admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:26.704345 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-4009d2fd-0ce1-408c-9686-b313f29a64d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e671cd2f11b545d48f9336efb2f119de'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:26.720715 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-4009d2fd-0ce1-408c-9686-b313f29a64d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e671cd2f11b545d48f9336efb2f119de'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:26.721863 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-4009d2fd-0ce1-408c-9686-b313f29a64d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e671cd2f11b545d48f9336efb2f119de'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:26.722893 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-4009d2fd-0ce1-408c-9686-b313f29a64d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e671cd2f11b545d48f9336efb2f119de'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:26.742590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-4009d2fd-0ce1-408c-9686-b313f29a64d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e671cd2f11b545d48f9336efb2f119de'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:26.754297 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-a3613921-1e04-4e72-8801-023f1f3ba8be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '813c33f9ebc441dca3bbecbcb06f9a13'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:26.755000 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-a3613921-1e04-4e72-8801-023f1f3ba8be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '813c33f9ebc441dca3bbecbcb06f9a13'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:26.755635 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-a3613921-1e04-4e72-8801-023f1f3ba8be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '813c33f9ebc441dca3bbecbcb06f9a13'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:26.766846 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-a3613921-1e04-4e72-8801-023f1f3ba8be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '813c33f9ebc441dca3bbecbcb06f9a13'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:26.779916 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-a3613921-1e04-4e72-8801-023f1f3ba8be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '813c33f9ebc441dca3bbecbcb06f9a13'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:26.780792 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 919/1835] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:56:26 2022] DELETE /identity/v3/users/e671cd2f11b545d48f9336efb2f119de => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:26.816976 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 917/1836] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:56:26 2022] DELETE /identity/v3/users/813c33f9ebc441dca3bbecbcb06f9a13 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:27.116676 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea8449-342d-407a-984a-3cc2a60758e5 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:27.117467 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea8449-342d-407a-984a-3cc2a60758e5 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:27.117768 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea8449-342d-407a-984a-3cc2a60758e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:27.164039 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-6fea8449-342d-407a-984a-3cc2a60758e5 None None] MFA Rules not processed for user `8d89e2fcfc5f4025b91653f90ced4af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:27.165341 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-6fea8449-342d-407a-984a-3cc2a60758e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:27.273734 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3613921-1e04-4e72-8801-023f1f3ba8be admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:27.275460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-a3613921-1e04-4e72-8801-023f1f3ba8be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:27.304225 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:27.339494 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 920/1837] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:27.340905 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea8449-342d-407a-984a-3cc2a60758e5 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:27.344140 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-6fea8449-342d-407a-984a-3cc2a60758e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:27.512028 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3613921-1e04-4e72-8801-023f1f3ba8be admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:27.541154 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72596fb7-3be7-4152-a06e-75d5245a5581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:27.541963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72596fb7-3be7-4152-a06e-75d5245a5581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:27.542420 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72596fb7-3be7-4152-a06e-75d5245a5581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:27.542702 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72596fb7-3be7-4152-a06e-75d5245a5581 admin admin] PATH_INFO: `/v3/projects/7be4299e0cc841d1bcccd92cb972ccb9` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:27.546106 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea8449-342d-407a-984a-3cc2a60758e5 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:27.546603 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72596fb7-3be7-4152-a06e-75d5245a5581 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7be4299e0cc841d1bcccd92cb972ccb9)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:27.553143 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72596fb7-3be7-4152-a06e-75d5245a5581 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:27.557298 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246ba8f-95ff-4b2c-ae49-ed211058e4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:27.560090 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246ba8f-95ff-4b2c-ae49-ed211058e4f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:27.560464 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246ba8f-95ff-4b2c-ae49-ed211058e4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:27.560842 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246ba8f-95ff-4b2c-ae49-ed211058e4f5 admin admin] PATH_INFO: `/v3/projects/506b2a042375460d94bd89b1a2aaacb1` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:27.563867 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246ba8f-95ff-4b2c-ae49-ed211058e4f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=506b2a042375460d94bd89b1a2aaacb1)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:27.565938 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246ba8f-95ff-4b2c-ae49-ed211058e4f5 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:27.599303 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:27.642416 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-7246ba8f-95ff-4b2c-ae49-ed211058e4f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '506b2a042375460d94bd89b1a2aaacb1', 'request_id': 'req-7246ba8f-95ff-4b2c-ae49-ed211058e4f5'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:27.648701 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-72596fb7-3be7-4152-a06e-75d5245a5581 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7be4299e0cc841d1bcccd92cb972ccb9', 'request_id': 'req-72596fb7-3be7-4152-a06e-75d5245a5581'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:27.657443 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-72596fb7-3be7-4152-a06e-75d5245a5581 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7be4299e0cc841d1bcccd92cb972ccb9', 'request_id': 'req-72596fb7-3be7-4152-a06e-75d5245a5581'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:27.668819 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-7246ba8f-95ff-4b2c-ae49-ed211058e4f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '506b2a042375460d94bd89b1a2aaacb1', 'request_id': 'req-7246ba8f-95ff-4b2c-ae49-ed211058e4f5'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:27.682373 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-72596fb7-3be7-4152-a06e-75d5245a5581 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7be4299e0cc841d1bcccd92cb972ccb9', 'request_id': 'req-72596fb7-3be7-4152-a06e-75d5245a5581'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:27.688107 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-7246ba8f-95ff-4b2c-ae49-ed211058e4f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '506b2a042375460d94bd89b1a2aaacb1', 'request_id': 'req-7246ba8f-95ff-4b2c-ae49-ed211058e4f5'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:27.701948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-72596fb7-3be7-4152-a06e-75d5245a5581 admin admin] The token cache is being invalidate because project 7be4299e0cc841d1bcccd92cb972ccb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:56:27.702379 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-72596fb7-3be7-4152-a06e-75d5245a5581 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:27.703167 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-72596fb7-3be7-4152-a06e-75d5245a5581 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:27.705297 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 918/1838] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:56:27 2022] DELETE /identity/v3/projects/7be4299e0cc841d1bcccd92cb972ccb9 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:27.707036 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2188e-e29b-431f-a9c9-e141d3bfbc68 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:27.707615 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2188e-e29b-431f-a9c9-e141d3bfbc68 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:27.708733 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2188e-e29b-431f-a9c9-e141d3bfbc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:27.709994 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-7246ba8f-95ff-4b2c-ae49-ed211058e4f5 admin admin] The token cache is being invalidate because project 506b2a042375460d94bd89b1a2aaacb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:56:27.712824 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-7246ba8f-95ff-4b2c-ae49-ed211058e4f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:27.714063 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-7246ba8f-95ff-4b2c-ae49-ed211058e4f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:27.716292 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 921/1839] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:56:27 2022] DELETE /identity/v3/projects/506b2a042375460d94bd89b1a2aaacb1 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:27.717518 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246ba8f-95ff-4b2c-ae49-ed211058e4f5 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:27.719071 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-7246ba8f-95ff-4b2c-ae49-ed211058e4f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:27.754807 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-c0d2188e-e29b-431f-a9c9-e141d3bfbc68 None None] MFA Rules not processed for user `79701852036c4622aa6f6bde71f7b2b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:27.757566 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-c0d2188e-e29b-431f-a9c9-e141d3bfbc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:27.815366 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246ba8f-95ff-4b2c-ae49-ed211058e4f5 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:27.849228 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 919/1840] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:27.849228 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79543f2-95cb-45af-81e2-1da30eeec0fd None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:27.849228 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79543f2-95cb-45af-81e2-1da30eeec0fd None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:27.849228 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79543f2-95cb-45af-81e2-1da30eeec0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:27.869838 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-c79543f2-95cb-45af-81e2-1da30eeec0fd None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:27.871236 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-c79543f2-95cb-45af-81e2-1da30eeec0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:27.889445 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80d3f2-e01e-437e-943f-627cbf64225b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:27.890276 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80d3f2-e01e-437e-943f-627cbf64225b service cinder] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:27.890712 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80d3f2-e01e-437e-943f-627cbf64225b service cinder] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:27.891128 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80d3f2-e01e-437e-943f-627cbf64225b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:27.893347 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-0b80d3f2-e01e-437e-943f-627cbf64225b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:27.979900 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:28.004067 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 920/1841] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:28.005738 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5c1de-a462-48b2-a8f2-6c715d03426a None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:28.006022 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5c1de-a462-48b2-a8f2-6c715d03426a None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:28.006305 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5c1de-a462-48b2-a8f2-6c715d03426a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:28.026656 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80d3f2-e01e-437e-943f-627cbf64225b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:28.030082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80d3f2-e01e-437e-943f-627cbf64225b service cinder] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:28.036519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-3ee5c1de-a462-48b2-a8f2-6c715d03426a None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:28.037813 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-3ee5c1de-a462-48b2-a8f2-6c715d03426a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:28.042326 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 922/1842] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:28.043575 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80d3f2-e01e-437e-943f-627cbf64225b service cinder] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:28.045199 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-0b80d3f2-e01e-437e-943f-627cbf64225b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:28.082041 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:28.082260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 921/1843] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:28.084206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd8c12-7226-47c8-bf90-38fe8d4786af None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:28.084474 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd8c12-7226-47c8-bf90-38fe8d4786af None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:28.084748 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd8c12-7226-47c8-bf90-38fe8d4786af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:28.113919 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-f4dd8c12-7226-47c8-bf90-38fe8d4786af None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:28.115539 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-f4dd8c12-7226-47c8-bf90-38fe8d4786af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:28.124997 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 922/1844] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:28.126373 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfcf48-7ed6-49a2-b731-6523e38419c5 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:28.126657 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfcf48-7ed6-49a2-b731-6523e38419c5 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:28.126930 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfcf48-7ed6-49a2-b731-6523e38419c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:28.155756 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-11bfcf48-7ed6-49a2-b731-6523e38419c5 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:28.157435 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-11bfcf48-7ed6-49a2-b731-6523e38419c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:28.178589 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 923/1845] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:28.182623 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfcf48-7ed6-49a2-b731-6523e38419c5 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:28.195737 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfcf48-7ed6-49a2-b731-6523e38419c5 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:28.205647 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5196f-cadf-4fed-b459-3d3b0186f660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:28.206273 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5196f-cadf-4fed-b459-3d3b0186f660 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:28.206538 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5196f-cadf-4fed-b459-3d3b0186f660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:28.206809 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5196f-cadf-4fed-b459-3d3b0186f660 admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:28.207712 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5196f-cadf-4fed-b459-3d3b0186f660 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:56:28.209659 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5196f-cadf-4fed-b459-3d3b0186f660 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:28.211607 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5196f-cadf-4fed-b459-3d3b0186f660 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:28.221664 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80d3f2-e01e-437e-943f-627cbf64225b service cinder] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:28.239422 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e84c69-beb9-49ed-8238-5f71e36869c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:28.240093 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e84c69-beb9-49ed-8238-5f71e36869c9 service nova] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:28.240379 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e84c69-beb9-49ed-8238-5f71e36869c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:28.240650 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e84c69-beb9-49ed-8238-5f71e36869c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:28.241417 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 924/1846] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:56:28.242859 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5196f-cadf-4fed-b459-3d3b0186f660 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:28.246766 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-52e84c69-beb9-49ed-8238-5f71e36869c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:28.269449 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5196f-cadf-4fed-b459-3d3b0186f660 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:28.272418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e84c69-beb9-49ed-8238-5f71e36869c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:28.274414 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e84c69-beb9-49ed-8238-5f71e36869c9 service nova] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:28.283359 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3b07d-ce11-4f66-b850-dd912fc57fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:28.284038 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3b07d-ce11-4f66-b850-dd912fc57fca admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:28.284294 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3b07d-ce11-4f66-b850-dd912fc57fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:28.284567 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3b07d-ce11-4f66-b850-dd912fc57fca admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:28.285972 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3b07d-ce11-4f66-b850-dd912fc57fca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:56:28.286283 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3b07d-ce11-4f66-b850-dd912fc57fca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:28.292651 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3b07d-ce11-4f66-b850-dd912fc57fca admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:28.316368 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 923/1847] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:28.318416 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e84c69-beb9-49ed-8238-5f71e36869c9 service nova] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:28.345648 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 925/1848] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:56:28.346121 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3b07d-ce11-4f66-b850-dd912fc57fca admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:28.353844 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e84c69-beb9-49ed-8238-5f71e36869c9 service nova] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:28.365075 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3b07d-ce11-4f66-b850-dd912fc57fca admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:28.370119 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f34c90-1ab0-4bad-a299-681be16956e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:28.372454 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f34c90-1ab0-4bad-a299-681be16956e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:28.372849 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f34c90-1ab0-4bad-a299-681be16956e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:28.373397 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f34c90-1ab0-4bad-a299-681be16956e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:28.375057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16aac0-1782-4576-a797-5c3ab4da0aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:28.375914 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f34c90-1ab0-4bad-a299-681be16956e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:28.376077 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16aac0-1782-4576-a797-5c3ab4da0aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:28.376493 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16aac0-1782-4576-a797-5c3ab4da0aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:28.383120 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16aac0-1782-4576-a797-5c3ab4da0aa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:28.384253 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16aac0-1782-4576-a797-5c3ab4da0aa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:28.385533 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f34c90-1ab0-4bad-a299-681be16956e2 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:28.417679 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16aac0-1782-4576-a797-5c3ab4da0aa9 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:28.457352 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 924/1849] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:56:28 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:28.461516 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f34c90-1ab0-4bad-a299-681be16956e2 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:28.461716 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 926/1850] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:56:28 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:28.466017 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16aac0-1782-4576-a797-5c3ab4da0aa9 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:28.562180 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16aac0-1782-4576-a797-5c3ab4da0aa9 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:28.568172 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d4f56-478f-4d08-b29a-37a1e96da00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:28.568695 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d4f56-478f-4d08-b29a-37a1e96da00f admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:28.569219 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d4f56-478f-4d08-b29a-37a1e96da00f admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:28.569341 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d4f56-478f-4d08-b29a-37a1e96da00f admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:28.569971 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d4f56-478f-4d08-b29a-37a1e96da00f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:28.572288 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d4f56-478f-4d08-b29a-37a1e96da00f admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:28.598469 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f34c90-1ab0-4bad-a299-681be16956e2 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:28.608206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 927/1851] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:56:28 2022] POST /identity/v3/users => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:28.609702 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0e234-a402-4535-ad26-c742bc153066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:28.611368 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d4f56-478f-4d08-b29a-37a1e96da00f admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:28.612046 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0e234-a402-4535-ad26-c742bc153066 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:28.612734 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0e234-a402-4535-ad26-c742bc153066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:28.613028 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0e234-a402-4535-ad26-c742bc153066 admin admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:28.617674 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0e234-a402-4535-ad26-c742bc153066 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:28.621159 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0e234-a402-4535-ad26-c742bc153066 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:28.642107 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d4f56-478f-4d08-b29a-37a1e96da00f admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:28.653894 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a94fd-96b3-4c27-8d3b-e46229929baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:28.656363 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 925/1852] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:56:28 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:28.656716 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a94fd-96b3-4c27-8d3b-e46229929baf admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:28.657046 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a94fd-96b3-4c27-8d3b-e46229929baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:28.657330 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a94fd-96b3-4c27-8d3b-e46229929baf admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:28.658719 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a94fd-96b3-4c27-8d3b-e46229929baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:28.661330 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0e234-a402-4535-ad26-c742bc153066 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:28.664924 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a94fd-96b3-4c27-8d3b-e46229929baf admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:28.689063 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0e234-a402-4535-ad26-c742bc153066 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:28.696948 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43348a1a-5855-42f4-964c-4bc5cf1ffeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:28.698052 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 928/1853] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:56:28.698578 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43348a1a-5855-42f4-964c-4bc5cf1ffeff admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:28.699061 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43348a1a-5855-42f4-964c-4bc5cf1ffeff admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:28.700728 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43348a1a-5855-42f4-964c-4bc5cf1ffeff admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:28.701965 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43348a1a-5855-42f4-964c-4bc5cf1ffeff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:28.702415 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a94fd-96b3-4c27-8d3b-e46229929baf admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:28.705447 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43348a1a-5855-42f4-964c-4bc5cf1ffeff admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:28.733952 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 926/1854] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:56:28.734148 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a94fd-96b3-4c27-8d3b-e46229929baf admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:28.735688 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43348a1a-5855-42f4-964c-4bc5cf1ffeff admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:28.749903 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0f75c-4cc7-44d8-8868-3f8e93784dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:28.750623 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0f75c-4cc7-44d8-8868-3f8e93784dae admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:28.750833 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0f75c-4cc7-44d8-8868-3f8e93784dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:28.752187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0f75c-4cc7-44d8-8868-3f8e93784dae admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:28.754575 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0f75c-4cc7-44d8-8868-3f8e93784dae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:28.761306 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0f75c-4cc7-44d8-8868-3f8e93784dae admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:28.764405 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43348a1a-5855-42f4-964c-4bc5cf1ffeff admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:28.778814 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f41ac9-c239-4550-ab85-d7c41c2f48a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:28.779698 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f41ac9-c239-4550-ab85-d7c41c2f48a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:28.779989 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f41ac9-c239-4550-ab85-d7c41c2f48a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:28.780189 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f41ac9-c239-4550-ab85-d7c41c2f48a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:28.780949 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f41ac9-c239-4550-ab85-d7c41c2f48a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:28.787301 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f41ac9-c239-4550-ab85-d7c41c2f48a7 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:28.788209 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 929/1855] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:56:28.790855 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0f75c-4cc7-44d8-8868-3f8e93784dae admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:28.818502 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0f75c-4cc7-44d8-8868-3f8e93784dae admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:28.822122 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 927/1856] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 17:56:28.826244 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f41ac9-c239-4550-ab85-d7c41c2f48a7 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:28.827544 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c579aa5-8f23-4e60-a126-bae90f8d6db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:28.830803 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c579aa5-8f23-4e60-a126-bae90f8d6db3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:28.832044 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c579aa5-8f23-4e60-a126-bae90f8d6db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:28.833137 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c579aa5-8f23-4e60-a126-bae90f8d6db3 admin admin] PATH_INFO: `/v3/projects/b7e9246f4b08438895d0c0874311aa7b/users/709453b367df4113b03d4d031616bf06/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:28.849453 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f41ac9-c239-4550-ab85-d7c41c2f48a7 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:28.858781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e1cfe7-0885-402d-a841-0ae2a26bec93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:28.860680 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1cfe7-0885-402d-a841-0ae2a26bec93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:28.861550 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1cfe7-0885-402d-a841-0ae2a26bec93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:28.862499 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1cfe7-0885-402d-a841-0ae2a26bec93 admin admin] PATH_INFO: `/v3/projects/f83f92bc88de46b68d931bfb90f1125c/users/7006c9b3491d4c1881b1079859957a3d/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:28.870922 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c579aa5-8f23-4e60-a126-bae90f8d6db3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7e9246f4b08438895d0c0874311aa7b, user_id=709453b367df4113b03d4d031616bf06, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:28.877202 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c579aa5-8f23-4e60-a126-bae90f8d6db3 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:28.905404 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e1cfe7-0885-402d-a841-0ae2a26bec93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f83f92bc88de46b68d931bfb90f1125c, user_id=7006c9b3491d4c1881b1079859957a3d, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:28.910346 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e1cfe7-0885-402d-a841-0ae2a26bec93 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:28.912883 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 930/1857] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:56:28 2022] PUT /identity/v3/projects/b7e9246f4b08438895d0c0874311aa7b/users/709453b367df4113b03d4d031616bf06/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:28.924469 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21482c-cd53-4824-a67d-85d46a49f96d None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:28.924784 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21482c-cd53-4824-a67d-85d46a49f96d None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:28.925097 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21482c-cd53-4824-a67d-85d46a49f96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:28.947412 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 928/1858] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:56:28 2022] PUT /identity/v3/projects/f83f92bc88de46b68d931bfb90f1125c/users/7006c9b3491d4c1881b1079859957a3d/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:28.955824 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c9f2e-10b4-4609-af6a-72b788c73d2d None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:28.956157 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c9f2e-10b4-4609-af6a-72b788c73d2d None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:28.956364 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c9f2e-10b4-4609-af6a-72b788c73d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:29.009886 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-9e21482c-cd53-4824-a67d-85d46a49f96d None None] MFA Rules not processed for user `709453b367df4113b03d4d031616bf06`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:29.015636 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-9e21482c-cd53-4824-a67d-85d46a49f96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:29.022948 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-ee2c9f2e-10b4-4609-af6a-72b788c73d2d None None] MFA Rules not processed for user `7006c9b3491d4c1881b1079859957a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:29.025360 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-ee2c9f2e-10b4-4609-af6a-72b788c73d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:29.043985 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:29.048689 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:29.140008 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 929/1859] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:29.156747 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c9f2e-10b4-4609-af6a-72b788c73d2d None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:29.181185 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 931/1860] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:29.182752 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21482c-cd53-4824-a67d-85d46a49f96d None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:29.244800 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c9f2e-10b4-4609-af6a-72b788c73d2d None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:29.275992 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628f148-b8f2-4162-88fa-a8ed82a95a40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:29.278839 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628f148-b8f2-4162-88fa-a8ed82a95a40 service cinder] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:29.279284 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628f148-b8f2-4162-88fa-a8ed82a95a40 service cinder] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:29.280699 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628f148-b8f2-4162-88fa-a8ed82a95a40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:29.298770 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1628f148-b8f2-4162-88fa-a8ed82a95a40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:29.302553 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1628f148-b8f2-4162-88fa-a8ed82a95a40 service cinder] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:29.312113 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21482c-cd53-4824-a67d-85d46a49f96d None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:29.325373 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31756059-0eae-44a7-bcf3-e83cfc294a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:29.327126 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31756059-0eae-44a7-bcf3-e83cfc294a44 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:29.327606 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31756059-0eae-44a7-bcf3-e83cfc294a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:29.328742 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31756059-0eae-44a7-bcf3-e83cfc294a44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:29.330174 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31756059-0eae-44a7-bcf3-e83cfc294a44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:29.337317 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31756059-0eae-44a7-bcf3-e83cfc294a44 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:29.351979 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 930/1861] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 17:56:29.377663 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628f148-b8f2-4162-88fa-a8ed82a95a40 service cinder] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:29.392535 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628f148-b8f2-4162-88fa-a8ed82a95a40 service cinder] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:29.413668 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d57415-7e3f-4a61-8b8f-00eb3a32b873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:29.416634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d57415-7e3f-4a61-8b8f-00eb3a32b873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:29.417204 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d57415-7e3f-4a61-8b8f-00eb3a32b873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:29.419068 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d57415-7e3f-4a61-8b8f-00eb3a32b873 admin admin] PATH_INFO: `/v3/users/7006c9b3491d4c1881b1079859957a3d` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:29.425932 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d57415-7e3f-4a61-8b8f-00eb3a32b873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7006c9b3491d4c1881b1079859957a3d)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:29.428280 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d57415-7e3f-4a61-8b8f-00eb3a32b873 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:29.431849 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 932/1862] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:56:29 2022] POST /identity/v3/projects => generated 375 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:29.437984 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31756059-0eae-44a7-bcf3-e83cfc294a44 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:29.516966 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-09d57415-7e3f-4a61-8b8f-00eb3a32b873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7006c9b3491d4c1881b1079859957a3d'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:29.528322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-09d57415-7e3f-4a61-8b8f-00eb3a32b873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7006c9b3491d4c1881b1079859957a3d'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:29.529487 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-09d57415-7e3f-4a61-8b8f-00eb3a32b873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7006c9b3491d4c1881b1079859957a3d'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:29.530793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-09d57415-7e3f-4a61-8b8f-00eb3a32b873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7006c9b3491d4c1881b1079859957a3d'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:29.547169 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-09d57415-7e3f-4a61-8b8f-00eb3a32b873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7006c9b3491d4c1881b1079859957a3d'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:29.578631 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31756059-0eae-44a7-bcf3-e83cfc294a44 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:29.583801 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c771e0ae-01d5-4449-a88f-7004b173d02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:29.584859 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771e0ae-01d5-4449-a88f-7004b173d02b admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:29.585314 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771e0ae-01d5-4449-a88f-7004b173d02b admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:29.585654 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771e0ae-01d5-4449-a88f-7004b173d02b admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:29.586708 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c771e0ae-01d5-4449-a88f-7004b173d02b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:29.588808 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c771e0ae-01d5-4449-a88f-7004b173d02b admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:29.599869 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 931/1863] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:56:29 2022] DELETE /identity/v3/users/7006c9b3491d4c1881b1079859957a3d => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:29.604271 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81819c-df76-4fea-a10b-ea3f4e3ede12 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:29.606234 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81819c-df76-4fea-a10b-ea3f4e3ede12 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:29.606838 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81819c-df76-4fea-a10b-ea3f4e3ede12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:29.643381 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 933/1864] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:56:29 2022] POST /identity/v3/users => generated 294 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:29.648313 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c771e0ae-01d5-4449-a88f-7004b173d02b admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:29.651962 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-c771e0ae-01d5-4449-a88f-7004b173d02b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:29.671286 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-cb81819c-df76-4fea-a10b-ea3f4e3ede12 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:29.672685 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-cb81819c-df76-4fea-a10b-ea3f4e3ede12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:29.675518 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c771e0ae-01d5-4449-a88f-7004b173d02b admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:29.711537 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:29.722963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:29.778141 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101d48e-2e36-4a79-a720-42ba6948140c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:29.781395 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101d48e-2e36-4a79-a720-42ba6948140c admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:29.781759 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101d48e-2e36-4a79-a720-42ba6948140c admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:29.782311 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101d48e-2e36-4a79-a720-42ba6948140c admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:29.783496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101d48e-2e36-4a79-a720-42ba6948140c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:29.786413 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 932/1865] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:29.790250 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101d48e-2e36-4a79-a720-42ba6948140c admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:29.799877 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81819c-df76-4fea-a10b-ea3f4e3ede12 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:29.801818 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-cb81819c-df76-4fea-a10b-ea3f4e3ede12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:29.805677 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 934/1866] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:56:29.810369 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101d48e-2e36-4a79-a720-42ba6948140c admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:29.826299 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101d48e-2e36-4a79-a720-42ba6948140c admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:29.831521 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635eeb18-a412-4700-98a1-af297f95d132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:29.832160 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635eeb18-a412-4700-98a1-af297f95d132 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:29.832448 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635eeb18-a412-4700-98a1-af297f95d132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:29.832724 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635eeb18-a412-4700-98a1-af297f95d132 admin admin] PATH_INFO: `/v3/projects/d59ce43c520d470bacad84ecceb76d9e/users/cb39b6ee3bf94c27861cee47d960eaea/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:29.871931 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635eeb18-a412-4700-98a1-af297f95d132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d59ce43c520d470bacad84ecceb76d9e, user_id=cb39b6ee3bf94c27861cee47d960eaea, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:29.874737 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635eeb18-a412-4700-98a1-af297f95d132 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:29.924298 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 935/1867] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:56:29 2022] PUT /identity/v3/projects/d59ce43c520d470bacad84ecceb76d9e/users/cb39b6ee3bf94c27861cee47d960eaea/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:29.928494 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635eeb18-a412-4700-98a1-af297f95d132 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:29.932384 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81819c-df76-4fea-a10b-ea3f4e3ede12 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:30.021790 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611f5de-e4a5-420a-87d9-1e3473d08083 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:30.021790 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611f5de-e4a5-420a-87d9-1e3473d08083 service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:30.021790 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611f5de-e4a5-420a-87d9-1e3473d08083 service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:30.021790 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611f5de-e4a5-420a-87d9-1e3473d08083 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:30.022079 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635eeb18-a412-4700-98a1-af297f95d132 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:30.023832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611f5de-e4a5-420a-87d9-1e3473d08083 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:30.025455 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611f5de-e4a5-420a-87d9-1e3473d08083 service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:30.026105 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816998c4-804a-4fd6-bdc5-2f9ff0432370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:30.027006 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816998c4-804a-4fd6-bdc5-2f9ff0432370 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:30.027458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816998c4-804a-4fd6-bdc5-2f9ff0432370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:30.027861 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816998c4-804a-4fd6-bdc5-2f9ff0432370 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:30.028844 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816998c4-804a-4fd6-bdc5-2f9ff0432370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:30.031164 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816998c4-804a-4fd6-bdc5-2f9ff0432370 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:30.036230 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 933/1868] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 17:56:30.045109 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 936/1869] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 17:56:30.049694 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611f5de-e4a5-420a-87d9-1e3473d08083 service neutron] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:30.061252 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611f5de-e4a5-420a-87d9-1e3473d08083 service neutron] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:30.067224 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8876690-2001-4627-a426-7f1f06a0c442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:30.068206 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8876690-2001-4627-a426-7f1f06a0c442 admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:30.069066 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8876690-2001-4627-a426-7f1f06a0c442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:30.069066 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8876690-2001-4627-a426-7f1f06a0c442 admin admin] PATH_INFO: `/v3/projects/d59ce43c520d470bacad84ecceb76d9e/users/cb39b6ee3bf94c27861cee47d960eaea/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:30.071611 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8876690-2001-4627-a426-7f1f06a0c442 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d59ce43c520d470bacad84ecceb76d9e, user_id=cb39b6ee3bf94c27861cee47d960eaea, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:30.075490 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8876690-2001-4627-a426-7f1f06a0c442 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:30.092055 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 934/1870] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:56:30 2022] PUT /identity/v3/projects/d59ce43c520d470bacad84ecceb76d9e/users/cb39b6ee3bf94c27861cee47d960eaea/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:56:30.106432 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3ff7d-812d-41f6-9de2-561da2453d1a None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:30.107185 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3ff7d-812d-41f6-9de2-561da2453d1a None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:30.107704 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3ff7d-812d-41f6-9de2-561da2453d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:30.148741 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-53b3ff7d-812d-41f6-9de2-561da2453d1a None None] MFA Rules not processed for user `cb39b6ee3bf94c27861cee47d960eaea`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:30.150454 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-53b3ff7d-812d-41f6-9de2-561da2453d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:30.259652 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 937/1871] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:30.273061 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8876690-2001-4627-a426-7f1f06a0c442 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:30.274866 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-c8876690-2001-4627-a426-7f1f06a0c442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:30.374128 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8876690-2001-4627-a426-7f1f06a0c442 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:30.378123 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86c139-0f41-4351-8804-4d45ba8af87b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:30.378918 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86c139-0f41-4351-8804-4d45ba8af87b service cinder] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:30.379061 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86c139-0f41-4351-8804-4d45ba8af87b service cinder] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:30.379471 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86c139-0f41-4351-8804-4d45ba8af87b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:30.381309 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-fc86c139-0f41-4351-8804-4d45ba8af87b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:30.399274 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3ff7d-812d-41f6-9de2-561da2453d1a None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:30.401071 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-53b3ff7d-812d-41f6-9de2-561da2453d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:30.433237 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:30.434489 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:30.470719 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86c139-0f41-4351-8804-4d45ba8af87b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:30.472666 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86c139-0f41-4351-8804-4d45ba8af87b service cinder] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:30.482885 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 935/1872] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:30.495060 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3ff7d-812d-41f6-9de2-561da2453d1a None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:30.500494 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a659551-431f-4210-9907-3f62b1996ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:30.501196 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a659551-431f-4210-9907-3f62b1996ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:30.501481 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a659551-431f-4210-9907-3f62b1996ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:30.501802 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a659551-431f-4210-9907-3f62b1996ef3 admin admin] PATH_INFO: `/v3/projects/f83f92bc88de46b68d931bfb90f1125c` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:30.502928 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a659551-431f-4210-9907-3f62b1996ef3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f83f92bc88de46b68d931bfb90f1125c)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:30.505437 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a659551-431f-4210-9907-3f62b1996ef3 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:30.577315 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-6a659551-431f-4210-9907-3f62b1996ef3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f83f92bc88de46b68d931bfb90f1125c', 'request_id': 'req-6a659551-431f-4210-9907-3f62b1996ef3'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:30.586050 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-6a659551-431f-4210-9907-3f62b1996ef3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f83f92bc88de46b68d931bfb90f1125c', 'request_id': 'req-6a659551-431f-4210-9907-3f62b1996ef3'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:30.601423 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-6a659551-431f-4210-9907-3f62b1996ef3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f83f92bc88de46b68d931bfb90f1125c', 'request_id': 'req-6a659551-431f-4210-9907-3f62b1996ef3'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:30.624346 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-6a659551-431f-4210-9907-3f62b1996ef3 admin admin] The token cache is being invalidate because project f83f92bc88de46b68d931bfb90f1125c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:56:30.624712 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-6a659551-431f-4210-9907-3f62b1996ef3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:30.625537 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-6a659551-431f-4210-9907-3f62b1996ef3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:30.630893 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 938/1873] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:56:30 2022] DELETE /identity/v3/projects/f83f92bc88de46b68d931bfb90f1125c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:30.633250 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5ee21-4f89-4710-a52b-4270afe38972 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:30.633953 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5ee21-4f89-4710-a52b-4270afe38972 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:30.633953 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5ee21-4f89-4710-a52b-4270afe38972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:30.657506 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-69c5ee21-4f89-4710-a52b-4270afe38972 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:30.658971 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-69c5ee21-4f89-4710-a52b-4270afe38972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:30.739002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 936/1874] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:30.748070 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2dab2-48b1-4bbd-95fa-c3435165f030 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:30.748356 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2dab2-48b1-4bbd-95fa-c3435165f030 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:30.748626 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2dab2-48b1-4bbd-95fa-c3435165f030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:30.769721 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-75f2dab2-48b1-4bbd-95fa-c3435165f030 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:30.771331 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-75f2dab2-48b1-4bbd-95fa-c3435165f030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:30.790109 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5ee21-4f89-4710-a52b-4270afe38972 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:30.797501 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 939/1875] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:30.803061 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5ee21-4f89-4710-a52b-4270afe38972 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:30.809831 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f68e41-0336-441e-92fe-9aa2c0bd266d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:30.810720 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f68e41-0336-441e-92fe-9aa2c0bd266d admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:30.811401 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f68e41-0336-441e-92fe-9aa2c0bd266d admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:30.811784 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f68e41-0336-441e-92fe-9aa2c0bd266d admin admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:30.812553 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f68e41-0336-441e-92fe-9aa2c0bd266d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:56:30.813313 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f68e41-0336-441e-92fe-9aa2c0bd266d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:30.815999 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f68e41-0336-441e-92fe-9aa2c0bd266d admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:30.838128 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 937/1876] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:56:30.838945 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2dab2-48b1-4bbd-95fa-c3435165f030 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:30.872158 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2dab2-48b1-4bbd-95fa-c3435165f030 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:30.883710 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6046f74-c393-4260-a38f-30bc7705f3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:30.884661 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6046f74-c393-4260-a38f-30bc7705f3b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:30.885154 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6046f74-c393-4260-a38f-30bc7705f3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:30.885617 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6046f74-c393-4260-a38f-30bc7705f3b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:30.886603 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6046f74-c393-4260-a38f-30bc7705f3b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:30.903508 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6046f74-c393-4260-a38f-30bc7705f3b4 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:30.978178 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 940/1877] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:56:30 2022] POST /identity/v3/projects => generated 375 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:30.979501 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f68e41-0336-441e-92fe-9aa2c0bd266d admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:31.007065 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f68e41-0336-441e-92fe-9aa2c0bd266d admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:31.111808 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b779d5-a38c-4080-8d2c-a0e1a7e44281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:31.112503 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b779d5-a38c-4080-8d2c-a0e1a7e44281 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:31.112790 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b779d5-a38c-4080-8d2c-a0e1a7e44281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:31.113085 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b779d5-a38c-4080-8d2c-a0e1a7e44281 admin admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:31.113900 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b779d5-a38c-4080-8d2c-a0e1a7e44281 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:31.116054 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b779d5-a38c-4080-8d2c-a0e1a7e44281 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:31.147678 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 938/1878] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:56:30 2022] POST /identity/v3/users => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 17:56:31.153487 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6046f74-c393-4260-a38f-30bc7705f3b4 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:31.171089 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6046f74-c393-4260-a38f-30bc7705f3b4 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:31.177205 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7934306-57bd-4aac-a31b-832eb577f02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:31.178154 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7934306-57bd-4aac-a31b-832eb577f02c admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:31.178348 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7934306-57bd-4aac-a31b-832eb577f02c admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:31.178694 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7934306-57bd-4aac-a31b-832eb577f02c admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:31.180366 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7934306-57bd-4aac-a31b-832eb577f02c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:31.183260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7934306-57bd-4aac-a31b-832eb577f02c admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:31.202015 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b779d5-a38c-4080-8d2c-a0e1a7e44281 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:31.208811 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 941/1879] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:56:31.227265 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b779d5-a38c-4080-8d2c-a0e1a7e44281 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:31.234253 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8a788-181b-430c-a99f-8c53a7074fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:31.235248 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8a788-181b-430c-a99f-8c53a7074fbe admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:31.235535 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8a788-181b-430c-a99f-8c53a7074fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:31.235955 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8a788-181b-430c-a99f-8c53a7074fbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:31.236850 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d8a788-181b-430c-a99f-8c53a7074fbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:31.238596 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d8a788-181b-430c-a99f-8c53a7074fbe admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:31.259676 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 939/1880] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:56:31.265961 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7934306-57bd-4aac-a31b-832eb577f02c admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:31.304745 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7934306-57bd-4aac-a31b-832eb577f02c admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:31.319089 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e948b-07ef-4982-af58-0bdd143330a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:31.321877 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e948b-07ef-4982-af58-0bdd143330a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:31.322235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e948b-07ef-4982-af58-0bdd143330a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:31.322575 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e948b-07ef-4982-af58-0bdd143330a4 admin admin] PATH_INFO: `/v3/projects/b0d91ad8b7e6430ba31fb7e934076890/users/e0da7aac1606491e8a3989b67d98b0b6/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:31.344979 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e948b-07ef-4982-af58-0bdd143330a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0d91ad8b7e6430ba31fb7e934076890, user_id=e0da7aac1606491e8a3989b67d98b0b6, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:31.346819 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8a788-181b-430c-a99f-8c53a7074fbe admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:31.348843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e948b-07ef-4982-af58-0bdd143330a4 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:31.349641 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-96d8a788-181b-430c-a99f-8c53a7074fbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:31.372471 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8a788-181b-430c-a99f-8c53a7074fbe admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:31.379655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 942/1881] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:56:31 2022] PUT /identity/v3/projects/b0d91ad8b7e6430ba31fb7e934076890/users/e0da7aac1606491e8a3989b67d98b0b6/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:31.391706 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3f1ac-268e-499d-9416-89fdbfac90a0 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:31.391905 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3f1ac-268e-499d-9416-89fdbfac90a0 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:31.393912 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3f1ac-268e-499d-9416-89fdbfac90a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:31.459715 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-a9f3f1ac-268e-499d-9416-89fdbfac90a0 None None] MFA Rules not processed for user `e0da7aac1606491e8a3989b67d98b0b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:31.461310 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-a9f3f1ac-268e-499d-9416-89fdbfac90a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:31.476117 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:31.518982 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88343450-4b14-4156-95b7-97c98451b7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:31.521050 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88343450-4b14-4156-95b7-97c98451b7b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:31.524000 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88343450-4b14-4156-95b7-97c98451b7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:31.524887 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88343450-4b14-4156-95b7-97c98451b7b9 admin admin] PATH_INFO: `/v3/users/7bdff92cd20445a4ae0d095db83d5345` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:31.532472 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88343450-4b14-4156-95b7-97c98451b7b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bdff92cd20445a4ae0d095db83d5345)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:31.538188 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88343450-4b14-4156-95b7-97c98451b7b9 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:31.542412 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:31.628952 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-88343450-4b14-4156-95b7-97c98451b7b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bdff92cd20445a4ae0d095db83d5345'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:31.641536 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-88343450-4b14-4156-95b7-97c98451b7b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bdff92cd20445a4ae0d095db83d5345'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:31.643358 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 943/1882] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:31.643775 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-88343450-4b14-4156-95b7-97c98451b7b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bdff92cd20445a4ae0d095db83d5345'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:31.644486 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-88343450-4b14-4156-95b7-97c98451b7b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bdff92cd20445a4ae0d095db83d5345'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:31.653579 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-88343450-4b14-4156-95b7-97c98451b7b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bdff92cd20445a4ae0d095db83d5345'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:31.655108 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3f1ac-268e-499d-9416-89fdbfac90a0 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:31.656822 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-a9f3f1ac-268e-499d-9416-89fdbfac90a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:31.684998 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 940/1883] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:56:31 2022] DELETE /identity/v3/users/7bdff92cd20445a4ae0d095db83d5345 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:56:31.688542 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6764f38-803f-44cb-b9bd-b84b771287ba None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:31.688835 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6764f38-803f-44cb-b9bd-b84b771287ba None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:31.689693 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6764f38-803f-44cb-b9bd-b84b771287ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:31.728124 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-a6764f38-803f-44cb-b9bd-b84b771287ba None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:31.730251 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-a6764f38-803f-44cb-b9bd-b84b771287ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:31.828013 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 941/1884] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:56:31.833821 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3f1ac-268e-499d-9416-89fdbfac90a0 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:31.859805 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6764f38-803f-44cb-b9bd-b84b771287ba None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:31.861746 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-a6764f38-803f-44cb-b9bd-b84b771287ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:31.946100 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bcf61d-13d7-4103-9d39-6874ed3b6b1f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab3b7ac09599477bb0c6c1d32e2d5dbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:31.947042 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcf61d-13d7-4103-9d39-6874ed3b6b1f service glance] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:31.947498 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcf61d-13d7-4103-9d39-6874ed3b6b1f service glance] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:31.947970 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcf61d-13d7-4103-9d39-6874ed3b6b1f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:31.951615 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-04bcf61d-13d7-4103-9d39-6874ed3b6b1f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:32.051267 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bcf61d-13d7-4103-9d39-6874ed3b6b1f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:32.053051 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bcf61d-13d7-4103-9d39-6874ed3b6b1f service glance] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:32.058255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6764f38-803f-44cb-b9bd-b84b771287ba None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:32.071286 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb336d-d999-45d2-8850-a3d7e1eb56d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:32.072262 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb336d-d999-45d2-8850-a3d7e1eb56d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:32.073046 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb336d-d999-45d2-8850-a3d7e1eb56d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:32.073291 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb336d-d999-45d2-8850-a3d7e1eb56d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:32.089152 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 944/1885] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:32.094817 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb336d-d999-45d2-8850-a3d7e1eb56d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:32.098524 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb336d-d999-45d2-8850-a3d7e1eb56d0 service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:32.116710 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:32.129471 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 942/1886] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 17:56:33.736644 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bcf61d-13d7-4103-9d39-6874ed3b6b1f service glance] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:33.738559 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-04bcf61d-13d7-4103-9d39-6874ed3b6b1f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:33.834028 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:33.877266 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb336d-d999-45d2-8850-a3d7e1eb56d0 service neutron] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:33.880974 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-1abb336d-d999-45d2-8850-a3d7e1eb56d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:33.902164 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bcf61d-13d7-4103-9d39-6874ed3b6b1f service glance] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:33.914628 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb336d-d999-45d2-8850-a3d7e1eb56d0 service neutron] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:33.924490 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb1d29-5246-40cc-9745-2fc2f5e205f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:33.925485 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb1d29-5246-40cc-9745-2fc2f5e205f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:33.925617 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb1d29-5246-40cc-9745-2fc2f5e205f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:33.926995 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe0911-2f50-4259-b529-5c16d7e83b7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:33.927629 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe0911-2f50-4259-b529-5c16d7e83b7e service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:33.927802 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb1d29-5246-40cc-9745-2fc2f5e205f5 admin admin] PATH_INFO: `/v3/projects/61b5cd302b004202aabc2aca40a17f09` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:33.927906 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe0911-2f50-4259-b529-5c16d7e83b7e service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:33.928159 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe0911-2f50-4259-b529-5c16d7e83b7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:33.929604 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb1d29-5246-40cc-9745-2fc2f5e205f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61b5cd302b004202aabc2aca40a17f09)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:33.936907 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb1d29-5246-40cc-9745-2fc2f5e205f5 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:33.944537 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-2efe0911-2f50-4259-b529-5c16d7e83b7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:34.078192 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-73cb1d29-5246-40cc-9745-2fc2f5e205f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61b5cd302b004202aabc2aca40a17f09', 'request_id': 'req-73cb1d29-5246-40cc-9745-2fc2f5e205f5'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:34.093590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-73cb1d29-5246-40cc-9745-2fc2f5e205f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61b5cd302b004202aabc2aca40a17f09', 'request_id': 'req-73cb1d29-5246-40cc-9745-2fc2f5e205f5'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:34.108938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe0911-2f50-4259-b529-5c16d7e83b7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:34.109759 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe0911-2f50-4259-b529-5c16d7e83b7e service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:34.109904 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-73cb1d29-5246-40cc-9745-2fc2f5e205f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61b5cd302b004202aabc2aca40a17f09', 'request_id': 'req-73cb1d29-5246-40cc-9745-2fc2f5e205f5'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:34.135187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-73cb1d29-5246-40cc-9745-2fc2f5e205f5 admin admin] The token cache is being invalidate because project 61b5cd302b004202aabc2aca40a17f09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:56:34.135542 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-73cb1d29-5246-40cc-9745-2fc2f5e205f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:34.137663 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-73cb1d29-5246-40cc-9745-2fc2f5e205f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:34.139477 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 943/1887] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:56:33 2022] DELETE /identity/v3/projects/61b5cd302b004202aabc2aca40a17f09 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:34.143447 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb1d29-5246-40cc-9745-2fc2f5e205f5 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:34.144794 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-73cb1d29-5246-40cc-9745-2fc2f5e205f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:34.170965 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 945/1888] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:34.243431 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb1d29-5246-40cc-9745-2fc2f5e205f5 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:34.252587 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ca801-aecf-47d5-aa39-574bf50720e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:34.253315 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ca801-aecf-47d5-aa39-574bf50720e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:34.253643 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ca801-aecf-47d5-aa39-574bf50720e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:34.253993 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ca801-aecf-47d5-aa39-574bf50720e6 admin admin] PATH_INFO: `/v3/users/981591d9162d47038986df4801f8419b` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:34.255184 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ca801-aecf-47d5-aa39-574bf50720e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=981591d9162d47038986df4801f8419b)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:34.258216 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ca801-aecf-47d5-aa39-574bf50720e6 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:34.334498 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-566ca801-aecf-47d5-aa39-574bf50720e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '981591d9162d47038986df4801f8419b'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:34.341813 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-566ca801-aecf-47d5-aa39-574bf50720e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '981591d9162d47038986df4801f8419b'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:34.342592 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-566ca801-aecf-47d5-aa39-574bf50720e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '981591d9162d47038986df4801f8419b'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:34.343286 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-566ca801-aecf-47d5-aa39-574bf50720e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '981591d9162d47038986df4801f8419b'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:34.354728 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-566ca801-aecf-47d5-aa39-574bf50720e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '981591d9162d47038986df4801f8419b'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:34.376407 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 944/1889] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:56:34 2022] DELETE /identity/v3/users/981591d9162d47038986df4801f8419b => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:34.795613 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe0911-2f50-4259-b529-5c16d7e83b7e service cinder] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:34.807557 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe0911-2f50-4259-b529-5c16d7e83b7e service cinder] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:34.889656 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ffd1f1-44b1-49ed-9256-292a865d9b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:34.890583 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffd1f1-44b1-49ed-9256-292a865d9b6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:34.890980 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffd1f1-44b1-49ed-9256-292a865d9b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:34.891280 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffd1f1-44b1-49ed-9256-292a865d9b6f admin admin] PATH_INFO: `/v3/projects/e1acfd04892644fab3e1f6accd451eb1` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:34.892581 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ffd1f1-44b1-49ed-9256-292a865d9b6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1acfd04892644fab3e1f6accd451eb1)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:34.894947 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ffd1f1-44b1-49ed-9256-292a865d9b6f admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:34.963663 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-52ffd1f1-44b1-49ed-9256-292a865d9b6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1acfd04892644fab3e1f6accd451eb1', 'request_id': 'req-52ffd1f1-44b1-49ed-9256-292a865d9b6f'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:34.963663 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-52ffd1f1-44b1-49ed-9256-292a865d9b6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1acfd04892644fab3e1f6accd451eb1', 'request_id': 'req-52ffd1f1-44b1-49ed-9256-292a865d9b6f'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:34.971441 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-52ffd1f1-44b1-49ed-9256-292a865d9b6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1acfd04892644fab3e1f6accd451eb1', 'request_id': 'req-52ffd1f1-44b1-49ed-9256-292a865d9b6f'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:34.988504 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-52ffd1f1-44b1-49ed-9256-292a865d9b6f admin admin] The token cache is being invalidate because project e1acfd04892644fab3e1f6accd451eb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:56:34.988752 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-52ffd1f1-44b1-49ed-9256-292a865d9b6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:34.989470 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-52ffd1f1-44b1-49ed-9256-292a865d9b6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:34.991535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 946/1890] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:56:34 2022] DELETE /identity/v3/projects/e1acfd04892644fab3e1f6accd451eb1 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:34.996300 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ca801-aecf-47d5-aa39-574bf50720e6 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:34.997342 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-566ca801-aecf-47d5-aa39-574bf50720e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:35.006707 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:35.013459 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ca801-aecf-47d5-aa39-574bf50720e6 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:35.081273 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aee61f-d641-47b7-b663-97549683bd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:35.081927 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aee61f-d641-47b7-b663-97549683bd78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:35.082395 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aee61f-d641-47b7-b663-97549683bd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:35.082542 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aee61f-d641-47b7-b663-97549683bd78 admin admin] PATH_INFO: `/v3/users/0cc6df3017ec4346b8358ec75073645b` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:35.083791 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aee61f-d641-47b7-b663-97549683bd78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cc6df3017ec4346b8358ec75073645b)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:35.086280 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aee61f-d641-47b7-b663-97549683bd78 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:35.140617 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-c4aee61f-d641-47b7-b663-97549683bd78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cc6df3017ec4346b8358ec75073645b'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:35.150669 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-c4aee61f-d641-47b7-b663-97549683bd78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cc6df3017ec4346b8358ec75073645b'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:35.151486 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-c4aee61f-d641-47b7-b663-97549683bd78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cc6df3017ec4346b8358ec75073645b'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:35.152966 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-c4aee61f-d641-47b7-b663-97549683bd78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cc6df3017ec4346b8358ec75073645b'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:35.169762 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-c4aee61f-d641-47b7-b663-97549683bd78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cc6df3017ec4346b8358ec75073645b'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:35.194739 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 945/1891] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:56:34 2022] DELETE /identity/v3/users/0cc6df3017ec4346b8358ec75073645b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:35.216411 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22370b23-f828-43a5-a4d0-907504186c64 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:35.217058 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22370b23-f828-43a5-a4d0-907504186c64 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:35.217408 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22370b23-f828-43a5-a4d0-907504186c64 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:35.219181 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 947/1892] 10.222.0.62 () {54 vars in 921 bytes} [Mon Sep 26 17:56:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:56:35.226434 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5ab4c-1094-463c-9957-37b28e925380 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:35.226731 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5ab4c-1094-463c-9957-37b28e925380 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:35.226997 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5ab4c-1094-463c-9957-37b28e925380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:35.267055 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-41e5ab4c-1094-463c-9957-37b28e925380 None None] MFA Rules not processed for user `1792e79b9c9a47e1923f19bfd2cd495b`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:35.268491 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-41e5ab4c-1094-463c-9957-37b28e925380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:35.354930 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 946/1893] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Sep 26 17:56:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:35.368449 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22370b23-f828-43a5-a4d0-907504186c64 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:35.370207 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-22370b23-f828-43a5-a4d0-907504186c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:35.390285 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22370b23-f828-43a5-a4d0-907504186c64 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:35.402537 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f983f-da69-4c8c-b548-8b7dc09c6b82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:35.402995 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f983f-da69-4c8c-b548-8b7dc09c6b82 service nova] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:35.403278 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f983f-da69-4c8c-b548-8b7dc09c6b82 service nova] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:35.403556 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f983f-da69-4c8c-b548-8b7dc09c6b82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:35.413877 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:35.420520 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f983f-da69-4c8c-b548-8b7dc09c6b82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:35.423004 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f983f-da69-4c8c-b548-8b7dc09c6b82 service nova] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:35.435381 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 948/1894] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:35.610464 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e5ab4c-1094-463c-9957-37b28e925380 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:35.612008 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-41e5ab4c-1094-463c-9957-37b28e925380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:35.636551 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:35.703940 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e5ab4c-1094-463c-9957-37b28e925380 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:35.715362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1574e9-89af-4beb-bc5e-c8cdb05a91c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:35.716392 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1574e9-89af-4beb-bc5e-c8cdb05a91c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:35.717279 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1574e9-89af-4beb-bc5e-c8cdb05a91c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:35.717452 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1574e9-89af-4beb-bc5e-c8cdb05a91c4 admin admin] PATH_INFO: `/v3/projects/1c8f8630a574492bab02ff595570badd` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:35.718835 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1574e9-89af-4beb-bc5e-c8cdb05a91c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c8f8630a574492bab02ff595570badd)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:35.720859 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1574e9-89af-4beb-bc5e-c8cdb05a91c4 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:35.782173 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-ff1574e9-89af-4beb-bc5e-c8cdb05a91c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c8f8630a574492bab02ff595570badd', 'request_id': 'req-ff1574e9-89af-4beb-bc5e-c8cdb05a91c4'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:35.790709 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-ff1574e9-89af-4beb-bc5e-c8cdb05a91c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c8f8630a574492bab02ff595570badd', 'request_id': 'req-ff1574e9-89af-4beb-bc5e-c8cdb05a91c4'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:35.802416 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-ff1574e9-89af-4beb-bc5e-c8cdb05a91c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c8f8630a574492bab02ff595570badd', 'request_id': 'req-ff1574e9-89af-4beb-bc5e-c8cdb05a91c4'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:35.821282 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-ff1574e9-89af-4beb-bc5e-c8cdb05a91c4 admin admin] The token cache is being invalidate because project 1c8f8630a574492bab02ff595570badd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:56:35.821674 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-ff1574e9-89af-4beb-bc5e-c8cdb05a91c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:35.822413 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-ff1574e9-89af-4beb-bc5e-c8cdb05a91c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:35.824005 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 947/1895] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:56:35 2022] DELETE /identity/v3/projects/1c8f8630a574492bab02ff595570badd => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:35.831167 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02510ca-288a-4a1d-9ab6-f9d5d11f04fc None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:35.832256 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02510ca-288a-4a1d-9ab6-f9d5d11f04fc None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:35.832574 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02510ca-288a-4a1d-9ab6-f9d5d11f04fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:35.873697 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-e02510ca-288a-4a1d-9ab6-f9d5d11f04fc None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:35.875560 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-e02510ca-288a-4a1d-9ab6-f9d5d11f04fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:35.941159 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 949/1896] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:35.950014 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ad017-7287-4005-a6bb-2ca049644a7e None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:35.950312 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ad017-7287-4005-a6bb-2ca049644a7e None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:35.950666 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ad017-7287-4005-a6bb-2ca049644a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:35.971367 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-8a2ad017-7287-4005-a6bb-2ca049644a7e None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:35.972651 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-8a2ad017-7287-4005-a6bb-2ca049644a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:35.982443 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 948/1897] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:35.986611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02510ca-288a-4a1d-9ab6-f9d5d11f04fc None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:35.997160 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02510ca-288a-4a1d-9ab6-f9d5d11f04fc None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:36.001788 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09712b56-4524-4298-b736-09bb6cff9163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:36.002391 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09712b56-4524-4298-b736-09bb6cff9163 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:36.002669 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09712b56-4524-4298-b736-09bb6cff9163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:36.002940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09712b56-4524-4298-b736-09bb6cff9163 admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:36.003694 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09712b56-4524-4298-b736-09bb6cff9163 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:56:36.004051 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09712b56-4524-4298-b736-09bb6cff9163 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:36.005942 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09712b56-4524-4298-b736-09bb6cff9163 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:36.021046 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 950/1898] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:56:36.022601 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ad017-7287-4005-a6bb-2ca049644a7e None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:36.035844 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ad017-7287-4005-a6bb-2ca049644a7e None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:36.040736 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4c802-8171-4114-a810-32c8157fc343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:36.041383 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4c802-8171-4114-a810-32c8157fc343 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:36.041785 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4c802-8171-4114-a810-32c8157fc343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:36.042071 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4c802-8171-4114-a810-32c8157fc343 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:36.042887 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4c802-8171-4114-a810-32c8157fc343 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:36.044787 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4c802-8171-4114-a810-32c8157fc343 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:36.076196 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 949/1899] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:56:36 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 17:56:36.080558 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09712b56-4524-4298-b736-09bb6cff9163 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:36.091976 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09712b56-4524-4298-b736-09bb6cff9163 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:36.164322 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd7174-4ff9-4303-afa2-53c9bb3d18fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:36.165119 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd7174-4ff9-4303-afa2-53c9bb3d18fa admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:36.165492 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd7174-4ff9-4303-afa2-53c9bb3d18fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:36.165761 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd7174-4ff9-4303-afa2-53c9bb3d18fa admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:36.166544 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd7174-4ff9-4303-afa2-53c9bb3d18fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:36.169146 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd7174-4ff9-4303-afa2-53c9bb3d18fa admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:36.193744 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 951/1900] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:56:36 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:36.197747 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4c802-8171-4114-a810-32c8157fc343 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:36.209028 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4c802-8171-4114-a810-32c8157fc343 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:36.214057 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cd305-b299-4d32-afb6-0ea59743b1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:36.215284 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cd305-b299-4d32-afb6-0ea59743b1ff admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:36.215641 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cd305-b299-4d32-afb6-0ea59743b1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:36.215962 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cd305-b299-4d32-afb6-0ea59743b1ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:36.216662 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cd305-b299-4d32-afb6-0ea59743b1ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:36.218348 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cd305-b299-4d32-afb6-0ea59743b1ff admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:36.228931 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 950/1901] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 17:56:36.233675 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd7174-4ff9-4303-afa2-53c9bb3d18fa admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:36.243629 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd7174-4ff9-4303-afa2-53c9bb3d18fa admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:36.248225 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b0069-f7ee-4945-9cd6-288175837313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:36.248821 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b0069-f7ee-4945-9cd6-288175837313 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:36.249131 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b0069-f7ee-4945-9cd6-288175837313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:36.249401 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b0069-f7ee-4945-9cd6-288175837313 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:36.250037 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b0069-f7ee-4945-9cd6-288175837313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:36.252022 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b0069-f7ee-4945-9cd6-288175837313 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:36.270833 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 952/1902] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:56:36.275404 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cd305-b299-4d32-afb6-0ea59743b1ff admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:36.296498 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cd305-b299-4d32-afb6-0ea59743b1ff admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:36.301898 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae33e0-72f4-434d-983e-5ee22673e5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:36.302768 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae33e0-72f4-434d-983e-5ee22673e5b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:36.302887 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae33e0-72f4-434d-983e-5ee22673e5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:36.303102 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae33e0-72f4-434d-983e-5ee22673e5b2 admin admin] PATH_INFO: `/v3/projects/045ef5783f7d4523a3acd46af190ee2c/users/032113f1baea4711adc39ce0cb568423/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:36.332458 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae33e0-72f4-434d-983e-5ee22673e5b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=045ef5783f7d4523a3acd46af190ee2c, user_id=032113f1baea4711adc39ce0cb568423, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:36.335100 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae33e0-72f4-434d-983e-5ee22673e5b2 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:36.355155 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 951/1903] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:56:36 2022] PUT /identity/v3/projects/045ef5783f7d4523a3acd46af190ee2c/users/032113f1baea4711adc39ce0cb568423/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:56:36.366648 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf26c4f-cc04-449c-8f9b-f25746355afb None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:36.367059 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf26c4f-cc04-449c-8f9b-f25746355afb None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:36.367341 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf26c4f-cc04-449c-8f9b-f25746355afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:36.407076 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-daf26c4f-cc04-449c-8f9b-f25746355afb None None] MFA Rules not processed for user `032113f1baea4711adc39ce0cb568423`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:36.408724 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-daf26c4f-cc04-449c-8f9b-f25746355afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:36.468882 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:36.494647 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 953/1904] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:36.499452 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae33e0-72f4-434d-983e-5ee22673e5b2 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:36.550206 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:36.574725 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae33e0-72f4-434d-983e-5ee22673e5b2 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:36.579419 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f8891-c894-47f3-b1c9-8e8c16b3a842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:36.580027 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f8891-c894-47f3-b1c9-8e8c16b3a842 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:36.580307 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f8891-c894-47f3-b1c9-8e8c16b3a842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:36.580577 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f8891-c894-47f3-b1c9-8e8c16b3a842 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:36.581251 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289f8891-c894-47f3-b1c9-8e8c16b3a842 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:36.583292 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289f8891-c894-47f3-b1c9-8e8c16b3a842 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:36.617235 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 952/1905] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:56:36 2022] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:36.621713 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf26c4f-cc04-449c-8f9b-f25746355afb None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:36.633203 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf26c4f-cc04-449c-8f9b-f25746355afb None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:36.699930 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397ea73-b958-4fe6-8fa8-9b694e9c88b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:36.700545 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397ea73-b958-4fe6-8fa8-9b694e9c88b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:36.700826 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397ea73-b958-4fe6-8fa8-9b694e9c88b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:36.701137 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397ea73-b958-4fe6-8fa8-9b694e9c88b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:36.701777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2397ea73-b958-4fe6-8fa8-9b694e9c88b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:36.703699 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2397ea73-b958-4fe6-8fa8-9b694e9c88b6 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:36.727621 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 954/1906] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:56:36 2022] POST /identity/v3/users => generated 297 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:36.732257 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f8891-c894-47f3-b1c9-8e8c16b3a842 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:36.743923 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f8891-c894-47f3-b1c9-8e8c16b3a842 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:36.748968 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c979d32-53e3-4ed4-8602-a75f560f87b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:36.750113 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c979d32-53e3-4ed4-8602-a75f560f87b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:36.750113 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c979d32-53e3-4ed4-8602-a75f560f87b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:36.750351 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c979d32-53e3-4ed4-8602-a75f560f87b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:36.751194 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c979d32-53e3-4ed4-8602-a75f560f87b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:36.753600 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c979d32-53e3-4ed4-8602-a75f560f87b1 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:36.764781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 953/1907] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:56:36.769785 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397ea73-b958-4fe6-8fa8-9b694e9c88b6 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:36.781191 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397ea73-b958-4fe6-8fa8-9b694e9c88b6 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:36.786475 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d5a10-380b-47fa-84ed-080f8950bd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:36.787161 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d5a10-380b-47fa-84ed-080f8950bd9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:36.787442 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d5a10-380b-47fa-84ed-080f8950bd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:36.787715 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d5a10-380b-47fa-84ed-080f8950bd9c admin admin] PATH_INFO: `/v3/projects/e5a70c9aaa1c4504830937360cce4e3c/users/7a2939415ece40d6b9b1712e6f1b6358/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:36.804174 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d5a10-380b-47fa-84ed-080f8950bd9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5a70c9aaa1c4504830937360cce4e3c, user_id=7a2939415ece40d6b9b1712e6f1b6358, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:36.806894 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d5a10-380b-47fa-84ed-080f8950bd9c admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:36.821658 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 955/1908] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:56:36 2022] PUT /identity/v3/projects/e5a70c9aaa1c4504830937360cce4e3c/users/7a2939415ece40d6b9b1712e6f1b6358/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:56:36.825511 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c979d32-53e3-4ed4-8602-a75f560f87b1 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:36.839004 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c979d32-53e3-4ed4-8602-a75f560f87b1 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:36.928825 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a122a5c0-2023-4175-8db4-72e9cfb9431e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:36.929496 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122a5c0-2023-4175-8db4-72e9cfb9431e admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:36.929775 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122a5c0-2023-4175-8db4-72e9cfb9431e admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:36.930044 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122a5c0-2023-4175-8db4-72e9cfb9431e admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:36.930991 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a122a5c0-2023-4175-8db4-72e9cfb9431e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:36.932796 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a122a5c0-2023-4175-8db4-72e9cfb9431e admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:36.953574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 954/1909] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:56:36.958083 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d5a10-380b-47fa-84ed-080f8950bd9c admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:36.979700 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d5a10-380b-47fa-84ed-080f8950bd9c admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:36.993862 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2e05e-fc59-445c-ab87-a7af65eca88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:36.994570 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2e05e-fc59-445c-ab87-a7af65eca88e admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:36.994854 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2e05e-fc59-445c-ab87-a7af65eca88e admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:36.995126 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2e05e-fc59-445c-ab87-a7af65eca88e admin admin] PATH_INFO: `/v3/projects/e5a70c9aaa1c4504830937360cce4e3c/users/7a2939415ece40d6b9b1712e6f1b6358/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:36.997884 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2e05e-fc59-445c-ab87-a7af65eca88e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5a70c9aaa1c4504830937360cce4e3c, user_id=7a2939415ece40d6b9b1712e6f1b6358, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:37.000599 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2e05e-fc59-445c-ab87-a7af65eca88e admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:37.029142 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 956/1910] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:56:36 2022] PUT /identity/v3/projects/e5a70c9aaa1c4504830937360cce4e3c/users/7a2939415ece40d6b9b1712e6f1b6358/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:37.037146 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5feeb0-0dad-4b92-8966-ef03e35b08c4 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:37.037621 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5feeb0-0dad-4b92-8966-ef03e35b08c4 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:37.037943 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5feeb0-0dad-4b92-8966-ef03e35b08c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:37.072752 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-1b5feeb0-0dad-4b92-8966-ef03e35b08c4 None None] MFA Rules not processed for user `7a2939415ece40d6b9b1712e6f1b6358`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:37.074791 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-1b5feeb0-0dad-4b92-8966-ef03e35b08c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:37.197089 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 955/1911] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:37 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:37.210793 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2e05e-fc59-445c-ab87-a7af65eca88e admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:37.212564 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-44e2e05e-fc59-445c-ab87-a7af65eca88e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:37.315144 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2e05e-fc59-445c-ab87-a7af65eca88e admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:37.329352 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b04e4-8d41-480a-9888-7ae8a976c251 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:37.332382 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b04e4-8d41-480a-9888-7ae8a976c251 service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:37.332823 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b04e4-8d41-480a-9888-7ae8a976c251 service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:37.333284 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b04e4-8d41-480a-9888-7ae8a976c251 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:37.359461 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b04e4-8d41-480a-9888-7ae8a976c251 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:37.360889 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b04e4-8d41-480a-9888-7ae8a976c251 service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:37.397491 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 957/1912] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:37 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:37.508599 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5feeb0-0dad-4b92-8966-ef03e35b08c4 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:37.510331 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-1b5feeb0-0dad-4b92-8966-ef03e35b08c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:37.525062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5feeb0-0dad-4b92-8966-ef03e35b08c4 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:37.529570 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9fe7b-42ab-4347-beaf-f91a6cfa100e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:37.530177 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9fe7b-42ab-4347-beaf-f91a6cfa100e service cinder] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:37.530453 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9fe7b-42ab-4347-beaf-f91a6cfa100e service cinder] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:37.530780 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9fe7b-42ab-4347-beaf-f91a6cfa100e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:37.569261 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:37.596085 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9fe7b-42ab-4347-beaf-f91a6cfa100e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:37.597730 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9fe7b-42ab-4347-beaf-f91a6cfa100e service cinder] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:37.607948 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 956/1913] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:40.258922 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b04e4-8d41-480a-9888-7ae8a976c251 service cinder] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:40.313427 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:40.331069 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b04e4-8d41-480a-9888-7ae8a976c251 service cinder] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:40.335896 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89898ae7-a87b-4d23-b197-5a76d6846e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:40.336561 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89898ae7-a87b-4d23-b197-5a76d6846e41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:40.336838 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89898ae7-a87b-4d23-b197-5a76d6846e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:40.337149 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89898ae7-a87b-4d23-b197-5a76d6846e41 admin admin] PATH_INFO: `/v3/users/032113f1baea4711adc39ce0cb568423` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:40.338368 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89898ae7-a87b-4d23-b197-5a76d6846e41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=032113f1baea4711adc39ce0cb568423)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:40.340355 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89898ae7-a87b-4d23-b197-5a76d6846e41 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:40.394848 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-89898ae7-a87b-4d23-b197-5a76d6846e41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '032113f1baea4711adc39ce0cb568423'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:40.395508 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-89898ae7-a87b-4d23-b197-5a76d6846e41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '032113f1baea4711adc39ce0cb568423'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:40.396117 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-89898ae7-a87b-4d23-b197-5a76d6846e41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '032113f1baea4711adc39ce0cb568423'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:40.404306 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-89898ae7-a87b-4d23-b197-5a76d6846e41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '032113f1baea4711adc39ce0cb568423'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:40.411809 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-89898ae7-a87b-4d23-b197-5a76d6846e41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '032113f1baea4711adc39ce0cb568423'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:40.434401 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 958/1914] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:56:40 2022] DELETE /identity/v3/users/032113f1baea4711adc39ce0cb568423 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:40.439079 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df27f3a-39f1-4917-9cd1-19fd798236e8 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:40.439533 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df27f3a-39f1-4917-9cd1-19fd798236e8 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:40.439664 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df27f3a-39f1-4917-9cd1-19fd798236e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:40.463466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-6df27f3a-39f1-4917-9cd1-19fd798236e8 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:40.464801 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-6df27f3a-39f1-4917-9cd1-19fd798236e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:40.525619 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 957/1915] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:40.535956 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89898ae7-a87b-4d23-b197-5a76d6846e41 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:40.537487 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-89898ae7-a87b-4d23-b197-5a76d6846e41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:40.604210 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89898ae7-a87b-4d23-b197-5a76d6846e41 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:40.608031 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8fdd4-0bf3-4933-97ef-e3c26540c0db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:40.608647 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8fdd4-0bf3-4933-97ef-e3c26540c0db service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:40.608921 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8fdd4-0bf3-4933-97ef-e3c26540c0db service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:40.609221 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8fdd4-0bf3-4933-97ef-e3c26540c0db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:40.618919 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d8fdd4-0bf3-4933-97ef-e3c26540c0db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:40.620982 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d8fdd4-0bf3-4933-97ef-e3c26540c0db service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:40.632583 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 959/1916] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:41.099438 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df27f3a-39f1-4917-9cd1-19fd798236e8 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:41.100837 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-6df27f3a-39f1-4917-9cd1-19fd798236e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:41.114043 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df27f3a-39f1-4917-9cd1-19fd798236e8 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:41.119257 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cececfa9-7f0a-4527-a5ce-0218e145d972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:41.120005 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cececfa9-7f0a-4527-a5ce-0218e145d972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:41.120328 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cececfa9-7f0a-4527-a5ce-0218e145d972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:41.121391 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cececfa9-7f0a-4527-a5ce-0218e145d972 admin admin] PATH_INFO: `/v3/projects/045ef5783f7d4523a3acd46af190ee2c` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:41.122444 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cececfa9-7f0a-4527-a5ce-0218e145d972 admin admin] RBAC: Authorizing `identity:delete_project(project_id=045ef5783f7d4523a3acd46af190ee2c)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:41.124467 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cececfa9-7f0a-4527-a5ce-0218e145d972 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:41.186261 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-cececfa9-7f0a-4527-a5ce-0218e145d972 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '045ef5783f7d4523a3acd46af190ee2c', 'request_id': 'req-cececfa9-7f0a-4527-a5ce-0218e145d972'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:41.193807 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-cececfa9-7f0a-4527-a5ce-0218e145d972 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '045ef5783f7d4523a3acd46af190ee2c', 'request_id': 'req-cececfa9-7f0a-4527-a5ce-0218e145d972'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:41.213844 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-cececfa9-7f0a-4527-a5ce-0218e145d972 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '045ef5783f7d4523a3acd46af190ee2c', 'request_id': 'req-cececfa9-7f0a-4527-a5ce-0218e145d972'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:41.230921 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-cececfa9-7f0a-4527-a5ce-0218e145d972 admin admin] The token cache is being invalidate because project 045ef5783f7d4523a3acd46af190ee2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:56:41.231279 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-cececfa9-7f0a-4527-a5ce-0218e145d972 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:41.231999 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-cececfa9-7f0a-4527-a5ce-0218e145d972 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:41.233599 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 958/1917] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:56:41 2022] DELETE /identity/v3/projects/045ef5783f7d4523a3acd46af190ee2c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:41.237793 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8fdd4-0bf3-4933-97ef-e3c26540c0db service neutron] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:41.247872 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8fdd4-0bf3-4933-97ef-e3c26540c0db service neutron] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:41.318353 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a286d1-dd38-4f45-aa6f-8207e765f188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:41.319815 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a286d1-dd38-4f45-aa6f-8207e765f188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:41.320104 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a286d1-dd38-4f45-aa6f-8207e765f188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:41.320467 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a286d1-dd38-4f45-aa6f-8207e765f188 admin admin] PATH_INFO: `/v3/users/7a2939415ece40d6b9b1712e6f1b6358` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:41.323263 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a286d1-dd38-4f45-aa6f-8207e765f188 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a2939415ece40d6b9b1712e6f1b6358)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:41.324734 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a286d1-dd38-4f45-aa6f-8207e765f188 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:41.332213 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:41.391329 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-36a286d1-dd38-4f45-aa6f-8207e765f188 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a2939415ece40d6b9b1712e6f1b6358'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:41.392008 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-36a286d1-dd38-4f45-aa6f-8207e765f188 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a2939415ece40d6b9b1712e6f1b6358'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:41.392623 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-36a286d1-dd38-4f45-aa6f-8207e765f188 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a2939415ece40d6b9b1712e6f1b6358'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:41.403229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-36a286d1-dd38-4f45-aa6f-8207e765f188 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a2939415ece40d6b9b1712e6f1b6358'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:41.413463 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-36a286d1-dd38-4f45-aa6f-8207e765f188 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a2939415ece40d6b9b1712e6f1b6358'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:41.446449 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 960/1918] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:56:41 2022] DELETE /identity/v3/users/7a2939415ece40d6b9b1712e6f1b6358 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:41.755826 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cececfa9-7f0a-4527-a5ce-0218e145d972 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:41.757555 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-cececfa9-7f0a-4527-a5ce-0218e145d972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:41.771167 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cececfa9-7f0a-4527-a5ce-0218e145d972 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:41.827262 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:41.836085 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1bd246-2e9d-499c-a0fc-1da86cdae1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:41.836806 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bd246-2e9d-499c-a0fc-1da86cdae1db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:41.837161 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bd246-2e9d-499c-a0fc-1da86cdae1db admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:41.837475 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bd246-2e9d-499c-a0fc-1da86cdae1db admin admin] PATH_INFO: `/v3/projects/e5a70c9aaa1c4504830937360cce4e3c` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:41.839730 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1bd246-2e9d-499c-a0fc-1da86cdae1db admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5a70c9aaa1c4504830937360cce4e3c)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:41.841977 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1bd246-2e9d-499c-a0fc-1da86cdae1db admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:41.919021 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-7e1bd246-2e9d-499c-a0fc-1da86cdae1db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5a70c9aaa1c4504830937360cce4e3c', 'request_id': 'req-7e1bd246-2e9d-499c-a0fc-1da86cdae1db'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:41.928324 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-7e1bd246-2e9d-499c-a0fc-1da86cdae1db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5a70c9aaa1c4504830937360cce4e3c', 'request_id': 'req-7e1bd246-2e9d-499c-a0fc-1da86cdae1db'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:41.940128 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-7e1bd246-2e9d-499c-a0fc-1da86cdae1db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5a70c9aaa1c4504830937360cce4e3c', 'request_id': 'req-7e1bd246-2e9d-499c-a0fc-1da86cdae1db'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:41.957062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-7e1bd246-2e9d-499c-a0fc-1da86cdae1db admin admin] The token cache is being invalidate because project e5a70c9aaa1c4504830937360cce4e3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:56:41.957364 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-7e1bd246-2e9d-499c-a0fc-1da86cdae1db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:41.958054 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-7e1bd246-2e9d-499c-a0fc-1da86cdae1db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:41.959592 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 959/1919] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:56:41 2022] DELETE /identity/v3/projects/e5a70c9aaa1c4504830937360cce4e3c => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:41.964867 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfd861-c683-4e61-b1f3-e250a77056f1 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:41.965192 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfd861-c683-4e61-b1f3-e250a77056f1 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:41.965469 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfd861-c683-4e61-b1f3-e250a77056f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:41.989660 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-09bfd861-c683-4e61-b1f3-e250a77056f1 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:41.989660 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-09bfd861-c683-4e61-b1f3-e250a77056f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:42.115719 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 961/1920] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:42.123717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b3aa8-6a42-4fa4-a9cb-7851104100e2 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:42.128440 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b3aa8-6a42-4fa4-a9cb-7851104100e2 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:42.128775 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b3aa8-6a42-4fa4-a9cb-7851104100e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:42.182210 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-2c1b3aa8-6a42-4fa4-a9cb-7851104100e2 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:42.183992 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-2c1b3aa8-6a42-4fa4-a9cb-7851104100e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:42.196125 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 960/1921] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:42.200859 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bfd861-c683-4e61-b1f3-e250a77056f1 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:42.222468 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bfd861-c683-4e61-b1f3-e250a77056f1 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:42.228491 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3157c84-0ebd-4713-a28c-89d4d7dc27c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:42.229224 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3157c84-0ebd-4713-a28c-89d4d7dc27c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:42.229560 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3157c84-0ebd-4713-a28c-89d4d7dc27c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:42.229869 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3157c84-0ebd-4713-a28c-89d4d7dc27c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:42.231420 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3157c84-0ebd-4713-a28c-89d4d7dc27c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:56:42.231858 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3157c84-0ebd-4713-a28c-89d4d7dc27c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:42.233976 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3157c84-0ebd-4713-a28c-89d4d7dc27c4 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:42.252145 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 962/1922] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:56:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:56:42.255833 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b3aa8-6a42-4fa4-a9cb-7851104100e2 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:42.274193 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b3aa8-6a42-4fa4-a9cb-7851104100e2 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:42.286464 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc069fac-e556-4e8d-a977-85b0d5254d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:42.287240 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc069fac-e556-4e8d-a977-85b0d5254d1a admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:42.287622 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc069fac-e556-4e8d-a977-85b0d5254d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:42.287994 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc069fac-e556-4e8d-a977-85b0d5254d1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:42.288801 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc069fac-e556-4e8d-a977-85b0d5254d1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:42.290855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc069fac-e556-4e8d-a977-85b0d5254d1a admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:42.345772 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 961/1923] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:56:42 2022] POST /identity/v3/projects => generated 379 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:42.350000 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3157c84-0ebd-4713-a28c-89d4d7dc27c4 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:42.364595 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3157c84-0ebd-4713-a28c-89d4d7dc27c4 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:42.475859 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91dcab-7719-4876-ab66-248caa0eb223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:42.476520 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91dcab-7719-4876-ab66-248caa0eb223 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:42.476998 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91dcab-7719-4876-ab66-248caa0eb223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:42.477232 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91dcab-7719-4876-ab66-248caa0eb223 admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:42.478020 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91dcab-7719-4876-ab66-248caa0eb223 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:42.480277 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91dcab-7719-4876-ab66-248caa0eb223 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:42.515783 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 963/1924] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:56:42 2022] POST /identity/v3/users => generated 290 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:42.519528 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc069fac-e556-4e8d-a977-85b0d5254d1a admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:42.541972 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc069fac-e556-4e8d-a977-85b0d5254d1a admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:42.553782 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a728ec-f96a-4bd7-9031-43941c834428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:42.554562 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a728ec-f96a-4bd7-9031-43941c834428 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:42.554919 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a728ec-f96a-4bd7-9031-43941c834428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:42.555307 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a728ec-f96a-4bd7-9031-43941c834428 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:42.556098 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a728ec-f96a-4bd7-9031-43941c834428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:42.557906 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a728ec-f96a-4bd7-9031-43941c834428 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:42.570322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 962/1925] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 17:56:42.583401 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91dcab-7719-4876-ab66-248caa0eb223 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:42.590023 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:42.602248 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91dcab-7719-4876-ab66-248caa0eb223 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:42.625867 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b7d49-2af7-4232-918d-85ef64cea2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:42.626497 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b7d49-2af7-4232-918d-85ef64cea2a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:42.626776 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b7d49-2af7-4232-918d-85ef64cea2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:42.627046 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b7d49-2af7-4232-918d-85ef64cea2a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:42.627756 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b7d49-2af7-4232-918d-85ef64cea2a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:42.629444 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b7d49-2af7-4232-918d-85ef64cea2a0 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:42.647829 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 964/1926] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:56:42.649043 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a728ec-f96a-4bd7-9031-43941c834428 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:42.661143 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a728ec-f96a-4bd7-9031-43941c834428 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:42.667460 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af8da2-41ad-4381-b22d-68d4f2cbe2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:42.668001 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af8da2-41ad-4381-b22d-68d4f2cbe2cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:42.671210 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af8da2-41ad-4381-b22d-68d4f2cbe2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:42.671210 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af8da2-41ad-4381-b22d-68d4f2cbe2cc admin admin] PATH_INFO: `/v3/projects/0b0349a7282b4f7aa47be4f964642812/users/34542460a10044d7868fe6bfc0afa282/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:42.690696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af8da2-41ad-4381-b22d-68d4f2cbe2cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b0349a7282b4f7aa47be4f964642812, user_id=34542460a10044d7868fe6bfc0afa282, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:42.695661 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af8da2-41ad-4381-b22d-68d4f2cbe2cc admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:42.724292 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 963/1927] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:56:42 2022] PUT /identity/v3/projects/0b0349a7282b4f7aa47be4f964642812/users/34542460a10044d7868fe6bfc0afa282/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:42.735473 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67201ca-2a03-4ead-97a2-5d3e15ddb94e None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:42.738665 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67201ca-2a03-4ead-97a2-5d3e15ddb94e None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:42.738665 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67201ca-2a03-4ead-97a2-5d3e15ddb94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:42.792911 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-e67201ca-2a03-4ead-97a2-5d3e15ddb94e None None] MFA Rules not processed for user `34542460a10044d7868fe6bfc0afa282`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:42.794551 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-e67201ca-2a03-4ead-97a2-5d3e15ddb94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:42.897695 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 965/1928] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:42.903594 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af8da2-41ad-4381-b22d-68d4f2cbe2cc admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:43.088571 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af8da2-41ad-4381-b22d-68d4f2cbe2cc admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:43.095855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505bf6f-bf01-4e7d-8dc2-0456c1e9b3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:43.096883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505bf6f-bf01-4e7d-8dc2-0456c1e9b3ae admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:43.098481 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505bf6f-bf01-4e7d-8dc2-0456c1e9b3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:43.098964 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505bf6f-bf01-4e7d-8dc2-0456c1e9b3ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:43.099874 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505bf6f-bf01-4e7d-8dc2-0456c1e9b3ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:43.105228 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505bf6f-bf01-4e7d-8dc2-0456c1e9b3ae admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:43.156420 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 964/1929] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:56:42 2022] POST /identity/v3/projects => generated 379 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:43.158258 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67201ca-2a03-4ead-97a2-5d3e15ddb94e None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:43.176668 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67201ca-2a03-4ead-97a2-5d3e15ddb94e None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:43.298858 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725552ae-ba01-4182-a9e3-fd6ca305a137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:43.299924 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725552ae-ba01-4182-a9e3-fd6ca305a137 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:43.299924 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725552ae-ba01-4182-a9e3-fd6ca305a137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:43.300197 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725552ae-ba01-4182-a9e3-fd6ca305a137 admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:43.301290 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725552ae-ba01-4182-a9e3-fd6ca305a137 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:43.305307 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725552ae-ba01-4182-a9e3-fd6ca305a137 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:43.342747 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505bf6f-bf01-4e7d-8dc2-0456c1e9b3ae admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:43.342943 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 966/1930] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:56:43 2022] POST /identity/v3/users => generated 290 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:43.357594 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505bf6f-bf01-4e7d-8dc2-0456c1e9b3ae admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:43.371024 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e0853-6adc-4f66-bb36-2ab4c0da5024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:43.371024 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e0853-6adc-4f66-bb36-2ab4c0da5024 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:43.371024 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e0853-6adc-4f66-bb36-2ab4c0da5024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:43.371024 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e0853-6adc-4f66-bb36-2ab4c0da5024 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:43.371468 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7e0853-6adc-4f66-bb36-2ab4c0da5024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:43.371979 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7e0853-6adc-4f66-bb36-2ab4c0da5024 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:43.375376 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:43.394045 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 965/1931] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:56:43.394983 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725552ae-ba01-4182-a9e3-fd6ca305a137 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:43.407078 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725552ae-ba01-4182-a9e3-fd6ca305a137 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:43.412861 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8b2ce-cd77-4f31-8f90-3f3ff41d7584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:43.413604 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8b2ce-cd77-4f31-8f90-3f3ff41d7584 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:43.413941 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8b2ce-cd77-4f31-8f90-3f3ff41d7584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:43.414280 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8b2ce-cd77-4f31-8f90-3f3ff41d7584 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:43.415094 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd8b2ce-cd77-4f31-8f90-3f3ff41d7584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:43.421303 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd8b2ce-cd77-4f31-8f90-3f3ff41d7584 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:43.434325 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 967/1932] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 17:56:43.438577 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e0853-6adc-4f66-bb36-2ab4c0da5024 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:43.449634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e0853-6adc-4f66-bb36-2ab4c0da5024 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:43.454622 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2137fc-6a78-4988-bdbf-d847549c3700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:43.455330 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2137fc-6a78-4988-bdbf-d847549c3700 admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:43.455610 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2137fc-6a78-4988-bdbf-d847549c3700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:43.455878 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2137fc-6a78-4988-bdbf-d847549c3700 admin admin] PATH_INFO: `/v3/projects/861fc0bd2f454d6bac7ef47c93dfa3e5/users/d217edf02543463c92e790051e2a3b34/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:43.473123 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2137fc-6a78-4988-bdbf-d847549c3700 admin admin] RBAC: Authorizing `identity:create_grant(project_id=861fc0bd2f454d6bac7ef47c93dfa3e5, user_id=d217edf02543463c92e790051e2a3b34, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:43.475839 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2137fc-6a78-4988-bdbf-d847549c3700 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:43.492521 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 966/1933] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:56:43 2022] PUT /identity/v3/projects/861fc0bd2f454d6bac7ef47c93dfa3e5/users/d217edf02543463c92e790051e2a3b34/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:43.502834 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f974e5-0169-4045-84b3-5db08ab7cd27 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:43.503125 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f974e5-0169-4045-84b3-5db08ab7cd27 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:43.503437 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f974e5-0169-4045-84b3-5db08ab7cd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:43.535718 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-e7f974e5-0169-4045-84b3-5db08ab7cd27 None None] MFA Rules not processed for user `d217edf02543463c92e790051e2a3b34`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:43.536951 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-e7f974e5-0169-4045-84b3-5db08ab7cd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:43.613386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:43.668805 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2137fc-6a78-4988-bdbf-d847549c3700 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:43.674037 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 968/1934] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:43.852338 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2137fc-6a78-4988-bdbf-d847549c3700 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:43.867415 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dba704-185c-4211-9ba3-a7f312d33e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:43.872046 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dba704-185c-4211-9ba3-a7f312d33e48 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:43.872343 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dba704-185c-4211-9ba3-a7f312d33e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:43.872622 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dba704-185c-4211-9ba3-a7f312d33e48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:43.874374 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dba704-185c-4211-9ba3-a7f312d33e48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:43.876632 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dba704-185c-4211-9ba3-a7f312d33e48 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:43.933696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 967/1935] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:56:43 2022] POST /identity/v3/projects => generated 377 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:43.942028 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f974e5-0169-4045-84b3-5db08ab7cd27 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:43.961426 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f974e5-0169-4045-84b3-5db08ab7cd27 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:44.042996 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d92488-4c18-4bb7-b01f-d119454631b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:44.043411 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d92488-4c18-4bb7-b01f-d119454631b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:44.043694 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d92488-4c18-4bb7-b01f-d119454631b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:44.043965 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d92488-4c18-4bb7-b01f-d119454631b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:44.045065 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d92488-4c18-4bb7-b01f-d119454631b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:44.046636 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d92488-4c18-4bb7-b01f-d119454631b6 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:44.093519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 969/1936] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:56:43 2022] POST /identity/v3/users => generated 295 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:44.095018 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dba704-185c-4211-9ba3-a7f312d33e48 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:44.110830 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dba704-185c-4211-9ba3-a7f312d33e48 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:44.122401 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ce824-2792-4630-a4b2-640bbd1f7c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:44.122952 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ce824-2792-4630-a4b2-640bbd1f7c5a admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:44.123229 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ce824-2792-4630-a4b2-640bbd1f7c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:44.123499 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ce824-2792-4630-a4b2-640bbd1f7c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:44.124147 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ce824-2792-4630-a4b2-640bbd1f7c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:44.127430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ce824-2792-4630-a4b2-640bbd1f7c5a admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:44.154885 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 968/1937] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:56:44.155743 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d92488-4c18-4bb7-b01f-d119454631b6 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:44.174356 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d92488-4c18-4bb7-b01f-d119454631b6 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:44.181501 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc11a15-6d46-4e51-aeaf-ba4a04c0ffb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:44.182505 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc11a15-6d46-4e51-aeaf-ba4a04c0ffb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:44.182898 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc11a15-6d46-4e51-aeaf-ba4a04c0ffb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:44.183256 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc11a15-6d46-4e51-aeaf-ba4a04c0ffb7 admin admin] PATH_INFO: `/v3/projects/cde72f74ff5a44ab82950f9f0f97e96a/users/e3c028483af34143add6122c75cb13ad/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:44.206340 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc11a15-6d46-4e51-aeaf-ba4a04c0ffb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cde72f74ff5a44ab82950f9f0f97e96a, user_id=e3c028483af34143add6122c75cb13ad, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:44.213447 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc11a15-6d46-4e51-aeaf-ba4a04c0ffb7 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:44.235019 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 970/1938] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:56:44 2022] PUT /identity/v3/projects/cde72f74ff5a44ab82950f9f0f97e96a/users/e3c028483af34143add6122c75cb13ad/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:56:44.240995 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ce824-2792-4630-a4b2-640bbd1f7c5a admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:44.254426 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ce824-2792-4630-a4b2-640bbd1f7c5a admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:44.340092 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd7986-72d8-4315-899b-2d53328523a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:44.340709 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd7986-72d8-4315-899b-2d53328523a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:44.340991 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd7986-72d8-4315-899b-2d53328523a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:44.341298 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd7986-72d8-4315-899b-2d53328523a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:44.341946 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd7986-72d8-4315-899b-2d53328523a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:44.343540 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd7986-72d8-4315-899b-2d53328523a7 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:44.353559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 969/1939] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:56:44.358387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc11a15-6d46-4e51-aeaf-ba4a04c0ffb7 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:44.369497 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc11a15-6d46-4e51-aeaf-ba4a04c0ffb7 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:44.374630 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af4408-8ad5-4b93-ae9b-df4401fd0f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:44.375593 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af4408-8ad5-4b93-ae9b-df4401fd0f94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:44.375883 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af4408-8ad5-4b93-ae9b-df4401fd0f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:44.376165 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af4408-8ad5-4b93-ae9b-df4401fd0f94 admin admin] PATH_INFO: `/v3/projects/cde72f74ff5a44ab82950f9f0f97e96a/users/e3c028483af34143add6122c75cb13ad/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:44.378329 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af4408-8ad5-4b93-ae9b-df4401fd0f94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cde72f74ff5a44ab82950f9f0f97e96a, user_id=e3c028483af34143add6122c75cb13ad, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:44.381144 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af4408-8ad5-4b93-ae9b-df4401fd0f94 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:44.392462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 971/1940] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:56:44 2022] PUT /identity/v3/projects/cde72f74ff5a44ab82950f9f0f97e96a/users/e3c028483af34143add6122c75cb13ad/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:44.403171 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e278ab7-3ffb-47fb-bfcd-cb3182f10ff8 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:44.403463 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e278ab7-3ffb-47fb-bfcd-cb3182f10ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:44.403740 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e278ab7-3ffb-47fb-bfcd-cb3182f10ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:44.433342 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-3e278ab7-3ffb-47fb-bfcd-cb3182f10ff8 None None] MFA Rules not processed for user `e3c028483af34143add6122c75cb13ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:44.434565 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-3e278ab7-3ffb-47fb-bfcd-cb3182f10ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:44.468870 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:44.511579 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 970/1941] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:44.523011 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af4408-8ad5-4b93-ae9b-df4401fd0f94 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:44.524881 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-52af4408-8ad5-4b93-ae9b-df4401fd0f94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:44.608029 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af4408-8ad5-4b93-ae9b-df4401fd0f94 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:44.611824 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a42ad-afd4-4107-a407-25ff4a150868 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:44.612433 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a42ad-afd4-4107-a407-25ff4a150868 service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:44.612712 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a42ad-afd4-4107-a407-25ff4a150868 service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:44.612986 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a42ad-afd4-4107-a407-25ff4a150868 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:44.622091 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a42ad-afd4-4107-a407-25ff4a150868 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:44.623570 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a42ad-afd4-4107-a407-25ff4a150868 service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:44.633135 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 972/1942] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:44.675759 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e278ab7-3ffb-47fb-bfcd-cb3182f10ff8 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:44.677245 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-3e278ab7-3ffb-47fb-bfcd-cb3182f10ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:44.688861 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e278ab7-3ffb-47fb-bfcd-cb3182f10ff8 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:44.692698 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6970aa-fe49-4f4c-9f49-170aac1984b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:44.693346 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6970aa-fe49-4f4c-9f49-170aac1984b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:44.693618 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6970aa-fe49-4f4c-9f49-170aac1984b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:44.693886 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6970aa-fe49-4f4c-9f49-170aac1984b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:44.752190 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6970aa-fe49-4f4c-9f49-170aac1984b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:44.753742 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6970aa-fe49-4f4c-9f49-170aac1984b9 service cinder] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:44.763661 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 971/1943] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:47.863511 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a42ad-afd4-4107-a407-25ff4a150868 service cinder] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:47.865081 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6970aa-fe49-4f4c-9f49-170aac1984b9 service cinder] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:47.867153 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-8b6970aa-fe49-4f4c-9f49-170aac1984b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:47.933821 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:47.962298 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a42ad-afd4-4107-a407-25ff4a150868 service cinder] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:47.968522 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01061a0d-9cc3-4bfe-93fa-2695715d63ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:47.969198 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01061a0d-9cc3-4bfe-93fa-2695715d63ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:47.969634 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01061a0d-9cc3-4bfe-93fa-2695715d63ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:47.969906 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01061a0d-9cc3-4bfe-93fa-2695715d63ec admin admin] PATH_INFO: `/v3/users/34542460a10044d7868fe6bfc0afa282` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:47.971074 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01061a0d-9cc3-4bfe-93fa-2695715d63ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=34542460a10044d7868fe6bfc0afa282)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:47.973250 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01061a0d-9cc3-4bfe-93fa-2695715d63ec admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:47.987157 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6970aa-fe49-4f4c-9f49-170aac1984b9 service cinder] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:48.007151 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f5ca7-4e3e-47fa-bc6b-bf79f13780fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:48.007873 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f5ca7-4e3e-47fa-bc6b-bf79f13780fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:48.008428 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f5ca7-4e3e-47fa-bc6b-bf79f13780fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:48.008786 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f5ca7-4e3e-47fa-bc6b-bf79f13780fb admin admin] PATH_INFO: `/v3/users/709453b367df4113b03d4d031616bf06` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:48.010276 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f5ca7-4e3e-47fa-bc6b-bf79f13780fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=709453b367df4113b03d4d031616bf06)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:48.012866 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f5ca7-4e3e-47fa-bc6b-bf79f13780fb admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:48.038734 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-01061a0d-9cc3-4bfe-93fa-2695715d63ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34542460a10044d7868fe6bfc0afa282'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:48.039556 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-01061a0d-9cc3-4bfe-93fa-2695715d63ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34542460a10044d7868fe6bfc0afa282'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:48.040239 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-01061a0d-9cc3-4bfe-93fa-2695715d63ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34542460a10044d7868fe6bfc0afa282'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:48.050352 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-01061a0d-9cc3-4bfe-93fa-2695715d63ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34542460a10044d7868fe6bfc0afa282'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:48.064053 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-01061a0d-9cc3-4bfe-93fa-2695715d63ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34542460a10044d7868fe6bfc0afa282'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:48.087646 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 973/1944] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:56:47 2022] DELETE /identity/v3/users/34542460a10044d7868fe6bfc0afa282 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:48.090434 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-f46f5ca7-4e3e-47fa-bc6b-bf79f13780fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '709453b367df4113b03d4d031616bf06'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:48.092012 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95e80d-7c83-4a40-afc3-79711eb99984 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:48.092500 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95e80d-7c83-4a40-afc3-79711eb99984 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:48.092793 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95e80d-7c83-4a40-afc3-79711eb99984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:48.102391 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-f46f5ca7-4e3e-47fa-bc6b-bf79f13780fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '709453b367df4113b03d4d031616bf06'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:48.103053 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-f46f5ca7-4e3e-47fa-bc6b-bf79f13780fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '709453b367df4113b03d4d031616bf06'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:48.103794 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-f46f5ca7-4e3e-47fa-bc6b-bf79f13780fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '709453b367df4113b03d4d031616bf06'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:48.113901 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-ce95e80d-7c83-4a40-afc3-79711eb99984 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:48.115101 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-ce95e80d-7c83-4a40-afc3-79711eb99984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:48.115365 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-f46f5ca7-4e3e-47fa-bc6b-bf79f13780fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '709453b367df4113b03d4d031616bf06'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:48.123792 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:48.144178 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 972/1945] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:56:47 2022] DELETE /identity/v3/users/709453b367df4113b03d4d031616bf06 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:56:48.149279 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cedd3-18b5-4543-86ea-1d533baf7b57 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:48.149633 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cedd3-18b5-4543-86ea-1d533baf7b57 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:48.149982 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cedd3-18b5-4543-86ea-1d533baf7b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:48.174132 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-3d4cedd3-18b5-4543-86ea-1d533baf7b57 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:48.175370 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-3d4cedd3-18b5-4543-86ea-1d533baf7b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:48.194814 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 974/1946] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:48.205352 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95e80d-7c83-4a40-afc3-79711eb99984 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:48.207084 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-ce95e80d-7c83-4a40-afc3-79711eb99984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:48.244324 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 973/1947] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:48.254586 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4cedd3-18b5-4543-86ea-1d533baf7b57 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:48.255945 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-3d4cedd3-18b5-4543-86ea-1d533baf7b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:48.274925 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95e80d-7c83-4a40-afc3-79711eb99984 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:48.290727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:48.318173 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4cedd3-18b5-4543-86ea-1d533baf7b57 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:48.322716 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61759b11-28b9-4c6a-a385-eefe5a3b3af8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:48.323352 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61759b11-28b9-4c6a-a385-eefe5a3b3af8 service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:48.323627 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61759b11-28b9-4c6a-a385-eefe5a3b3af8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:48.324053 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61759b11-28b9-4c6a-a385-eefe5a3b3af8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:48.325775 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a27cd2-5bf6-444f-a7e8-7cbd0a03217b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:48.326397 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a27cd2-5bf6-444f-a7e8-7cbd0a03217b service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:48.326658 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a27cd2-5bf6-444f-a7e8-7cbd0a03217b service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:48.326930 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a27cd2-5bf6-444f-a7e8-7cbd0a03217b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:48.333421 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61759b11-28b9-4c6a-a385-eefe5a3b3af8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:48.334935 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61759b11-28b9-4c6a-a385-eefe5a3b3af8 service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:48.336718 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a27cd2-5bf6-444f-a7e8-7cbd0a03217b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:48.338235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a27cd2-5bf6-444f-a7e8-7cbd0a03217b service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:48.344773 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 974/1948] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 17:56:48.352029 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 975/1949] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:48.725523 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61759b11-28b9-4c6a-a385-eefe5a3b3af8 service neutron] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:48.727452 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-61759b11-28b9-4c6a-a385-eefe5a3b3af8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:48.740278 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a27cd2-5bf6-444f-a7e8-7cbd0a03217b service neutron] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:48.743776 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61759b11-28b9-4c6a-a385-eefe5a3b3af8 service neutron] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:48.746397 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-00a27cd2-5bf6-444f-a7e8-7cbd0a03217b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:48.748950 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c176fcd-2825-45ac-aa7b-722d452c8434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:48.749770 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c176fcd-2825-45ac-aa7b-722d452c8434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:48.750055 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c176fcd-2825-45ac-aa7b-722d452c8434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:48.750375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c176fcd-2825-45ac-aa7b-722d452c8434 admin admin] PATH_INFO: `/v3/projects/b7e9246f4b08438895d0c0874311aa7b` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:48.751549 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c176fcd-2825-45ac-aa7b-722d452c8434 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7e9246f4b08438895d0c0874311aa7b)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:48.753524 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c176fcd-2825-45ac-aa7b-722d452c8434 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:48.783926 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a27cd2-5bf6-444f-a7e8-7cbd0a03217b service neutron] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:48.794243 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b93852-b177-47a4-927e-b3ed247a1896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:48.794890 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b93852-b177-47a4-927e-b3ed247a1896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:48.795166 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b93852-b177-47a4-927e-b3ed247a1896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:48.795435 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b93852-b177-47a4-927e-b3ed247a1896 admin admin] PATH_INFO: `/v3/projects/0b0349a7282b4f7aa47be4f964642812` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:48.796576 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b93852-b177-47a4-927e-b3ed247a1896 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b0349a7282b4f7aa47be4f964642812)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:48.798824 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b93852-b177-47a4-927e-b3ed247a1896 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:48.848729 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-8c176fcd-2825-45ac-aa7b-722d452c8434 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7e9246f4b08438895d0c0874311aa7b', 'request_id': 'req-8c176fcd-2825-45ac-aa7b-722d452c8434'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:48.856108 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-8c176fcd-2825-45ac-aa7b-722d452c8434 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7e9246f4b08438895d0c0874311aa7b', 'request_id': 'req-8c176fcd-2825-45ac-aa7b-722d452c8434'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:48.857788 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-19b93852-b177-47a4-927e-b3ed247a1896 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b0349a7282b4f7aa47be4f964642812', 'request_id': 'req-19b93852-b177-47a4-927e-b3ed247a1896'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:48.864965 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-19b93852-b177-47a4-927e-b3ed247a1896 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b0349a7282b4f7aa47be4f964642812', 'request_id': 'req-19b93852-b177-47a4-927e-b3ed247a1896'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:48.868471 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-8c176fcd-2825-45ac-aa7b-722d452c8434 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7e9246f4b08438895d0c0874311aa7b', 'request_id': 'req-8c176fcd-2825-45ac-aa7b-722d452c8434'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:48.874100 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-19b93852-b177-47a4-927e-b3ed247a1896 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b0349a7282b4f7aa47be4f964642812', 'request_id': 'req-19b93852-b177-47a4-927e-b3ed247a1896'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:48.886354 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-8c176fcd-2825-45ac-aa7b-722d452c8434 admin admin] The token cache is being invalidate because project b7e9246f4b08438895d0c0874311aa7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:56:48.886719 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-8c176fcd-2825-45ac-aa7b-722d452c8434 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:48.887339 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-8c176fcd-2825-45ac-aa7b-722d452c8434 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:48.888025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-19b93852-b177-47a4-927e-b3ed247a1896 admin admin] The token cache is being invalidate because project 0b0349a7282b4f7aa47be4f964642812 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:56:48.888318 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-19b93852-b177-47a4-927e-b3ed247a1896 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:48.889131 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 975/1950] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:56:48 2022] DELETE /identity/v3/projects/b7e9246f4b08438895d0c0874311aa7b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:48.891917 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-19b93852-b177-47a4-927e-b3ed247a1896 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:48.892786 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c176fcd-2825-45ac-aa7b-722d452c8434 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:48.893737 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 976/1951] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:56:48 2022] DELETE /identity/v3/projects/0b0349a7282b4f7aa47be4f964642812 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:48.897408 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-8c176fcd-2825-45ac-aa7b-722d452c8434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:48.897772 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b93852-b177-47a4-927e-b3ed247a1896 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:48.899253 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-19b93852-b177-47a4-927e-b3ed247a1896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:48.915816 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:48.976533 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c176fcd-2825-45ac-aa7b-722d452c8434 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:49.001257 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b93852-b177-47a4-927e-b3ed247a1896 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:49.007613 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10bc2e-c8ed-48cd-9b22-b024384b1612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:49.008442 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10bc2e-c8ed-48cd-9b22-b024384b1612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:49.008824 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10bc2e-c8ed-48cd-9b22-b024384b1612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:49.009335 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10bc2e-c8ed-48cd-9b22-b024384b1612 admin admin] PATH_INFO: `/v3/users/d217edf02543463c92e790051e2a3b34` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:49.011550 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10bc2e-c8ed-48cd-9b22-b024384b1612 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d217edf02543463c92e790051e2a3b34)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:49.014658 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10bc2e-c8ed-48cd-9b22-b024384b1612 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:49.048491 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ef388-dedc-4d51-be9d-bad4be73f706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:49.049219 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ef388-dedc-4d51-be9d-bad4be73f706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:49.049550 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ef388-dedc-4d51-be9d-bad4be73f706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:49.049818 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ef388-dedc-4d51-be9d-bad4be73f706 admin admin] PATH_INFO: `/v3/users/cb39b6ee3bf94c27861cee47d960eaea` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:49.051133 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ef388-dedc-4d51-be9d-bad4be73f706 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb39b6ee3bf94c27861cee47d960eaea)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:49.055181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ef388-dedc-4d51-be9d-bad4be73f706 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:49.092341 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-9a10bc2e-c8ed-48cd-9b22-b024384b1612 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd217edf02543463c92e790051e2a3b34'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:49.093265 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-9a10bc2e-c8ed-48cd-9b22-b024384b1612 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd217edf02543463c92e790051e2a3b34'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:49.094438 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-9a10bc2e-c8ed-48cd-9b22-b024384b1612 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd217edf02543463c92e790051e2a3b34'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:49.096174 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:49.110117 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-9a10bc2e-c8ed-48cd-9b22-b024384b1612 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd217edf02543463c92e790051e2a3b34'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:49.118084 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-f69ef388-dedc-4d51-be9d-bad4be73f706 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb39b6ee3bf94c27861cee47d960eaea'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:49.123195 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-9a10bc2e-c8ed-48cd-9b22-b024384b1612 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd217edf02543463c92e790051e2a3b34'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:49.130054 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-f69ef388-dedc-4d51-be9d-bad4be73f706 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb39b6ee3bf94c27861cee47d960eaea'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:49.132489 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-f69ef388-dedc-4d51-be9d-bad4be73f706 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb39b6ee3bf94c27861cee47d960eaea'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:49.133347 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-f69ef388-dedc-4d51-be9d-bad4be73f706 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb39b6ee3bf94c27861cee47d960eaea'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:49.157034 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 977/1952] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:56:48 2022] DELETE /identity/v3/users/d217edf02543463c92e790051e2a3b34 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:56:49.157228 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-f69ef388-dedc-4d51-be9d-bad4be73f706 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb39b6ee3bf94c27861cee47d960eaea'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:49.176855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 976/1953] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:56:48 2022] DELETE /identity/v3/users/cb39b6ee3bf94c27861cee47d960eaea => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:56:49.521757 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10bc2e-c8ed-48cd-9b22-b024384b1612 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:49.523218 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-9a10bc2e-c8ed-48cd-9b22-b024384b1612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:49.564108 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ef388-dedc-4d51-be9d-bad4be73f706 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:49.565924 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-f69ef388-dedc-4d51-be9d-bad4be73f706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:49.601950 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10bc2e-c8ed-48cd-9b22-b024384b1612 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:49.634029 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:49.662187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ef388-dedc-4d51-be9d-bad4be73f706 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:49.668390 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f238f-c371-4049-a3be-79f424336f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:49.669153 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f238f-c371-4049-a3be-79f424336f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:49.669519 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f238f-c371-4049-a3be-79f424336f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:49.669921 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f238f-c371-4049-a3be-79f424336f32 admin admin] PATH_INFO: `/v3/projects/861fc0bd2f454d6bac7ef47c93dfa3e5` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:49.670138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87884c-77a9-41fa-b781-9cdff206b0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:49.670747 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87884c-77a9-41fa-b781-9cdff206b0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:49.671027 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87884c-77a9-41fa-b781-9cdff206b0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:49.671186 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f238f-c371-4049-a3be-79f424336f32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=861fc0bd2f454d6bac7ef47c93dfa3e5)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:49.671281 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87884c-77a9-41fa-b781-9cdff206b0c1 admin admin] PATH_INFO: `/v3/projects/d59ce43c520d470bacad84ecceb76d9e` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:49.672584 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad87884c-77a9-41fa-b781-9cdff206b0c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d59ce43c520d470bacad84ecceb76d9e)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:49.673444 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f238f-c371-4049-a3be-79f424336f32 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:49.675270 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad87884c-77a9-41fa-b781-9cdff206b0c1 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:49.737387 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-da0f238f-c371-4049-a3be-79f424336f32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '861fc0bd2f454d6bac7ef47c93dfa3e5', 'request_id': 'req-da0f238f-c371-4049-a3be-79f424336f32'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:49.740926 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-ad87884c-77a9-41fa-b781-9cdff206b0c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd59ce43c520d470bacad84ecceb76d9e', 'request_id': 'req-ad87884c-77a9-41fa-b781-9cdff206b0c1'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:49.749883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-da0f238f-c371-4049-a3be-79f424336f32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '861fc0bd2f454d6bac7ef47c93dfa3e5', 'request_id': 'req-da0f238f-c371-4049-a3be-79f424336f32'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:49.753160 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-ad87884c-77a9-41fa-b781-9cdff206b0c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd59ce43c520d470bacad84ecceb76d9e', 'request_id': 'req-ad87884c-77a9-41fa-b781-9cdff206b0c1'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:49.763616 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-da0f238f-c371-4049-a3be-79f424336f32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '861fc0bd2f454d6bac7ef47c93dfa3e5', 'request_id': 'req-da0f238f-c371-4049-a3be-79f424336f32'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:49.770545 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-ad87884c-77a9-41fa-b781-9cdff206b0c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd59ce43c520d470bacad84ecceb76d9e', 'request_id': 'req-ad87884c-77a9-41fa-b781-9cdff206b0c1'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:49.787173 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-da0f238f-c371-4049-a3be-79f424336f32 admin admin] The token cache is being invalidate because project 861fc0bd2f454d6bac7ef47c93dfa3e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:56:49.787500 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-da0f238f-c371-4049-a3be-79f424336f32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:49.789392 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-da0f238f-c371-4049-a3be-79f424336f32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:49.795824 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 977/1954] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:56:49 2022] DELETE /identity/v3/projects/861fc0bd2f454d6bac7ef47c93dfa3e5 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:56:49.799797 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f238f-c371-4049-a3be-79f424336f32 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:49.801760 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-da0f238f-c371-4049-a3be-79f424336f32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:49.808379 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-ad87884c-77a9-41fa-b781-9cdff206b0c1 admin admin] The token cache is being invalidate because project d59ce43c520d470bacad84ecceb76d9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:56:49.808734 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-ad87884c-77a9-41fa-b781-9cdff206b0c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:49.809575 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-ad87884c-77a9-41fa-b781-9cdff206b0c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:49.811781 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 978/1955] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:56:49 2022] DELETE /identity/v3/projects/d59ce43c520d470bacad84ecceb76d9e => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:49.816543 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61720dd-d0ae-4e1c-95e0-61461bbcca85 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:49.816924 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61720dd-d0ae-4e1c-95e0-61461bbcca85 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:49.817320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61720dd-d0ae-4e1c-95e0-61461bbcca85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:49.827059 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:49.855764 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-c61720dd-d0ae-4e1c-95e0-61461bbcca85 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:49.857263 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-c61720dd-d0ae-4e1c-95e0-61461bbcca85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:49.895491 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f238f-c371-4049-a3be-79f424336f32 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:49.933714 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 979/1956] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:56:49.940839 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bd968-da58-4878-9dc3-49efc2e11db3 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:49.941188 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bd968-da58-4878-9dc3-49efc2e11db3 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:49.941471 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bd968-da58-4878-9dc3-49efc2e11db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:49.967963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-1f6bd968-da58-4878-9dc3-49efc2e11db3 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:49.969510 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-1f6bd968-da58-4878-9dc3-49efc2e11db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:49.973757 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf25324-ddc5-43d2-8de6-7ba37dadfbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:49.974589 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf25324-ddc5-43d2-8de6-7ba37dadfbba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:49.974878 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf25324-ddc5-43d2-8de6-7ba37dadfbba admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:49.975155 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf25324-ddc5-43d2-8de6-7ba37dadfbba admin admin] PATH_INFO: `/v3/users/e3c028483af34143add6122c75cb13ad` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:49.976535 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf25324-ddc5-43d2-8de6-7ba37dadfbba admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3c028483af34143add6122c75cb13ad)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:49.978454 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf25324-ddc5-43d2-8de6-7ba37dadfbba admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:49.980410 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 980/1957] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:56:49.984293 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bd968-da58-4878-9dc3-49efc2e11db3 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:49.994369 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bd968-da58-4878-9dc3-49efc2e11db3 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:49.999084 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacea09d-02dd-47fc-88a6-33015b1ab57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:49.999693 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacea09d-02dd-47fc-88a6-33015b1ab57c admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:49.999978 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacea09d-02dd-47fc-88a6-33015b1ab57c admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:50.000251 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacea09d-02dd-47fc-88a6-33015b1ab57c admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:50.000904 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacea09d-02dd-47fc-88a6-33015b1ab57c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:56:50.001729 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacea09d-02dd-47fc-88a6-33015b1ab57c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:50.002888 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacea09d-02dd-47fc-88a6-33015b1ab57c admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:50.021643 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:50.023467 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 981/1958] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:56:50.024460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacea09d-02dd-47fc-88a6-33015b1ab57c admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:50.039785 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacea09d-02dd-47fc-88a6-33015b1ab57c admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:50.049162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a255568-4210-48a2-9111-ca3303c45303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:50.050186 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a255568-4210-48a2-9111-ca3303c45303 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:50.050771 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a255568-4210-48a2-9111-ca3303c45303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:50.051216 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a255568-4210-48a2-9111-ca3303c45303 admin admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:50.051877 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a255568-4210-48a2-9111-ca3303c45303 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:50.054163 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a255568-4210-48a2-9111-ca3303c45303 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:50.061190 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-2cf25324-ddc5-43d2-8de6-7ba37dadfbba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3c028483af34143add6122c75cb13ad'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:50.069927 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-2cf25324-ddc5-43d2-8de6-7ba37dadfbba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3c028483af34143add6122c75cb13ad'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:50.070645 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-2cf25324-ddc5-43d2-8de6-7ba37dadfbba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3c028483af34143add6122c75cb13ad'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:50.071342 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-2cf25324-ddc5-43d2-8de6-7ba37dadfbba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3c028483af34143add6122c75cb13ad'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:50.085348 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-2cf25324-ddc5-43d2-8de6-7ba37dadfbba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3c028483af34143add6122c75cb13ad'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:50.087431 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 982/1959] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:56:50 2022] POST /identity/v3/projects => generated 399 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:50.092470 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a255568-4210-48a2-9111-ca3303c45303 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:50.095353 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-4a255568-4210-48a2-9111-ca3303c45303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:50.111950 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 978/1960] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:56:49 2022] DELETE /identity/v3/users/e3c028483af34143add6122c75cb13ad => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:50.173833 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a255568-4210-48a2-9111-ca3303c45303 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:50.256344 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bdface-b611-4e1b-8166-000ce41604fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:50.257338 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdface-b611-4e1b-8166-000ce41604fa admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:50.257825 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdface-b611-4e1b-8166-000ce41604fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:50.258227 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdface-b611-4e1b-8166-000ce41604fa admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:50.259015 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bdface-b611-4e1b-8166-000ce41604fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:50.262794 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bdface-b611-4e1b-8166-000ce41604fa admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:50.287970 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:50.300957 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 983/1961] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:56:50 2022] POST /identity/v3/users => generated 300 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 17:56:50.305092 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf25324-ddc5-43d2-8de6-7ba37dadfbba admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:50.322243 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf25324-ddc5-43d2-8de6-7ba37dadfbba admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:50.336003 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4f0f2-a2ae-4300-8cf4-1227261ece32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:50.336634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4f0f2-a2ae-4300-8cf4-1227261ece32 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:50.336912 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4f0f2-a2ae-4300-8cf4-1227261ece32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:50.337382 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4f0f2-a2ae-4300-8cf4-1227261ece32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:50.338389 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4f0f2-a2ae-4300-8cf4-1227261ece32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:50.340089 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4f0f2-a2ae-4300-8cf4-1227261ece32 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:50.363858 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 979/1962] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:56:50.368043 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bdface-b611-4e1b-8166-000ce41604fa admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:50.409629 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bdface-b611-4e1b-8166-000ce41604fa admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:50.429862 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58fa72-fb1a-4468-8662-69d0ddc48485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:50.430502 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58fa72-fb1a-4468-8662-69d0ddc48485 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:50.430788 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58fa72-fb1a-4468-8662-69d0ddc48485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:50.431065 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58fa72-fb1a-4468-8662-69d0ddc48485 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:50.432148 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f58fa72-fb1a-4468-8662-69d0ddc48485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:50.434368 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f58fa72-fb1a-4468-8662-69d0ddc48485 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:50.446116 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 984/1963] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:56:50.451379 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4f0f2-a2ae-4300-8cf4-1227261ece32 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:50.463846 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4f0f2-a2ae-4300-8cf4-1227261ece32 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:50.469356 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4c1fd-976a-49d0-a4c3-e1ffb39c49fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:50.470412 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4c1fd-976a-49d0-a4c3-e1ffb39c49fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:50.470701 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4c1fd-976a-49d0-a4c3-e1ffb39c49fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:50.470979 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4c1fd-976a-49d0-a4c3-e1ffb39c49fa admin admin] PATH_INFO: `/v3/projects/1cc2171f9ea541dfad7f370acdabf084/users/f430a85a5d2641d8af60ca29330f1e58/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:50.491198 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc4c1fd-976a-49d0-a4c3-e1ffb39c49fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cc2171f9ea541dfad7f370acdabf084, user_id=f430a85a5d2641d8af60ca29330f1e58, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:50.494180 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc4c1fd-976a-49d0-a4c3-e1ffb39c49fa admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:50.515013 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 980/1964] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:56:50 2022] PUT /identity/v3/projects/1cc2171f9ea541dfad7f370acdabf084/users/f430a85a5d2641d8af60ca29330f1e58/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:50.527172 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ebb9b-600d-4b6e-9d46-669eb46ef074 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:50.527172 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ebb9b-600d-4b6e-9d46-669eb46ef074 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:50.527423 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ebb9b-600d-4b6e-9d46-669eb46ef074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:50.565151 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-232ebb9b-600d-4b6e-9d46-669eb46ef074 None None] MFA Rules not processed for user `f430a85a5d2641d8af60ca29330f1e58`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:50.565151 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-232ebb9b-600d-4b6e-9d46-669eb46ef074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:50.665207 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 985/1965] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:50 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:50.669544 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4c1fd-976a-49d0-a4c3-e1ffb39c49fa admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:50.690669 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ebb9b-600d-4b6e-9d46-669eb46ef074 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:50.692071 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-232ebb9b-600d-4b6e-9d46-669eb46ef074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:50.758466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4c1fd-976a-49d0-a4c3-e1ffb39c49fa admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:50.764007 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13228d9-6177-40c1-9032-7f519ce8968b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:50.764625 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13228d9-6177-40c1-9032-7f519ce8968b admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:50.764895 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13228d9-6177-40c1-9032-7f519ce8968b admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:50.765282 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13228d9-6177-40c1-9032-7f519ce8968b admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:50.765836 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13228d9-6177-40c1-9032-7f519ce8968b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:50.767756 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13228d9-6177-40c1-9032-7f519ce8968b admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:50.785052 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ebb9b-600d-4b6e-9d46-669eb46ef074 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:50.786805 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9e8ac-b3b5-4566-a7ec-ebf896ee8652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:50.787709 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9e8ac-b3b5-4566-a7ec-ebf896ee8652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:50.788058 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9e8ac-b3b5-4566-a7ec-ebf896ee8652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:50.788364 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9e8ac-b3b5-4566-a7ec-ebf896ee8652 admin admin] PATH_INFO: `/v3/projects/cde72f74ff5a44ab82950f9f0f97e96a` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:50.789668 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9e8ac-b3b5-4566-a7ec-ebf896ee8652 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cde72f74ff5a44ab82950f9f0f97e96a)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:50.792406 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9e8ac-b3b5-4566-a7ec-ebf896ee8652 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:50.801419 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 981/1966] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:56:50 2022] POST /identity/v3/projects => generated 401 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:50.805305 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13228d9-6177-40c1-9032-7f519ce8968b admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:50.847366 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-d2f9e8ac-b3b5-4566-a7ec-ebf896ee8652 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cde72f74ff5a44ab82950f9f0f97e96a', 'request_id': 'req-d2f9e8ac-b3b5-4566-a7ec-ebf896ee8652'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:50.853523 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-d2f9e8ac-b3b5-4566-a7ec-ebf896ee8652 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cde72f74ff5a44ab82950f9f0f97e96a', 'request_id': 'req-d2f9e8ac-b3b5-4566-a7ec-ebf896ee8652'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:50.862026 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:50.864635 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-d2f9e8ac-b3b5-4566-a7ec-ebf896ee8652 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cde72f74ff5a44ab82950f9f0f97e96a', 'request_id': 'req-d2f9e8ac-b3b5-4566-a7ec-ebf896ee8652'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:50.879886 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-d2f9e8ac-b3b5-4566-a7ec-ebf896ee8652 admin admin] The token cache is being invalidate because project cde72f74ff5a44ab82950f9f0f97e96a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:56:50.880183 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-d2f9e8ac-b3b5-4566-a7ec-ebf896ee8652 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:50.880855 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-d2f9e8ac-b3b5-4566-a7ec-ebf896ee8652 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:50.881196 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13228d9-6177-40c1-9032-7f519ce8968b admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:50.882416 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 986/1967] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:56:50 2022] DELETE /identity/v3/projects/cde72f74ff5a44ab82950f9f0f97e96a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:56:50.890450 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd83a03-a39a-4e2c-aabc-10e94a78ddfd None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:50.891219 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd83a03-a39a-4e2c-aabc-10e94a78ddfd None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:50.891500 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd83a03-a39a-4e2c-aabc-10e94a78ddfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:50.910651 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:50.917648 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-3bd83a03-a39a-4e2c-aabc-10e94a78ddfd None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:50.920228 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-3bd83a03-a39a-4e2c-aabc-10e94a78ddfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:50.960435 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822657c-39eb-445b-83ff-5011e273f437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:50.961993 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822657c-39eb-445b-83ff-5011e273f437 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:50.962462 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822657c-39eb-445b-83ff-5011e273f437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:50.962916 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822657c-39eb-445b-83ff-5011e273f437 admin admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:50.964866 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0822657c-39eb-445b-83ff-5011e273f437 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:50.968717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0822657c-39eb-445b-83ff-5011e273f437 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:50.993089 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 987/1968] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:50.998489 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1705b08-2556-4be2-a79d-0d38e5793899 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:50.998904 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1705b08-2556-4be2-a79d-0d38e5793899 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:50.999203 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1705b08-2556-4be2-a79d-0d38e5793899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:51.013086 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 982/1969] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:56:50 2022] POST /identity/v3/users => generated 307 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:51.022873 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822657c-39eb-445b-83ff-5011e273f437 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:51.026937 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-d1705b08-2556-4be2-a79d-0d38e5793899 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:51.028400 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-d1705b08-2556-4be2-a79d-0d38e5793899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:51.030024 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-0822657c-39eb-445b-83ff-5011e273f437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:51.037833 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 988/1970] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:56:51.042772 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1705b08-2556-4be2-a79d-0d38e5793899 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:51.052847 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1705b08-2556-4be2-a79d-0d38e5793899 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:51.054255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822657c-39eb-445b-83ff-5011e273f437 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:51.058661 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8b85e-6d18-4a1f-8b82-ba62eb261c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:51.059343 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8b85e-6d18-4a1f-8b82-ba62eb261c95 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:51.059628 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8b85e-6d18-4a1f-8b82-ba62eb261c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:51.059903 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8b85e-6d18-4a1f-8b82-ba62eb261c95 admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:51.060568 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8b85e-6d18-4a1f-8b82-ba62eb261c95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:56:51.060824 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18150bc-84bd-4ebc-a6a0-3ee4661445b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:51.060949 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8b85e-6d18-4a1f-8b82-ba62eb261c95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:51.061744 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18150bc-84bd-4ebc-a6a0-3ee4661445b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:51.062187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18150bc-84bd-4ebc-a6a0-3ee4661445b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:51.062686 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8b85e-6d18-4a1f-8b82-ba62eb261c95 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:51.062867 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18150bc-84bd-4ebc-a6a0-3ee4661445b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:51.063827 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18150bc-84bd-4ebc-a6a0-3ee4661445b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:51.067852 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18150bc-84bd-4ebc-a6a0-3ee4661445b0 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:51.078923 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 989/1971] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:56:51.083963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8b85e-6d18-4a1f-8b82-ba62eb261c95 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:51.086679 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 983/1972] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:56:51.090343 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18150bc-84bd-4ebc-a6a0-3ee4661445b0 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:51.096719 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8b85e-6d18-4a1f-8b82-ba62eb261c95 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:51.105753 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18150bc-84bd-4ebc-a6a0-3ee4661445b0 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:51.105916 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27ec08-5b9a-4773-bde3-c040755de8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:51.108121 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27ec08-5b9a-4773-bde3-c040755de8bf admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:51.108876 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27ec08-5b9a-4773-bde3-c040755de8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:51.108876 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27ec08-5b9a-4773-bde3-c040755de8bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:51.109766 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af27ec08-5b9a-4773-bde3-c040755de8bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:51.112372 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af27ec08-5b9a-4773-bde3-c040755de8bf admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:51.113741 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588d3c4-79e4-4c49-87c5-44d900382475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:51.115387 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588d3c4-79e4-4c49-87c5-44d900382475 admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:51.115849 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588d3c4-79e4-4c49-87c5-44d900382475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:51.116299 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588d3c4-79e4-4c49-87c5-44d900382475 admin admin] PATH_INFO: `/v3/projects/1a2c85cc524b48118028bebaa4e06eec/users/adf456e27a8241a69900241f6d14a9c3/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:51.145565 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588d3c4-79e4-4c49-87c5-44d900382475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a2c85cc524b48118028bebaa4e06eec, user_id=adf456e27a8241a69900241f6d14a9c3, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:51.149502 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588d3c4-79e4-4c49-87c5-44d900382475 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:51.161226 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 990/1973] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:56:51 2022] POST /identity/v3/projects => generated 387 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:51.176572 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 984/1974] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:56:51 2022] PUT /identity/v3/projects/1a2c85cc524b48118028bebaa4e06eec/users/adf456e27a8241a69900241f6d14a9c3/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:56:51.177700 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588d3c4-79e4-4c49-87c5-44d900382475 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:51.177901 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27ec08-5b9a-4773-bde3-c040755de8bf admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:51.309464 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27ec08-5b9a-4773-bde3-c040755de8bf admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:51.317950 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56980667-5e92-4685-9161-ef18e99d1cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:51.318820 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56980667-5e92-4685-9161-ef18e99d1cd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:51.319252 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56980667-5e92-4685-9161-ef18e99d1cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:51.319396 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588d3c4-79e4-4c49-87c5-44d900382475 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:51.319801 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56980667-5e92-4685-9161-ef18e99d1cd0 admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:51.320682 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56980667-5e92-4685-9161-ef18e99d1cd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:51.323239 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56980667-5e92-4685-9161-ef18e99d1cd0 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:51.326207 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2233d9-f9ad-4bfa-9f79-900414877d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:51.326824 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2233d9-f9ad-4bfa-9f79-900414877d54 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:51.327101 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2233d9-f9ad-4bfa-9f79-900414877d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:51.327370 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2233d9-f9ad-4bfa-9f79-900414877d54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:51.328012 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2233d9-f9ad-4bfa-9f79-900414877d54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:51.329640 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2233d9-f9ad-4bfa-9f79-900414877d54 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:51.349133 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 985/1975] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:56:51.349613 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2233d9-f9ad-4bfa-9f79-900414877d54 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:51.360246 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 991/1976] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:56:51 2022] POST /identity/v3/users => generated 294 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:51.362653 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56980667-5e92-4685-9161-ef18e99d1cd0 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:51.366990 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2233d9-f9ad-4bfa-9f79-900414877d54 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:51.373341 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab3d66-dd9d-468c-9590-4f67c5a6c095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:51.373943 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab3d66-dd9d-468c-9590-4f67c5a6c095 admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:51.374219 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab3d66-dd9d-468c-9590-4f67c5a6c095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:51.374542 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab3d66-dd9d-468c-9590-4f67c5a6c095 admin admin] PATH_INFO: `/v3/projects/1a2c85cc524b48118028bebaa4e06eec/users/adf456e27a8241a69900241f6d14a9c3/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:51.376281 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56980667-5e92-4685-9161-ef18e99d1cd0 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:51.381225 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab3d66-dd9d-468c-9590-4f67c5a6c095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a2c85cc524b48118028bebaa4e06eec, user_id=adf456e27a8241a69900241f6d14a9c3, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:51.381225 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab3d66-dd9d-468c-9590-4f67c5a6c095 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:51.387927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456f9cc-6da9-41ae-9e3c-9e473e44a394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:51.393475 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456f9cc-6da9-41ae-9e3c-9e473e44a394 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:51.393475 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456f9cc-6da9-41ae-9e3c-9e473e44a394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:51.393475 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456f9cc-6da9-41ae-9e3c-9e473e44a394 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:51.393475 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f456f9cc-6da9-41ae-9e3c-9e473e44a394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:51.393475 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f456f9cc-6da9-41ae-9e3c-9e473e44a394 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:51.400167 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 986/1977] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:56:51 2022] PUT /identity/v3/projects/1a2c85cc524b48118028bebaa4e06eec/users/adf456e27a8241a69900241f6d14a9c3/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:56:51.406269 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 992/1978] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:56:51.409890 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab3d66-dd9d-468c-9590-4f67c5a6c095 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:51.413889 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863463b-73b5-4225-8234-e02720a456c0 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:51.414177 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863463b-73b5-4225-8234-e02720a456c0 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:51.414442 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863463b-73b5-4225-8234-e02720a456c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:51.451214 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-f863463b-73b5-4225-8234-e02720a456c0 None None] MFA Rules not processed for user `adf456e27a8241a69900241f6d14a9c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:51.452477 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-f863463b-73b5-4225-8234-e02720a456c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:51.452607 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:51.495950 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:51.520713 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab3d66-dd9d-468c-9590-4f67c5a6c095 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:51.541487 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e322f3-3df7-4a15-9538-4d95ce90212c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:51.542650 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e322f3-3df7-4a15-9538-4d95ce90212c admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:51.543592 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e322f3-3df7-4a15-9538-4d95ce90212c admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:51.543898 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e322f3-3df7-4a15-9538-4d95ce90212c admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:51.544565 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e322f3-3df7-4a15-9538-4d95ce90212c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:51.546339 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e322f3-3df7-4a15-9538-4d95ce90212c admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:51.563168 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 987/1979] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:56:51.563568 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 993/1980] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:51 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:51.569849 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e322f3-3df7-4a15-9538-4d95ce90212c admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:51.575117 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863463b-73b5-4225-8234-e02720a456c0 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:51.578819 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-f863463b-73b5-4225-8234-e02720a456c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:51.594561 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e322f3-3df7-4a15-9538-4d95ce90212c admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:51.608118 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855bec1e-68de-4ec0-9b2e-4229300fbcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:51.608724 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bec1e-68de-4ec0-9b2e-4229300fbcfb admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:51.609038 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bec1e-68de-4ec0-9b2e-4229300fbcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:51.609658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bec1e-68de-4ec0-9b2e-4229300fbcfb admin admin] PATH_INFO: `/v3/projects/09b362dee3a643c79a873da91d92474d/users/0e48715496e84d2c923e1a9c7f0a69b7/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:51.655814 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855bec1e-68de-4ec0-9b2e-4229300fbcfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=09b362dee3a643c79a873da91d92474d, user_id=0e48715496e84d2c923e1a9c7f0a69b7, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:51.665716 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855bec1e-68de-4ec0-9b2e-4229300fbcfb admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:51.711046 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 988/1981] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:56:51 2022] PUT /identity/v3/projects/09b362dee3a643c79a873da91d92474d/users/0e48715496e84d2c923e1a9c7f0a69b7/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:51.716362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea4ec2-8c1c-49b3-9a7f-441e32085874 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:51.716659 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea4ec2-8c1c-49b3-9a7f-441e32085874 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:51.716925 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea4ec2-8c1c-49b3-9a7f-441e32085874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:51.748062 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863463b-73b5-4225-8234-e02720a456c0 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:51.795074 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-a0ea4ec2-8c1c-49b3-9a7f-441e32085874 None None] MFA Rules not processed for user `0e48715496e84d2c923e1a9c7f0a69b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:51.796464 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-a0ea4ec2-8c1c-49b3-9a7f-441e32085874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:51.829054 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978cdbf-86f9-43cf-bbf0-3e3c4cd468dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:51.829688 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978cdbf-86f9-43cf-bbf0-3e3c4cd468dc service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:51.829971 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978cdbf-86f9-43cf-bbf0-3e3c4cd468dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:51.830249 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978cdbf-86f9-43cf-bbf0-3e3c4cd468dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:51.886494 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 989/1982] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:51.891173 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea4ec2-8c1c-49b3-9a7f-441e32085874 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:51.906795 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978cdbf-86f9-43cf-bbf0-3e3c4cd468dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:51.908475 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978cdbf-86f9-43cf-bbf0-3e3c4cd468dc service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:51.920924 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 994/1983] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:51 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:51.970060 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea4ec2-8c1c-49b3-9a7f-441e32085874 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:51.976354 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e42b4-3510-43c6-9bab-9fdbe18f8ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:51.976979 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e42b4-3510-43c6-9bab-9fdbe18f8ab7 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:51.977287 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e42b4-3510-43c6-9bab-9fdbe18f8ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:51.977558 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e42b4-3510-43c6-9bab-9fdbe18f8ab7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:51.978329 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e42b4-3510-43c6-9bab-9fdbe18f8ab7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:51.980971 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e42b4-3510-43c6-9bab-9fdbe18f8ab7 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:52.011766 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978cdbf-86f9-43cf-bbf0-3e3c4cd468dc service cinder] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:52.024791 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978cdbf-86f9-43cf-bbf0-3e3c4cd468dc service cinder] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:52.029374 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b7f86-ea12-44a7-8415-97ea021d93f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:52.029508 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 990/1984] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:56:51 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:52.030055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b7f86-ea12-44a7-8415-97ea021d93f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:52.030588 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b7f86-ea12-44a7-8415-97ea021d93f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:52.030866 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b7f86-ea12-44a7-8415-97ea021d93f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:52.033056 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e42b4-3510-43c6-9bab-9fdbe18f8ab7 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:52.033623 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-fe1b7f86-ea12-44a7-8415-97ea021d93f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:52.058593 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:52.092773 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:52.112758 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e42b4-3510-43c6-9bab-9fdbe18f8ab7 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:52.117799 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5ee1c-4c1b-45b3-b1c6-532a7d31eca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:52.118602 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5ee1c-4c1b-45b3-b1c6-532a7d31eca9 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:52.118788 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5ee1c-4c1b-45b3-b1c6-532a7d31eca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:52.119019 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5ee1c-4c1b-45b3-b1c6-532a7d31eca9 admin admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:52.119776 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5ee1c-4c1b-45b3-b1c6-532a7d31eca9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:52.122886 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5ee1c-4c1b-45b3-b1c6-532a7d31eca9 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:52.136650 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b7f86-ea12-44a7-8415-97ea021d93f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:52.138936 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b7f86-ea12-44a7-8415-97ea021d93f2 service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:52.152529 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 995/1985] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:52 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:52.155184 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 991/1986] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:56:52 2022] POST /identity/v3/users => generated 299 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 17:56:52.159864 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b7f86-ea12-44a7-8415-97ea021d93f2 service cinder] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:52.172402 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b7f86-ea12-44a7-8415-97ea021d93f2 service cinder] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:52.177237 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdfbd90-e467-4523-84af-6d9c6513241c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:52.177849 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfbd90-e467-4523-84af-6d9c6513241c admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:52.178130 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfbd90-e467-4523-84af-6d9c6513241c admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:52.178549 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfbd90-e467-4523-84af-6d9c6513241c admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:52.179196 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdfbd90-e467-4523-84af-6d9c6513241c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:52.180794 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdfbd90-e467-4523-84af-6d9c6513241c admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:52.225629 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 996/1987] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:56:52.226004 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5ee1c-4c1b-45b3-b1c6-532a7d31eca9 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:52.241653 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5ee1c-4c1b-45b3-b1c6-532a7d31eca9 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:52.248819 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33438c1-1cb5-4aba-8586-30711042e966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:52.249667 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33438c1-1cb5-4aba-8586-30711042e966 admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:52.250195 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33438c1-1cb5-4aba-8586-30711042e966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:52.250626 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33438c1-1cb5-4aba-8586-30711042e966 admin admin] PATH_INFO: `/v3/projects/150973e996c3403ebbe6f84b2aed7279/users/9d0f8c7bcc9b4781807917266f4629a2/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:52.282986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33438c1-1cb5-4aba-8586-30711042e966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=150973e996c3403ebbe6f84b2aed7279, user_id=9d0f8c7bcc9b4781807917266f4629a2, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:52.287537 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33438c1-1cb5-4aba-8586-30711042e966 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:52.311386 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 992/1988] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:56:52 2022] PUT /identity/v3/projects/150973e996c3403ebbe6f84b2aed7279/users/9d0f8c7bcc9b4781807917266f4629a2/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:52.315591 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdfbd90-e467-4523-84af-6d9c6513241c admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:52.333744 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdfbd90-e467-4523-84af-6d9c6513241c admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:52.438924 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7800bee-a20d-49f3-83f1-d408b2cedbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:52.439763 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7800bee-a20d-49f3-83f1-d408b2cedbf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:52.439923 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7800bee-a20d-49f3-83f1-d408b2cedbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:52.440205 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7800bee-a20d-49f3-83f1-d408b2cedbf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:52.441037 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7800bee-a20d-49f3-83f1-d408b2cedbf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:52.442735 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7800bee-a20d-49f3-83f1-d408b2cedbf1 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:52.461504 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 997/1989] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:56:52.467285 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33438c1-1cb5-4aba-8586-30711042e966 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:52.488064 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33438c1-1cb5-4aba-8586-30711042e966 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:52.493220 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9df3c2-ac10-491c-9591-4334ee6c16c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:52.493900 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9df3c2-ac10-491c-9591-4334ee6c16c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:52.494183 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9df3c2-ac10-491c-9591-4334ee6c16c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:52.494800 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9df3c2-ac10-491c-9591-4334ee6c16c0 admin admin] PATH_INFO: `/v3/projects/150973e996c3403ebbe6f84b2aed7279/users/9d0f8c7bcc9b4781807917266f4629a2/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:52.497328 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9df3c2-ac10-491c-9591-4334ee6c16c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=150973e996c3403ebbe6f84b2aed7279, user_id=9d0f8c7bcc9b4781807917266f4629a2, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:52.500676 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9df3c2-ac10-491c-9591-4334ee6c16c0 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:52.514041 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 993/1990] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:56:52 2022] PUT /identity/v3/projects/150973e996c3403ebbe6f84b2aed7279/users/9d0f8c7bcc9b4781807917266f4629a2/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:52.528807 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a99edc-315f-479e-b507-7f8fe8805ed0 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:52.529101 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a99edc-315f-479e-b507-7f8fe8805ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:52.529368 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a99edc-315f-479e-b507-7f8fe8805ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:52.607977 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-d0a99edc-315f-479e-b507-7f8fe8805ed0 None None] MFA Rules not processed for user `9d0f8c7bcc9b4781807917266f4629a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:52.609321 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-d0a99edc-315f-479e-b507-7f8fe8805ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:52.708521 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 998/1991] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:52 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:52.720375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9df3c2-ac10-491c-9591-4334ee6c16c0 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:52.797445 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9df3c2-ac10-491c-9591-4334ee6c16c0 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:52.802190 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72088382-7fe0-4664-a637-f8fa834f052f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:52.802809 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72088382-7fe0-4664-a637-f8fa834f052f service cinder] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:52.803612 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72088382-7fe0-4664-a637-f8fa834f052f service cinder] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:52.803612 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72088382-7fe0-4664-a637-f8fa834f052f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:52.815436 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72088382-7fe0-4664-a637-f8fa834f052f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:52.817482 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72088382-7fe0-4664-a637-f8fa834f052f service cinder] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:52.840618 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 994/1992] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:52 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:53.578783 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a99edc-315f-479e-b507-7f8fe8805ed0 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:53.650158 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:53.679392 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a99edc-315f-479e-b507-7f8fe8805ed0 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:53.688032 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90008ca9-e7ca-43b2-91fd-f174b9bac347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:53.689051 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90008ca9-e7ca-43b2-91fd-f174b9bac347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:53.689958 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90008ca9-e7ca-43b2-91fd-f174b9bac347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:53.690509 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90008ca9-e7ca-43b2-91fd-f174b9bac347 admin admin] PATH_INFO: `/v3/users/0e48715496e84d2c923e1a9c7f0a69b7` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:53.692429 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90008ca9-e7ca-43b2-91fd-f174b9bac347 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e48715496e84d2c923e1a9c7f0a69b7)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:53.695082 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90008ca9-e7ca-43b2-91fd-f174b9bac347 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:53.792129 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-90008ca9-e7ca-43b2-91fd-f174b9bac347 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e48715496e84d2c923e1a9c7f0a69b7'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:53.793388 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-90008ca9-e7ca-43b2-91fd-f174b9bac347 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e48715496e84d2c923e1a9c7f0a69b7'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:53.795162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-90008ca9-e7ca-43b2-91fd-f174b9bac347 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e48715496e84d2c923e1a9c7f0a69b7'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:53.812225 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-90008ca9-e7ca-43b2-91fd-f174b9bac347 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e48715496e84d2c923e1a9c7f0a69b7'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:53.830519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-90008ca9-e7ca-43b2-91fd-f174b9bac347 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e48715496e84d2c923e1a9c7f0a69b7'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:53.869455 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 999/1993] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:56:53 2022] DELETE /identity/v3/users/0e48715496e84d2c923e1a9c7f0a69b7 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:53.872299 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ce2d8-38f3-46d6-af00-a38f3325735b None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:53.872731 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ce2d8-38f3-46d6-af00-a38f3325735b None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:53.872903 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ce2d8-38f3-46d6-af00-a38f3325735b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:53.911369 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-be7ce2d8-38f3-46d6-af00-a38f3325735b None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:53.913527 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-be7ce2d8-38f3-46d6-af00-a38f3325735b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:54.040179 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 995/1994] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:54.051668 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90008ca9-e7ca-43b2-91fd-f174b9bac347 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:54.053309 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-90008ca9-e7ca-43b2-91fd-f174b9bac347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:54.170927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90008ca9-e7ca-43b2-91fd-f174b9bac347 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:54.175332 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b31b8-1025-4c87-ad94-1c58d4a38939 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:54.176587 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b31b8-1025-4c87-ad94-1c58d4a38939 service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:54.176843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b31b8-1025-4c87-ad94-1c58d4a38939 service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:54.177143 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b31b8-1025-4c87-ad94-1c58d4a38939 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:54.190218 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b31b8-1025-4c87-ad94-1c58d4a38939 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:54.193544 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b31b8-1025-4c87-ad94-1c58d4a38939 service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:54.206512 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1000/1995] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:54.598244 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ce2d8-38f3-46d6-af00-a38f3325735b None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:54.599929 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-be7ce2d8-38f3-46d6-af00-a38f3325735b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:54.615157 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ce2d8-38f3-46d6-af00-a38f3325735b None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:54.621504 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654297d-635d-4128-a6e3-f5377a59dd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:54.622153 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654297d-635d-4128-a6e3-f5377a59dd8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:54.622437 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654297d-635d-4128-a6e3-f5377a59dd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:54.622706 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654297d-635d-4128-a6e3-f5377a59dd8d admin admin] PATH_INFO: `/v3/projects/09b362dee3a643c79a873da91d92474d` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:54.623829 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654297d-635d-4128-a6e3-f5377a59dd8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=09b362dee3a643c79a873da91d92474d)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:54.625817 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654297d-635d-4128-a6e3-f5377a59dd8d admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:54.634282 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:54.674806 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-a654297d-635d-4128-a6e3-f5377a59dd8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09b362dee3a643c79a873da91d92474d', 'request_id': 'req-a654297d-635d-4128-a6e3-f5377a59dd8d'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:54.680531 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-a654297d-635d-4128-a6e3-f5377a59dd8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09b362dee3a643c79a873da91d92474d', 'request_id': 'req-a654297d-635d-4128-a6e3-f5377a59dd8d'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:54.688226 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-a654297d-635d-4128-a6e3-f5377a59dd8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09b362dee3a643c79a873da91d92474d', 'request_id': 'req-a654297d-635d-4128-a6e3-f5377a59dd8d'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:54.700343 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-a654297d-635d-4128-a6e3-f5377a59dd8d admin admin] The token cache is being invalidate because project 09b362dee3a643c79a873da91d92474d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:56:54.700629 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-a654297d-635d-4128-a6e3-f5377a59dd8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:54.701301 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-a654297d-635d-4128-a6e3-f5377a59dd8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:54.702785 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 996/1996] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:56:54 2022] DELETE /identity/v3/projects/09b362dee3a643c79a873da91d92474d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:56:54.707037 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b31b8-1025-4c87-ad94-1c58d4a38939 service neutron] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:54.717848 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b31b8-1025-4c87-ad94-1c58d4a38939 service neutron] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:54.774576 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a5a19-c50c-4a0d-aadf-e1f2e76410fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:54.775125 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a5a19-c50c-4a0d-aadf-e1f2e76410fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:54.775406 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a5a19-c50c-4a0d-aadf-e1f2e76410fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:54.775676 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a5a19-c50c-4a0d-aadf-e1f2e76410fc admin admin] PATH_INFO: `/v3/users/9d0f8c7bcc9b4781807917266f4629a2` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:54.777442 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a5a19-c50c-4a0d-aadf-e1f2e76410fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d0f8c7bcc9b4781807917266f4629a2)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:54.779381 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a5a19-c50c-4a0d-aadf-e1f2e76410fc admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:54.785094 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:54.826239 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-fc2a5a19-c50c-4a0d-aadf-e1f2e76410fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d0f8c7bcc9b4781807917266f4629a2'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:54.826877 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-fc2a5a19-c50c-4a0d-aadf-e1f2e76410fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d0f8c7bcc9b4781807917266f4629a2'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:54.827501 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-fc2a5a19-c50c-4a0d-aadf-e1f2e76410fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d0f8c7bcc9b4781807917266f4629a2'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:54.834522 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-fc2a5a19-c50c-4a0d-aadf-e1f2e76410fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d0f8c7bcc9b4781807917266f4629a2'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:54.842672 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-fc2a5a19-c50c-4a0d-aadf-e1f2e76410fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d0f8c7bcc9b4781807917266f4629a2'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:54.860538 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1001/1997] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:56:54 2022] DELETE /identity/v3/users/9d0f8c7bcc9b4781807917266f4629a2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:54.945162 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654297d-635d-4128-a6e3-f5377a59dd8d admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:54.947194 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-a654297d-635d-4128-a6e3-f5377a59dd8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:54.961767 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654297d-635d-4128-a6e3-f5377a59dd8d admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:55.032547 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae7e12-3c2e-434c-a8ea-c8748677e3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:55.033336 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae7e12-3c2e-434c-a8ea-c8748677e3d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:55.033681 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae7e12-3c2e-434c-a8ea-c8748677e3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:55.034048 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae7e12-3c2e-434c-a8ea-c8748677e3d3 admin admin] PATH_INFO: `/v3/users/e0da7aac1606491e8a3989b67d98b0b6` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:55.035428 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae7e12-3c2e-434c-a8ea-c8748677e3d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0da7aac1606491e8a3989b67d98b0b6)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:55.037500 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae7e12-3c2e-434c-a8ea-c8748677e3d3 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:55.085786 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-6dae7e12-3c2e-434c-a8ea-c8748677e3d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0da7aac1606491e8a3989b67d98b0b6'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:55.094044 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-6dae7e12-3c2e-434c-a8ea-c8748677e3d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0da7aac1606491e8a3989b67d98b0b6'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:55.094984 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-6dae7e12-3c2e-434c-a8ea-c8748677e3d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0da7aac1606491e8a3989b67d98b0b6'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:55.095603 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-6dae7e12-3c2e-434c-a8ea-c8748677e3d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0da7aac1606491e8a3989b67d98b0b6'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:55.103055 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-6dae7e12-3c2e-434c-a8ea-c8748677e3d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0da7aac1606491e8a3989b67d98b0b6'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:55.122961 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 997/1998] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:56:54 2022] DELETE /identity/v3/users/e0da7aac1606491e8a3989b67d98b0b6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:56:55.127698 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde16a7-6e17-4d5c-a463-1ce701e7556f None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:55.128090 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde16a7-6e17-4d5c-a463-1ce701e7556f None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:55.128374 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde16a7-6e17-4d5c-a463-1ce701e7556f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:55.142353 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae7e12-3c2e-434c-a8ea-c8748677e3d3 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:55.143810 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-6dae7e12-3c2e-434c-a8ea-c8748677e3d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:55.156531 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-cbde16a7-6e17-4d5c-a463-1ce701e7556f None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:55.160579 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-cbde16a7-6e17-4d5c-a463-1ce701e7556f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:55.168891 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:55.244725 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae7e12-3c2e-434c-a8ea-c8748677e3d3 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:55.250269 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5431e6-3dd8-4bcf-9d12-5bdec79824db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:55.250943 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5431e6-3dd8-4bcf-9d12-5bdec79824db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:55.251259 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5431e6-3dd8-4bcf-9d12-5bdec79824db admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:55.251543 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5431e6-3dd8-4bcf-9d12-5bdec79824db admin admin] PATH_INFO: `/v3/projects/150973e996c3403ebbe6f84b2aed7279` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:55.252798 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5431e6-3dd8-4bcf-9d12-5bdec79824db admin admin] RBAC: Authorizing `identity:delete_project(project_id=150973e996c3403ebbe6f84b2aed7279)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:55.254786 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5431e6-3dd8-4bcf-9d12-5bdec79824db admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:55.255319 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1002/1999] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:55.270133 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde16a7-6e17-4d5c-a463-1ce701e7556f None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:55.271546 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-cbde16a7-6e17-4d5c-a463-1ce701e7556f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:55.349622 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-3d5431e6-3dd8-4bcf-9d12-5bdec79824db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '150973e996c3403ebbe6f84b2aed7279', 'request_id': 'req-3d5431e6-3dd8-4bcf-9d12-5bdec79824db'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:55.361410 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-3d5431e6-3dd8-4bcf-9d12-5bdec79824db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '150973e996c3403ebbe6f84b2aed7279', 'request_id': 'req-3d5431e6-3dd8-4bcf-9d12-5bdec79824db'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:55.385050 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-3d5431e6-3dd8-4bcf-9d12-5bdec79824db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '150973e996c3403ebbe6f84b2aed7279', 'request_id': 'req-3d5431e6-3dd8-4bcf-9d12-5bdec79824db'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:55.404597 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde16a7-6e17-4d5c-a463-1ce701e7556f None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:55.412167 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-3d5431e6-3dd8-4bcf-9d12-5bdec79824db admin admin] The token cache is being invalidate because project 150973e996c3403ebbe6f84b2aed7279 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:56:55.412735 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-3d5431e6-3dd8-4bcf-9d12-5bdec79824db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:55.413857 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-3d5431e6-3dd8-4bcf-9d12-5bdec79824db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:55.416436 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 998/2000] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:56:55 2022] DELETE /identity/v3/projects/150973e996c3403ebbe6f84b2aed7279 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:56:55.421765 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96818f02-a79f-4f04-80a0-3cdaa803dacb None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:55.422067 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96818f02-a79f-4f04-80a0-3cdaa803dacb None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:55.422471 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96818f02-a79f-4f04-80a0-3cdaa803dacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:55.456107 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-96818f02-a79f-4f04-80a0-3cdaa803dacb None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:55.457952 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-96818f02-a79f-4f04-80a0-3cdaa803dacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:55.497370 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:55.517107 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd79b12-85ad-4c39-89f1-65e99185c3b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:55.517807 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd79b12-85ad-4c39-89f1-65e99185c3b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:55.518087 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd79b12-85ad-4c39-89f1-65e99185c3b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:55.518357 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd79b12-85ad-4c39-89f1-65e99185c3b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:55.522754 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-9cd79b12-85ad-4c39-89f1-65e99185c3b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:55.613334 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 999/2001] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:55.622845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96b7bf-858f-4470-97ba-170b0f3a2afd None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:55.623537 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96b7bf-858f-4470-97ba-170b0f3a2afd None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:55.624355 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96b7bf-858f-4470-97ba-170b0f3a2afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:55.689182 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-5b96b7bf-858f-4470-97ba-170b0f3a2afd None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:55.692955 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-5b96b7bf-858f-4470-97ba-170b0f3a2afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:55.711433 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1000/2002] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:56:55.719284 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96b7bf-858f-4470-97ba-170b0f3a2afd None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:55.735133 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96b7bf-858f-4470-97ba-170b0f3a2afd None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:55.741269 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd79b12-85ad-4c39-89f1-65e99185c3b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:55.742836 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289d835-7cb3-4f09-b9a1-0d75cb1d5e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:55.743486 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289d835-7cb3-4f09-b9a1-0d75cb1d5e6c admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:55.743774 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289d835-7cb3-4f09-b9a1-0d75cb1d5e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:55.744045 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289d835-7cb3-4f09-b9a1-0d75cb1d5e6c admin admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:55.745528 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd79b12-85ad-4c39-89f1-65e99185c3b5 service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:55.748401 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289d835-7cb3-4f09-b9a1-0d75cb1d5e6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:56:55.748401 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289d835-7cb3-4f09-b9a1-0d75cb1d5e6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:55.748401 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289d835-7cb3-4f09-b9a1-0d75cb1d5e6c admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:55.771162 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1001/2003] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:56:55.776564 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1003/2004] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:55.776702 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289d835-7cb3-4f09-b9a1-0d75cb1d5e6c admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:55.797033 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289d835-7cb3-4f09-b9a1-0d75cb1d5e6c admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:55.810202 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62356195-db9b-49e3-a8e2-b521f572b28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:55.810948 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62356195-db9b-49e3-a8e2-b521f572b28c admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:55.811327 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62356195-db9b-49e3-a8e2-b521f572b28c admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:55.811727 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62356195-db9b-49e3-a8e2-b521f572b28c admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:55.812492 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62356195-db9b-49e3-a8e2-b521f572b28c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:55.814617 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62356195-db9b-49e3-a8e2-b521f572b28c admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:55.851817 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1002/2005] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:56:55 2022] POST /identity/v3/projects => generated 369 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:55.852979 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd79b12-85ad-4c39-89f1-65e99185c3b5 service neutron] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:55.863875 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd79b12-85ad-4c39-89f1-65e99185c3b5 service neutron] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:55.948167 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3dc254-d50c-4bcb-85f3-ad854f4d0af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:55.949951 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3dc254-d50c-4bcb-85f3-ad854f4d0af5 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:55.950422 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3dc254-d50c-4bcb-85f3-ad854f4d0af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:55.950830 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3dc254-d50c-4bcb-85f3-ad854f4d0af5 admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:55.951775 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3dc254-d50c-4bcb-85f3-ad854f4d0af5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:55.954740 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3dc254-d50c-4bcb-85f3-ad854f4d0af5 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:55.988086 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1004/2006] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:56:55 2022] POST /identity/v3/users => generated 285 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 17:56:55.998097 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62356195-db9b-49e3-a8e2-b521f572b28c admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:56.014200 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:56.024477 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62356195-db9b-49e3-a8e2-b521f572b28c admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:56.039832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69981e10-e64c-4c08-857c-60de399f47d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:56.039832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69981e10-e64c-4c08-857c-60de399f47d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:56.039832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69981e10-e64c-4c08-857c-60de399f47d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:56.039832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69981e10-e64c-4c08-857c-60de399f47d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:56.041022 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69981e10-e64c-4c08-857c-60de399f47d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:56.044055 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69981e10-e64c-4c08-857c-60de399f47d5 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:56.060616 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1003/2007] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:56:56.064390 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3dc254-d50c-4bcb-85f3-ad854f4d0af5 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:56.076323 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3dc254-d50c-4bcb-85f3-ad854f4d0af5 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:56.082125 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b7d58-f350-4015-9176-73ac33db56be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:56.082929 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b7d58-f350-4015-9176-73ac33db56be admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:56.083308 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b7d58-f350-4015-9176-73ac33db56be admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:56.083683 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b7d58-f350-4015-9176-73ac33db56be admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:56.084470 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b7d58-f350-4015-9176-73ac33db56be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:56.086485 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b7d58-f350-4015-9176-73ac33db56be admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:56.098514 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1005/2008] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:56:56.102867 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69981e10-e64c-4c08-857c-60de399f47d5 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:56.115376 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69981e10-e64c-4c08-857c-60de399f47d5 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:56.121705 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc13446-497a-4384-a2c5-42dc5358c132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:56.122583 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc13446-497a-4384-a2c5-42dc5358c132 admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:56.123494 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc13446-497a-4384-a2c5-42dc5358c132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:56.123494 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc13446-497a-4384-a2c5-42dc5358c132 admin admin] PATH_INFO: `/v3/projects/8d1248d01df94a6597ffc3c890e835e0/users/a461e3ea6ea54ca8a046c47b7f79a47d/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:56.152329 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc13446-497a-4384-a2c5-42dc5358c132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d1248d01df94a6597ffc3c890e835e0, user_id=a461e3ea6ea54ca8a046c47b7f79a47d, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:56.158497 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc13446-497a-4384-a2c5-42dc5358c132 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:56.186375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1004/2009] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:56:56 2022] PUT /identity/v3/projects/8d1248d01df94a6597ffc3c890e835e0/users/a461e3ea6ea54ca8a046c47b7f79a47d/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:56.214855 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b233267-049b-4b89-99bc-c53df2084122 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:56.215155 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b233267-049b-4b89-99bc-c53df2084122 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:56.216313 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b233267-049b-4b89-99bc-c53df2084122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:56.251419 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-8b233267-049b-4b89-99bc-c53df2084122 None None] MFA Rules not processed for user `a461e3ea6ea54ca8a046c47b7f79a47d`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:56.252865 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-8b233267-049b-4b89-99bc-c53df2084122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:56.326995 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:56.331428 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1006/2010] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:56.344055 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc13446-497a-4384-a2c5-42dc5358c132 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:56.345834 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-4bc13446-497a-4384-a2c5-42dc5358c132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:56.406022 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b233267-049b-4b89-99bc-c53df2084122 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:56.407563 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-8b233267-049b-4b89-99bc-c53df2084122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:56.408766 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc13446-497a-4384-a2c5-42dc5358c132 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:56.413928 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632cf80-8252-45bf-9f2f-a08465ea6442 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab3b7ac09599477bb0c6c1d32e2d5dbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:56.414570 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632cf80-8252-45bf-9f2f-a08465ea6442 service glance] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:56.414852 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632cf80-8252-45bf-9f2f-a08465ea6442 service glance] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:56.415124 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632cf80-8252-45bf-9f2f-a08465ea6442 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:56.426620 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632cf80-8252-45bf-9f2f-a08465ea6442 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:56.428063 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632cf80-8252-45bf-9f2f-a08465ea6442 service glance] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:56.438548 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1005/2011] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:56 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:56.501804 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b233267-049b-4b89-99bc-c53df2084122 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:56.506432 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac31f3-eb31-45e8-8ae5-6c77b0ee03bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:56.507059 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac31f3-eb31-45e8-8ae5-6c77b0ee03bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:56.507339 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac31f3-eb31-45e8-8ae5-6c77b0ee03bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:56.507613 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac31f3-eb31-45e8-8ae5-6c77b0ee03bb admin admin] PATH_INFO: `/v3/projects/b0d91ad8b7e6430ba31fb7e934076890` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:56.508773 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac31f3-eb31-45e8-8ae5-6c77b0ee03bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0d91ad8b7e6430ba31fb7e934076890)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:56.511263 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac31f3-eb31-45e8-8ae5-6c77b0ee03bb admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:56.564725 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-6dac31f3-eb31-45e8-8ae5-6c77b0ee03bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0d91ad8b7e6430ba31fb7e934076890', 'request_id': 'req-6dac31f3-eb31-45e8-8ae5-6c77b0ee03bb'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:56.575660 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-6dac31f3-eb31-45e8-8ae5-6c77b0ee03bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0d91ad8b7e6430ba31fb7e934076890', 'request_id': 'req-6dac31f3-eb31-45e8-8ae5-6c77b0ee03bb'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:56.585264 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-6dac31f3-eb31-45e8-8ae5-6c77b0ee03bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0d91ad8b7e6430ba31fb7e934076890', 'request_id': 'req-6dac31f3-eb31-45e8-8ae5-6c77b0ee03bb'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:56.603324 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-6dac31f3-eb31-45e8-8ae5-6c77b0ee03bb admin admin] The token cache is being invalidate because project b0d91ad8b7e6430ba31fb7e934076890 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:56:56.603616 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-6dac31f3-eb31-45e8-8ae5-6c77b0ee03bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:56.604327 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-6dac31f3-eb31-45e8-8ae5-6c77b0ee03bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:56.606089 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1007/2012] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:56:56 2022] DELETE /identity/v3/projects/b0d91ad8b7e6430ba31fb7e934076890 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:56:56.611107 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb698e-2a60-4a11-a387-032751a79d45 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:56.611399 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb698e-2a60-4a11-a387-032751a79d45 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:56.611698 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb698e-2a60-4a11-a387-032751a79d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:56.640380 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-9cbb698e-2a60-4a11-a387-032751a79d45 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:56.641624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-9cbb698e-2a60-4a11-a387-032751a79d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:56.733443 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1006/2013] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:56.741318 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cc5d4-eee7-4ae9-aebe-2fba7b3261c1 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:56.741831 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cc5d4-eee7-4ae9-aebe-2fba7b3261c1 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:56.741960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cc5d4-eee7-4ae9-aebe-2fba7b3261c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:56.813594 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-be7cc5d4-eee7-4ae9-aebe-2fba7b3261c1 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:56.817112 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-be7cc5d4-eee7-4ae9-aebe-2fba7b3261c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:56.847728 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1008/2014] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:56.847951 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb698e-2a60-4a11-a387-032751a79d45 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:56.860366 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb698e-2a60-4a11-a387-032751a79d45 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:56.865277 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ec3ea-b005-4489-9bf5-232eee21b823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:56.865897 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ec3ea-b005-4489-9bf5-232eee21b823 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:56.866173 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ec3ea-b005-4489-9bf5-232eee21b823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:56.866442 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ec3ea-b005-4489-9bf5-232eee21b823 admin admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:56.867085 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ec3ea-b005-4489-9bf5-232eee21b823 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:56:56.867569 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ec3ea-b005-4489-9bf5-232eee21b823 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:56.869069 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ec3ea-b005-4489-9bf5-232eee21b823 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:56.887581 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1007/2015] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:56:56.888730 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cc5d4-eee7-4ae9-aebe-2fba7b3261c1 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:56.900317 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cc5d4-eee7-4ae9-aebe-2fba7b3261c1 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:56.906132 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44716fab-e272-49d7-a366-2447121db5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:56.906742 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44716fab-e272-49d7-a366-2447121db5bd admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:56.907069 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44716fab-e272-49d7-a366-2447121db5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:56.907342 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44716fab-e272-49d7-a366-2447121db5bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:56.908014 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44716fab-e272-49d7-a366-2447121db5bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:56.909947 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44716fab-e272-49d7-a366-2447121db5bd admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:56.949756 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1009/2016] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:56:56 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 17:56:56.953706 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ec3ea-b005-4489-9bf5-232eee21b823 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:56.966017 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ec3ea-b005-4489-9bf5-232eee21b823 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:57.073500 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dbe59e-1287-45d4-a426-b02cc4761807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:57.076966 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbe59e-1287-45d4-a426-b02cc4761807 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:57.077381 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbe59e-1287-45d4-a426-b02cc4761807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:57.077745 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbe59e-1287-45d4-a426-b02cc4761807 admin admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:57.088222 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dbe59e-1287-45d4-a426-b02cc4761807 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:57.090534 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dbe59e-1287-45d4-a426-b02cc4761807 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:57.121296 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:57.158954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1008/2017] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:56:56 2022] POST /identity/v3/users => generated 292 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:57.161162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44716fab-e272-49d7-a366-2447121db5bd admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:57.176116 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44716fab-e272-49d7-a366-2447121db5bd admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:57.182670 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b1972-13aa-460b-a74c-232112cc5cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:57.183647 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b1972-13aa-460b-a74c-232112cc5cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:57.183994 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b1972-13aa-460b-a74c-232112cc5cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:57.184419 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b1972-13aa-460b-a74c-232112cc5cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:57.185186 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b1972-13aa-460b-a74c-232112cc5cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:57.187141 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b1972-13aa-460b-a74c-232112cc5cc5 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:57.215124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1010/2018] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:56:57.220894 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dbe59e-1287-45d4-a426-b02cc4761807 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:57.223790 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b1972-13aa-460b-a74c-232112cc5cc5 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:57.225591 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-418b1972-13aa-460b-a74c-232112cc5cc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:57.243576 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dbe59e-1287-45d4-a426-b02cc4761807 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:57.249796 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd7550-dc45-41b5-a11f-63c3818a3d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:57.250197 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b1972-13aa-460b-a74c-232112cc5cc5 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:57.250443 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd7550-dc45-41b5-a11f-63c3818a3d38 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:57.250782 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd7550-dc45-41b5-a11f-63c3818a3d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:57.251060 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd7550-dc45-41b5-a11f-63c3818a3d38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:57.251718 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bd7550-dc45-41b5-a11f-63c3818a3d38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:57.254172 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bd7550-dc45-41b5-a11f-63c3818a3d38 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:57.256934 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee21bf4-60d9-4c86-b2de-4c3f77e42465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:57.257779 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee21bf4-60d9-4c86-b2de-4c3f77e42465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:57.258129 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee21bf4-60d9-4c86-b2de-4c3f77e42465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:57.258495 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee21bf4-60d9-4c86-b2de-4c3f77e42465 admin admin] PATH_INFO: `/v3/users/f430a85a5d2641d8af60ca29330f1e58` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:57.259866 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee21bf4-60d9-4c86-b2de-4c3f77e42465 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f430a85a5d2641d8af60ca29330f1e58)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:57.262701 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee21bf4-60d9-4c86-b2de-4c3f77e42465 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:57.270107 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1009/2019] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:56:57.274616 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd7550-dc45-41b5-a11f-63c3818a3d38 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:57.294781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd7550-dc45-41b5-a11f-63c3818a3d38 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:57.300570 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23895429-dd52-4d16-b36c-aeb6694a1b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:57.302010 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23895429-dd52-4d16-b36c-aeb6694a1b2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:57.302010 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23895429-dd52-4d16-b36c-aeb6694a1b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:57.302010 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23895429-dd52-4d16-b36c-aeb6694a1b2c admin admin] PATH_INFO: `/v3/projects/5dc410190e7f4f42a5fba8a9c257a222/users/557aa0bb43984f198fdf56178eab42b3/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:57.318890 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23895429-dd52-4d16-b36c-aeb6694a1b2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dc410190e7f4f42a5fba8a9c257a222, user_id=557aa0bb43984f198fdf56178eab42b3, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:57.321618 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23895429-dd52-4d16-b36c-aeb6694a1b2c admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:57.330914 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:57.333676 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-4ee21bf4-60d9-4c86-b2de-4c3f77e42465 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f430a85a5d2641d8af60ca29330f1e58'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:57.334835 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-4ee21bf4-60d9-4c86-b2de-4c3f77e42465 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f430a85a5d2641d8af60ca29330f1e58'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:57.336675 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-4ee21bf4-60d9-4c86-b2de-4c3f77e42465 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f430a85a5d2641d8af60ca29330f1e58'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:57.340542 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1010/2020] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:56:57 2022] PUT /identity/v3/projects/5dc410190e7f4f42a5fba8a9c257a222/users/557aa0bb43984f198fdf56178eab42b3/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:56:57.353667 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79bcdc-aa82-4563-b131-a47c70d0cba0 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:57.354550 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79bcdc-aa82-4563-b131-a47c70d0cba0 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:57.354831 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79bcdc-aa82-4563-b131-a47c70d0cba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:57.364768 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-4ee21bf4-60d9-4c86-b2de-4c3f77e42465 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f430a85a5d2641d8af60ca29330f1e58'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:57.385950 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-4ee21bf4-60d9-4c86-b2de-4c3f77e42465 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f430a85a5d2641d8af60ca29330f1e58'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:57.403443 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-cf79bcdc-aa82-4563-b131-a47c70d0cba0 None None] MFA Rules not processed for user `557aa0bb43984f198fdf56178eab42b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:57.404980 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-cf79bcdc-aa82-4563-b131-a47c70d0cba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:57.421034 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1011/2021] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:56:57 2022] DELETE /identity/v3/users/f430a85a5d2641d8af60ca29330f1e58 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:57.422986 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e859c47-0ec9-4ac7-838d-9fcee5f60f08 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:57.423427 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e859c47-0ec9-4ac7-838d-9fcee5f60f08 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:57.423882 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e859c47-0ec9-4ac7-838d-9fcee5f60f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:57.446669 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-6e859c47-0ec9-4ac7-838d-9fcee5f60f08 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:57.448206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-6e859c47-0ec9-4ac7-838d-9fcee5f60f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:57.519509 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1011/2022] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:56:57.534120 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79bcdc-aa82-4563-b131-a47c70d0cba0 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:57.539784 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-cf79bcdc-aa82-4563-b131-a47c70d0cba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:57.543353 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1012/2023] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:56:57.553687 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e859c47-0ec9-4ac7-838d-9fcee5f60f08 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:57.555880 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-6e859c47-0ec9-4ac7-838d-9fcee5f60f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:57.621978 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79bcdc-aa82-4563-b131-a47c70d0cba0 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:57.624666 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e859c47-0ec9-4ac7-838d-9fcee5f60f08 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:57.629654 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f01535-40d9-41ad-ad03-f9a9a514c738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:57.630338 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f01535-40d9-41ad-ad03-f9a9a514c738 service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:57.630686 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f01535-40d9-41ad-ad03-f9a9a514c738 service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:57.631024 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f01535-40d9-41ad-ad03-f9a9a514c738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:57.641115 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f01535-40d9-41ad-ad03-f9a9a514c738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:57.642809 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f01535-40d9-41ad-ad03-f9a9a514c738 service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:57.655470 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1013/2024] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:57.677683 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b32ed1-cc4b-434f-9d8b-9ac28ff49529 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:57.678634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b32ed1-cc4b-434f-9d8b-9ac28ff49529 service cinder] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:57.678920 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b32ed1-cc4b-434f-9d8b-9ac28ff49529 service cinder] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:57.679214 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b32ed1-cc4b-434f-9d8b-9ac28ff49529 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:57.698955 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:57.749535 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b32ed1-cc4b-434f-9d8b-9ac28ff49529 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:57.751216 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b32ed1-cc4b-434f-9d8b-9ac28ff49529 service cinder] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:57.760902 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1012/2025] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:57.965243 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f01535-40d9-41ad-ad03-f9a9a514c738 service neutron] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:57.966762 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-c6f01535-40d9-41ad-ad03-f9a9a514c738 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:57.983922 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f01535-40d9-41ad-ad03-f9a9a514c738 service neutron] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:57.991316 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec9db3-ec42-4172-8aa3-6de8b5632b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:57.992075 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec9db3-ec42-4172-8aa3-6de8b5632b21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:57.992423 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec9db3-ec42-4172-8aa3-6de8b5632b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:57.992781 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec9db3-ec42-4172-8aa3-6de8b5632b21 admin admin] PATH_INFO: `/v3/projects/1cc2171f9ea541dfad7f370acdabf084` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:57.994425 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec9db3-ec42-4172-8aa3-6de8b5632b21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cc2171f9ea541dfad7f370acdabf084)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:57.996437 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec9db3-ec42-4172-8aa3-6de8b5632b21 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:58.084490 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-efec9db3-ec42-4172-8aa3-6de8b5632b21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cc2171f9ea541dfad7f370acdabf084', 'request_id': 'req-efec9db3-ec42-4172-8aa3-6de8b5632b21'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:58.099543 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-efec9db3-ec42-4172-8aa3-6de8b5632b21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cc2171f9ea541dfad7f370acdabf084', 'request_id': 'req-efec9db3-ec42-4172-8aa3-6de8b5632b21'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:58.108732 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:58.126023 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-efec9db3-ec42-4172-8aa3-6de8b5632b21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cc2171f9ea541dfad7f370acdabf084', 'request_id': 'req-efec9db3-ec42-4172-8aa3-6de8b5632b21'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:58.138960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-efec9db3-ec42-4172-8aa3-6de8b5632b21 admin admin] The token cache is being invalidate because project 1cc2171f9ea541dfad7f370acdabf084 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:56:58.139571 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-efec9db3-ec42-4172-8aa3-6de8b5632b21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:58.147215 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-efec9db3-ec42-4172-8aa3-6de8b5632b21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:58.152678 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1014/2026] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:56:57 2022] DELETE /identity/v3/projects/1cc2171f9ea541dfad7f370acdabf084 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:58.156651 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b32ed1-cc4b-434f-9d8b-9ac28ff49529 service cinder] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:58.182865 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b32ed1-cc4b-434f-9d8b-9ac28ff49529 service cinder] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:58.276540 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16efd89-f4ed-4739-a785-d2cda4aa326f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:58.277322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16efd89-f4ed-4739-a785-d2cda4aa326f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:58.277675 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16efd89-f4ed-4739-a785-d2cda4aa326f admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:58.278017 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16efd89-f4ed-4739-a785-d2cda4aa326f admin admin] PATH_INFO: `/v3/users/adf456e27a8241a69900241f6d14a9c3` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:58.279628 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16efd89-f4ed-4739-a785-d2cda4aa326f admin admin] RBAC: Authorizing `identity:delete_user(user_id=adf456e27a8241a69900241f6d14a9c3)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:58.281674 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16efd89-f4ed-4739-a785-d2cda4aa326f admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:58.331216 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-e16efd89-f4ed-4739-a785-d2cda4aa326f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adf456e27a8241a69900241f6d14a9c3'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:58.340049 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-e16efd89-f4ed-4739-a785-d2cda4aa326f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adf456e27a8241a69900241f6d14a9c3'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:58.340718 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-e16efd89-f4ed-4739-a785-d2cda4aa326f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adf456e27a8241a69900241f6d14a9c3'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:58.341430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-e16efd89-f4ed-4739-a785-d2cda4aa326f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adf456e27a8241a69900241f6d14a9c3'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:58.348753 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-e16efd89-f4ed-4739-a785-d2cda4aa326f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adf456e27a8241a69900241f6d14a9c3'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:58.366882 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1013/2027] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:56:58 2022] DELETE /identity/v3/users/adf456e27a8241a69900241f6d14a9c3 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:58.658122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec9db3-ec42-4172-8aa3-6de8b5632b21 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:58.659705 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-efec9db3-ec42-4172-8aa3-6de8b5632b21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:58.688320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec9db3-ec42-4172-8aa3-6de8b5632b21 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:58.767212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4bdc9-2910-40bc-b325-bd6c06daa81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:58.767847 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4bdc9-2910-40bc-b325-bd6c06daa81f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:58.768123 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4bdc9-2910-40bc-b325-bd6c06daa81f admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:58.768424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4bdc9-2910-40bc-b325-bd6c06daa81f admin admin] PATH_INFO: `/v3/projects/1a2c85cc524b48118028bebaa4e06eec` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:58.769601 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4bdc9-2910-40bc-b325-bd6c06daa81f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a2c85cc524b48118028bebaa4e06eec)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:58.771588 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4bdc9-2910-40bc-b325-bd6c06daa81f admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:58.826333 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-6fe4bdc9-2910-40bc-b325-bd6c06daa81f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a2c85cc524b48118028bebaa4e06eec', 'request_id': 'req-6fe4bdc9-2910-40bc-b325-bd6c06daa81f'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:58.832798 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-6fe4bdc9-2910-40bc-b325-bd6c06daa81f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a2c85cc524b48118028bebaa4e06eec', 'request_id': 'req-6fe4bdc9-2910-40bc-b325-bd6c06daa81f'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:58.841488 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-6fe4bdc9-2910-40bc-b325-bd6c06daa81f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a2c85cc524b48118028bebaa4e06eec', 'request_id': 'req-6fe4bdc9-2910-40bc-b325-bd6c06daa81f'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:58.853672 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-6fe4bdc9-2910-40bc-b325-bd6c06daa81f admin admin] The token cache is being invalidate because project 1a2c85cc524b48118028bebaa4e06eec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:56:58.854008 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-6fe4bdc9-2910-40bc-b325-bd6c06daa81f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:58.854725 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-6fe4bdc9-2910-40bc-b325-bd6c06daa81f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:58.856213 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1015/2028] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:56:58 2022] DELETE /identity/v3/projects/1a2c85cc524b48118028bebaa4e06eec => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:56:58.862033 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f1823-8107-4fba-a651-42cc29dc21d1 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:58.862319 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f1823-8107-4fba-a651-42cc29dc21d1 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:58.862592 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f1823-8107-4fba-a651-42cc29dc21d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:58.882774 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-014f1823-8107-4fba-a651-42cc29dc21d1 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:58.883985 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-014f1823-8107-4fba-a651-42cc29dc21d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:58.915035 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:58.951674 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1014/2029] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:58.959513 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd875b5-7e65-4bfe-b49e-7ea40b326c27 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:58.960041 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd875b5-7e65-4bfe-b49e-7ea40b326c27 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:58.960326 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd875b5-7e65-4bfe-b49e-7ea40b326c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:58.984456 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-6fd875b5-7e65-4bfe-b49e-7ea40b326c27 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:58.986097 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-6fd875b5-7e65-4bfe-b49e-7ea40b326c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:59.006422 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1016/2030] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:59.010875 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f1823-8107-4fba-a651-42cc29dc21d1 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:59.022877 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f1823-8107-4fba-a651-42cc29dc21d1 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:59.028458 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651a76a-b7b6-4e0a-905e-5b938fa7b7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:59.029179 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651a76a-b7b6-4e0a-905e-5b938fa7b7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:59.029451 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651a76a-b7b6-4e0a-905e-5b938fa7b7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:59.029714 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651a76a-b7b6-4e0a-905e-5b938fa7b7d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:59.030365 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651a76a-b7b6-4e0a-905e-5b938fa7b7d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:56:59.030660 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651a76a-b7b6-4e0a-905e-5b938fa7b7d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:59.032253 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651a76a-b7b6-4e0a-905e-5b938fa7b7d0 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:59.044224 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1015/2031] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:56:59.048556 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd875b5-7e65-4bfe-b49e-7ea40b326c27 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:59.057887 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd875b5-7e65-4bfe-b49e-7ea40b326c27 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:59.062468 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a60a5-0ed2-4cc2-b9bb-ba5b58494872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:59.063060 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a60a5-0ed2-4cc2-b9bb-ba5b58494872 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:59.063333 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a60a5-0ed2-4cc2-b9bb-ba5b58494872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:59.063601 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a60a5-0ed2-4cc2-b9bb-ba5b58494872 admin admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:59.064244 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a60a5-0ed2-4cc2-b9bb-ba5b58494872 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:59.066169 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a60a5-0ed2-4cc2-b9bb-ba5b58494872 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:59.098081 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1017/2032] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:56:59 2022] POST /identity/v3/projects => generated 359 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:59.102065 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651a76a-b7b6-4e0a-905e-5b938fa7b7d0 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:59.112123 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651a76a-b7b6-4e0a-905e-5b938fa7b7d0 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:59.174218 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294c929-33b4-46c7-9bac-8585e54a3435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:59.174836 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294c929-33b4-46c7-9bac-8585e54a3435 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:59.175116 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294c929-33b4-46c7-9bac-8585e54a3435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:59.175388 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294c929-33b4-46c7-9bac-8585e54a3435 admin admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:59.176199 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0294c929-33b4-46c7-9bac-8585e54a3435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:59.178558 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0294c929-33b4-46c7-9bac-8585e54a3435 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:59.206564 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1016/2033] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:56:59 2022] POST /identity/v3/users => generated 280 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:56:59.207999 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a60a5-0ed2-4cc2-b9bb-ba5b58494872 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:59.218490 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a60a5-0ed2-4cc2-b9bb-ba5b58494872 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:59.224238 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453316dd-3e35-468a-90f1-5c69d3f95ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:59.225334 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453316dd-3e35-468a-90f1-5c69d3f95ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:59.225616 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453316dd-3e35-468a-90f1-5c69d3f95ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:59.225885 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453316dd-3e35-468a-90f1-5c69d3f95ea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:59.226543 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453316dd-3e35-468a-90f1-5c69d3f95ea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:59.228304 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453316dd-3e35-468a-90f1-5c69d3f95ea3 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:59.240414 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1018/2034] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 17:56:59.245140 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294c929-33b4-46c7-9bac-8585e54a3435 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:59.258566 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294c929-33b4-46c7-9bac-8585e54a3435 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:59.265697 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b100c51-b3ff-445b-9d4d-a3f1e25e5c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:59.266318 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b100c51-b3ff-445b-9d4d-a3f1e25e5c51 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:59.266598 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b100c51-b3ff-445b-9d4d-a3f1e25e5c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:59.266871 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b100c51-b3ff-445b-9d4d-a3f1e25e5c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:59.267548 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b100c51-b3ff-445b-9d4d-a3f1e25e5c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:59.269246 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b100c51-b3ff-445b-9d4d-a3f1e25e5c51 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:59.280885 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1017/2035] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 17:56:59.285032 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453316dd-3e35-468a-90f1-5c69d3f95ea3 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:59.295312 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453316dd-3e35-468a-90f1-5c69d3f95ea3 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:59.302180 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185929a-3ef4-4157-9862-280c83303ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:59.302998 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185929a-3ef4-4157-9862-280c83303ab2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:59.303279 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185929a-3ef4-4157-9862-280c83303ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:59.303550 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185929a-3ef4-4157-9862-280c83303ab2 admin admin] PATH_INFO: `/v3/projects/ecbe1585260a498f9ceb84c70db73ba4/users/fb0572ad3ab34db18d2b92fcc8e6ea34/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:59.319815 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d185929a-3ef4-4157-9862-280c83303ab2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecbe1585260a498f9ceb84c70db73ba4, user_id=fb0572ad3ab34db18d2b92fcc8e6ea34, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:59.323126 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d185929a-3ef4-4157-9862-280c83303ab2 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:59.337327 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1019/2036] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:56:59 2022] PUT /identity/v3/projects/ecbe1585260a498f9ceb84c70db73ba4/users/fb0572ad3ab34db18d2b92fcc8e6ea34/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:59.351543 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5b560-c15d-4c5d-9119-7874269b989d None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:59.351864 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5b560-c15d-4c5d-9119-7874269b989d None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:59.352238 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5b560-c15d-4c5d-9119-7874269b989d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:59.385000 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-17c5b560-c15d-4c5d-9119-7874269b989d None None] MFA Rules not processed for user `fb0572ad3ab34db18d2b92fcc8e6ea34`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:59.385999 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-17c5b560-c15d-4c5d-9119-7874269b989d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:59.468817 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1018/2037] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:59 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:59.505330 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185929a-3ef4-4157-9862-280c83303ab2 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:59.506973 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-d185929a-3ef4-4157-9862-280c83303ab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:59.528083 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:59.571628 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185929a-3ef4-4157-9862-280c83303ab2 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:59.575926 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1af6d-fb89-4f11-b47d-3bbe25ec8ccb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:59.576589 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1af6d-fb89-4f11-b47d-3bbe25ec8ccb service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:59.576901 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1af6d-fb89-4f11-b47d-3bbe25ec8ccb service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:59.577208 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1af6d-fb89-4f11-b47d-3bbe25ec8ccb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:59.587435 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1af6d-fb89-4f11-b47d-3bbe25ec8ccb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:59.589583 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1af6d-fb89-4f11-b47d-3bbe25ec8ccb service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:59.599390 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1020/2038] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:59 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:56:59.614918 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5b560-c15d-4c5d-9119-7874269b989d None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:59.647714 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:56:59.688664 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5b560-c15d-4c5d-9119-7874269b989d None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:56:59.693653 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670cb3c0-56c2-4b7d-85d6-c2429d9bf3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:56:59.694323 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670cb3c0-56c2-4b7d-85d6-c2429d9bf3b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:59.694605 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670cb3c0-56c2-4b7d-85d6-c2429d9bf3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:59.695009 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670cb3c0-56c2-4b7d-85d6-c2429d9bf3b7 admin admin] PATH_INFO: `/v3/users/fb0572ad3ab34db18d2b92fcc8e6ea34` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:59.696171 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670cb3c0-56c2-4b7d-85d6-c2429d9bf3b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb0572ad3ab34db18d2b92fcc8e6ea34)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:56:59.698674 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670cb3c0-56c2-4b7d-85d6-c2429d9bf3b7 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:56:59.747097 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-670cb3c0-56c2-4b7d-85d6-c2429d9bf3b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb0572ad3ab34db18d2b92fcc8e6ea34'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:59.754429 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-670cb3c0-56c2-4b7d-85d6-c2429d9bf3b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb0572ad3ab34db18d2b92fcc8e6ea34'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:59.755071 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-670cb3c0-56c2-4b7d-85d6-c2429d9bf3b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb0572ad3ab34db18d2b92fcc8e6ea34'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:59.755695 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-670cb3c0-56c2-4b7d-85d6-c2429d9bf3b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb0572ad3ab34db18d2b92fcc8e6ea34'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:59.768477 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-670cb3c0-56c2-4b7d-85d6-c2429d9bf3b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb0572ad3ab34db18d2b92fcc8e6ea34'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:56:59.809388 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1019/2039] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:56:59 2022] DELETE /identity/v3/users/fb0572ad3ab34db18d2b92fcc8e6ea34 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:56:59.811500 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e6957-9717-454b-b5d2-8213992434ad None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:56:59.812131 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e6957-9717-454b-b5d2-8213992434ad None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:56:59.812480 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e6957-9717-454b-b5d2-8213992434ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:56:59.863114 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-472e6957-9717-454b-b5d2-8213992434ad None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:56:59.865137 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-472e6957-9717-454b-b5d2-8213992434ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:56:59.950953 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1021/2040] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:56:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:56:59.969674 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670cb3c0-56c2-4b7d-85d6-c2429d9bf3b7 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:56:59.971314 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-670cb3c0-56c2-4b7d-85d6-c2429d9bf3b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:00.037482 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670cb3c0-56c2-4b7d-85d6-c2429d9bf3b7 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:00.042905 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c93cb-2cd2-41ec-b4f9-eb8bdc20de9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:00.043693 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c93cb-2cd2-41ec-b4f9-eb8bdc20de9e service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:00.044136 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c93cb-2cd2-41ec-b4f9-eb8bdc20de9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:00.044390 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c93cb-2cd2-41ec-b4f9-eb8bdc20de9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:00.054872 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c93cb-2cd2-41ec-b4f9-eb8bdc20de9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:00.056315 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c93cb-2cd2-41ec-b4f9-eb8bdc20de9e service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:00.066475 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1020/2041] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:56:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:57:00.364420 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e6957-9717-454b-b5d2-8213992434ad None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:00.365910 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-472e6957-9717-454b-b5d2-8213992434ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:00.379097 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e6957-9717-454b-b5d2-8213992434ad None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:00.383933 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea40bf-1c78-4e84-97b2-d7764a800566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:00.384578 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea40bf-1c78-4e84-97b2-d7764a800566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:00.384860 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea40bf-1c78-4e84-97b2-d7764a800566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:00.385168 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea40bf-1c78-4e84-97b2-d7764a800566 admin admin] PATH_INFO: `/v3/projects/ecbe1585260a498f9ceb84c70db73ba4` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:00.386307 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea40bf-1c78-4e84-97b2-d7764a800566 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecbe1585260a498f9ceb84c70db73ba4)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:00.389057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea40bf-1c78-4e84-97b2-d7764a800566 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:00.438208 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-29ea40bf-1c78-4e84-97b2-d7764a800566 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecbe1585260a498f9ceb84c70db73ba4', 'request_id': 'req-29ea40bf-1c78-4e84-97b2-d7764a800566'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:00.443731 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-29ea40bf-1c78-4e84-97b2-d7764a800566 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecbe1585260a498f9ceb84c70db73ba4', 'request_id': 'req-29ea40bf-1c78-4e84-97b2-d7764a800566'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:00.451532 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-29ea40bf-1c78-4e84-97b2-d7764a800566 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecbe1585260a498f9ceb84c70db73ba4', 'request_id': 'req-29ea40bf-1c78-4e84-97b2-d7764a800566'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:00.463178 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-29ea40bf-1c78-4e84-97b2-d7764a800566 admin admin] The token cache is being invalidate because project ecbe1585260a498f9ceb84c70db73ba4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:57:00.463393 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-29ea40bf-1c78-4e84-97b2-d7764a800566 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:00.464038 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-29ea40bf-1c78-4e84-97b2-d7764a800566 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:00.465553 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1022/2042] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:57:00 2022] DELETE /identity/v3/projects/ecbe1585260a498f9ceb84c70db73ba4 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:00.470332 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464112c-531c-42ae-a0ff-0a55849b85bf None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:00.470824 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464112c-531c-42ae-a0ff-0a55849b85bf None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:00.471113 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464112c-531c-42ae-a0ff-0a55849b85bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:00.508591 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-d464112c-531c-42ae-a0ff-0a55849b85bf None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:00.510909 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-d464112c-531c-42ae-a0ff-0a55849b85bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:00.594518 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:00.612040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1021/2043] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:00.620626 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13491f11-c619-4ad1-a486-87bc8cff4236 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:00.620915 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13491f11-c619-4ad1-a486-87bc8cff4236 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:00.621238 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13491f11-c619-4ad1-a486-87bc8cff4236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:00.648392 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-13491f11-c619-4ad1-a486-87bc8cff4236 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:00.649757 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-13491f11-c619-4ad1-a486-87bc8cff4236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:00.672605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1023/2044] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:00.676875 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464112c-531c-42ae-a0ff-0a55849b85bf None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:00.689544 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464112c-531c-42ae-a0ff-0a55849b85bf None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:00.701492 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adb3d9-6195-4637-b630-c919e7cc101d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:00.702351 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adb3d9-6195-4637-b630-c919e7cc101d admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:00.702797 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adb3d9-6195-4637-b630-c919e7cc101d admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:00.703162 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adb3d9-6195-4637-b630-c919e7cc101d admin admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:00.703998 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adb3d9-6195-4637-b630-c919e7cc101d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:57:00.704381 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adb3d9-6195-4637-b630-c919e7cc101d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:00.707145 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adb3d9-6195-4637-b630-c919e7cc101d admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:00.724890 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1022/2045] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:57:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:57:00.729783 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13491f11-c619-4ad1-a486-87bc8cff4236 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:00.741717 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13491f11-c619-4ad1-a486-87bc8cff4236 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:00.747462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac17a1-a91a-4acb-b453-0aa811ddddca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:00.748387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac17a1-a91a-4acb-b453-0aa811ddddca admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:00.748522 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac17a1-a91a-4acb-b453-0aa811ddddca admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:00.748800 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac17a1-a91a-4acb-b453-0aa811ddddca admin admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:00.749491 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac17a1-a91a-4acb-b453-0aa811ddddca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:00.754756 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac17a1-a91a-4acb-b453-0aa811ddddca admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:00.809848 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1024/2046] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:57:00 2022] POST /identity/v3/projects => generated 377 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:57:00.813295 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adb3d9-6195-4637-b630-c919e7cc101d admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:00.837046 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adb3d9-6195-4637-b630-c919e7cc101d admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:00.962596 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbfa63-5f31-47a5-b859-60144632ad25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:00.964414 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbfa63-5f31-47a5-b859-60144632ad25 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:00.964903 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbfa63-5f31-47a5-b859-60144632ad25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:00.965305 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbfa63-5f31-47a5-b859-60144632ad25 admin admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:00.966195 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fbfa63-5f31-47a5-b859-60144632ad25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:00.969128 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fbfa63-5f31-47a5-b859-60144632ad25 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:00.995697 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1023/2047] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:57:00 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:57:00.999705 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac17a1-a91a-4acb-b453-0aa811ddddca admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:01.010164 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac17a1-a91a-4acb-b453-0aa811ddddca admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:01.014990 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be7c32-ee29-406a-bad3-7d35ec8a94d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:01.015715 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be7c32-ee29-406a-bad3-7d35ec8a94d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:01.015999 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be7c32-ee29-406a-bad3-7d35ec8a94d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:01.016269 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be7c32-ee29-406a-bad3-7d35ec8a94d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:01.016906 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be7c32-ee29-406a-bad3-7d35ec8a94d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:01.018671 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be7c32-ee29-406a-bad3-7d35ec8a94d3 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:01.029355 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1025/2048] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:57:01.033131 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbfa63-5f31-47a5-b859-60144632ad25 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:01.044886 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbfa63-5f31-47a5-b859-60144632ad25 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:01.050256 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075316d6-d467-469d-87f7-b11dd77a26f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:01.050930 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075316d6-d467-469d-87f7-b11dd77a26f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:01.051209 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075316d6-d467-469d-87f7-b11dd77a26f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:01.051483 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075316d6-d467-469d-87f7-b11dd77a26f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:01.052131 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075316d6-d467-469d-87f7-b11dd77a26f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:01.054146 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075316d6-d467-469d-87f7-b11dd77a26f9 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:01.080933 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1024/2049] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:57:01.082839 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be7c32-ee29-406a-bad3-7d35ec8a94d3 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:01.090739 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:01.099996 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be7c32-ee29-406a-bad3-7d35ec8a94d3 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:01.112030 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8eadf-e0fc-4160-9211-664a97478ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:01.112855 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8eadf-e0fc-4160-9211-664a97478ece admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:01.113338 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8eadf-e0fc-4160-9211-664a97478ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:01.113751 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8eadf-e0fc-4160-9211-664a97478ece admin admin] PATH_INFO: `/v3/projects/d46d7a2e73c94ff990a8f2965c34714d/users/afd3548aa2504e2bb62d2435b576a695/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:01.149099 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a8eadf-e0fc-4160-9211-664a97478ece admin admin] RBAC: Authorizing `identity:create_grant(project_id=d46d7a2e73c94ff990a8f2965c34714d, user_id=afd3548aa2504e2bb62d2435b576a695, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:01.154751 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a8eadf-e0fc-4160-9211-664a97478ece admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:01.176763 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1026/2050] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:57:01 2022] PUT /identity/v3/projects/d46d7a2e73c94ff990a8f2965c34714d/users/afd3548aa2504e2bb62d2435b576a695/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:01.189259 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72719423-8535-41e4-a6a1-16af843038b7 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:01.189780 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72719423-8535-41e4-a6a1-16af843038b7 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:01.190373 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72719423-8535-41e4-a6a1-16af843038b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:01.233438 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-72719423-8535-41e4-a6a1-16af843038b7 None None] MFA Rules not processed for user `afd3548aa2504e2bb62d2435b576a695`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:01.234595 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-72719423-8535-41e4-a6a1-16af843038b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:01.419141 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1025/2051] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:01.536319 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8eadf-e0fc-4160-9211-664a97478ece admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:01.540157 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-e4a8eadf-e0fc-4160-9211-664a97478ece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:01.619775 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8eadf-e0fc-4160-9211-664a97478ece admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:01.630297 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dced44-4b73-41bc-b383-50a499ac7e28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:01.633187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dced44-4b73-41bc-b383-50a499ac7e28 service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:01.634285 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dced44-4b73-41bc-b383-50a499ac7e28 service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:01.635181 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dced44-4b73-41bc-b383-50a499ac7e28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:01.658038 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dced44-4b73-41bc-b383-50a499ac7e28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:01.659879 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dced44-4b73-41bc-b383-50a499ac7e28 service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:01.682493 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1027/2052] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:57:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:57:03.690957 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72719423-8535-41e4-a6a1-16af843038b7 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:03.692520 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-72719423-8535-41e4-a6a1-16af843038b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:03.747574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:03.771147 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72719423-8535-41e4-a6a1-16af843038b7 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:03.775716 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155db5f-b09a-4079-a99e-9472fa944e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:03.776341 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155db5f-b09a-4079-a99e-9472fa944e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:03.776615 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155db5f-b09a-4079-a99e-9472fa944e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:03.776879 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155db5f-b09a-4079-a99e-9472fa944e22 admin admin] PATH_INFO: `/v3/users/557aa0bb43984f198fdf56178eab42b3` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:03.778020 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155db5f-b09a-4079-a99e-9472fa944e22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=557aa0bb43984f198fdf56178eab42b3)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:03.779978 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155db5f-b09a-4079-a99e-9472fa944e22 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:03.827078 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-c155db5f-b09a-4079-a99e-9472fa944e22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '557aa0bb43984f198fdf56178eab42b3'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:03.835235 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-c155db5f-b09a-4079-a99e-9472fa944e22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '557aa0bb43984f198fdf56178eab42b3'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:03.835910 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-c155db5f-b09a-4079-a99e-9472fa944e22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '557aa0bb43984f198fdf56178eab42b3'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:03.836551 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-c155db5f-b09a-4079-a99e-9472fa944e22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '557aa0bb43984f198fdf56178eab42b3'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:03.843519 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-c155db5f-b09a-4079-a99e-9472fa944e22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '557aa0bb43984f198fdf56178eab42b3'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:03.865161 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1026/2053] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:57:03 2022] DELETE /identity/v3/users/557aa0bb43984f198fdf56178eab42b3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:03.870319 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d20e55-4d92-401d-8912-f0fc50601e2c None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:03.870788 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d20e55-4d92-401d-8912-f0fc50601e2c None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:03.870892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d20e55-4d92-401d-8912-f0fc50601e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:03.891478 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-b8d20e55-4d92-401d-8912-f0fc50601e2c None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:03.892693 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-b8d20e55-4d92-401d-8912-f0fc50601e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:03.961356 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1028/2054] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:03.971322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155db5f-b09a-4079-a99e-9472fa944e22 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:03.972866 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-c155db5f-b09a-4079-a99e-9472fa944e22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:04.031829 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155db5f-b09a-4079-a99e-9472fa944e22 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:04.035506 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dcc23d-32bf-4eae-8e9e-9184c2758f7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:04.036106 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dcc23d-32bf-4eae-8e9e-9184c2758f7d service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:04.036381 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dcc23d-32bf-4eae-8e9e-9184c2758f7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:04.036647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dcc23d-32bf-4eae-8e9e-9184c2758f7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:04.047026 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dcc23d-32bf-4eae-8e9e-9184c2758f7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:04.048706 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dcc23d-32bf-4eae-8e9e-9184c2758f7d service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:04.059527 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1027/2055] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:57:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:57:04.392495 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d20e55-4d92-401d-8912-f0fc50601e2c None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:04.394168 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-b8d20e55-4d92-401d-8912-f0fc50601e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:04.473101 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d20e55-4d92-401d-8912-f0fc50601e2c None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:04.476716 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8603b7-a9d1-44e8-bc2e-721213468ac5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:04.477364 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8603b7-a9d1-44e8-bc2e-721213468ac5 service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:04.477637 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8603b7-a9d1-44e8-bc2e-721213468ac5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:04.477906 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8603b7-a9d1-44e8-bc2e-721213468ac5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:04.480282 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-5e8603b7-a9d1-44e8-bc2e-721213468ac5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:04.517939 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:04.550343 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8603b7-a9d1-44e8-bc2e-721213468ac5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:04.551700 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8603b7-a9d1-44e8-bc2e-721213468ac5 service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:04.562026 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1029/2056] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:57:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:57:04.605652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dcc23d-32bf-4eae-8e9e-9184c2758f7d service neutron] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:04.605652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-17dcc23d-32bf-4eae-8e9e-9184c2758f7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:04.617478 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dcc23d-32bf-4eae-8e9e-9184c2758f7d service neutron] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:04.624532 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e30193-c591-484b-b66d-088d41ced897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:04.625231 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e30193-c591-484b-b66d-088d41ced897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:04.625512 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e30193-c591-484b-b66d-088d41ced897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:04.625945 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e30193-c591-484b-b66d-088d41ced897 admin admin] PATH_INFO: `/v3/projects/5dc410190e7f4f42a5fba8a9c257a222` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:04.627343 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e30193-c591-484b-b66d-088d41ced897 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dc410190e7f4f42a5fba8a9c257a222)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:04.629525 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e30193-c591-484b-b66d-088d41ced897 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:04.692623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-92e30193-c591-484b-b66d-088d41ced897 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dc410190e7f4f42a5fba8a9c257a222', 'request_id': 'req-92e30193-c591-484b-b66d-088d41ced897'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:04.702434 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-92e30193-c591-484b-b66d-088d41ced897 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dc410190e7f4f42a5fba8a9c257a222', 'request_id': 'req-92e30193-c591-484b-b66d-088d41ced897'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:04.706772 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:04.711725 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-92e30193-c591-484b-b66d-088d41ced897 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dc410190e7f4f42a5fba8a9c257a222', 'request_id': 'req-92e30193-c591-484b-b66d-088d41ced897'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:04.733726 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-92e30193-c591-484b-b66d-088d41ced897 admin admin] The token cache is being invalidate because project 5dc410190e7f4f42a5fba8a9c257a222 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:57:04.735751 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-92e30193-c591-484b-b66d-088d41ced897 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:04.736562 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-92e30193-c591-484b-b66d-088d41ced897 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:04.742484 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1028/2057] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:57:04 2022] DELETE /identity/v3/projects/5dc410190e7f4f42a5fba8a9c257a222 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:04.743806 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c6fdb-a498-4e0a-aabe-86210c7088ab None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:04.744138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c6fdb-a498-4e0a-aabe-86210c7088ab None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:04.744416 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c6fdb-a498-4e0a-aabe-86210c7088ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:04.769617 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-754c6fdb-a498-4e0a-aabe-86210c7088ab None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:04.770936 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-754c6fdb-a498-4e0a-aabe-86210c7088ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:04.864067 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1030/2058] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:57:04.871917 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773bba4-1f5d-4b7d-80ca-8e5b9921c6f8 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:04.872217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773bba4-1f5d-4b7d-80ca-8e5b9921c6f8 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:04.872489 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773bba4-1f5d-4b7d-80ca-8e5b9921c6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:04.893290 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-f773bba4-1f5d-4b7d-80ca-8e5b9921c6f8 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:04.894530 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-f773bba4-1f5d-4b7d-80ca-8e5b9921c6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:04.903055 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1029/2059] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:04.907363 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c6fdb-a498-4e0a-aabe-86210c7088ab None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:04.917739 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c6fdb-a498-4e0a-aabe-86210c7088ab None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:04.923251 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523d013-01c0-4313-8655-9d7a0fd2233f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:04.923950 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523d013-01c0-4313-8655-9d7a0fd2233f admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:04.924229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523d013-01c0-4313-8655-9d7a0fd2233f admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:04.924553 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523d013-01c0-4313-8655-9d7a0fd2233f admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:04.925249 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523d013-01c0-4313-8655-9d7a0fd2233f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:57:04.925555 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523d013-01c0-4313-8655-9d7a0fd2233f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:04.927413 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523d013-01c0-4313-8655-9d7a0fd2233f admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:04.940520 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1031/2060] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:57:04.944635 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773bba4-1f5d-4b7d-80ca-8e5b9921c6f8 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:04.955067 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773bba4-1f5d-4b7d-80ca-8e5b9921c6f8 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:04.961468 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d52ab-a88c-48c4-84bc-617024415961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:04.962126 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d52ab-a88c-48c4-84bc-617024415961 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:04.962409 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d52ab-a88c-48c4-84bc-617024415961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:04.962741 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d52ab-a88c-48c4-84bc-617024415961 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:04.963903 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d52ab-a88c-48c4-84bc-617024415961 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:04.965848 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d52ab-a88c-48c4-84bc-617024415961 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:05.000598 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1030/2061] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:57:04 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:57:05.005399 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523d013-01c0-4313-8655-9d7a0fd2233f admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:05.016019 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523d013-01c0-4313-8655-9d7a0fd2233f admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:05.081275 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b554e9-17f9-436f-adfd-ff7c79637031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:05.081893 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b554e9-17f9-436f-adfd-ff7c79637031 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:05.082180 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b554e9-17f9-436f-adfd-ff7c79637031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:05.082456 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b554e9-17f9-436f-adfd-ff7c79637031 admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:05.083113 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b554e9-17f9-436f-adfd-ff7c79637031 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:05.085868 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b554e9-17f9-436f-adfd-ff7c79637031 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:05.109242 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1032/2062] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:57:05 2022] POST /identity/v3/users => generated 284 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 17:57:05.114091 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d52ab-a88c-48c4-84bc-617024415961 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:05.125596 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d52ab-a88c-48c4-84bc-617024415961 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:05.132073 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539936b0-806d-4e6b-b92a-05aa39c81da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:05.132760 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539936b0-806d-4e6b-b92a-05aa39c81da5 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:05.133062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539936b0-806d-4e6b-b92a-05aa39c81da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:05.133335 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539936b0-806d-4e6b-b92a-05aa39c81da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:05.133971 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539936b0-806d-4e6b-b92a-05aa39c81da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:05.136111 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539936b0-806d-4e6b-b92a-05aa39c81da5 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:05.147879 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1031/2063] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:57:05.152715 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b554e9-17f9-436f-adfd-ff7c79637031 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:05.164291 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b554e9-17f9-436f-adfd-ff7c79637031 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:05.169633 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df9761-3ed0-45a6-a956-69f70e6b9c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:05.170242 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df9761-3ed0-45a6-a956-69f70e6b9c26 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:05.170524 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df9761-3ed0-45a6-a956-69f70e6b9c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:05.170799 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df9761-3ed0-45a6-a956-69f70e6b9c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:05.171478 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df9761-3ed0-45a6-a956-69f70e6b9c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:05.173120 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df9761-3ed0-45a6-a956-69f70e6b9c26 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:05.184489 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1033/2064] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:57:05.189134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539936b0-806d-4e6b-b92a-05aa39c81da5 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:05.200192 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539936b0-806d-4e6b-b92a-05aa39c81da5 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:05.206310 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ea286-cdcb-421a-99c7-875056a4d3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:05.206973 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ea286-cdcb-421a-99c7-875056a4d3ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:05.207256 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ea286-cdcb-421a-99c7-875056a4d3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:05.207531 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ea286-cdcb-421a-99c7-875056a4d3ca admin admin] PATH_INFO: `/v3/projects/061593798de947d0854672e68f1a4aac/users/f72b46341efc48b496a3b422c657e380/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:05.225294 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ea286-cdcb-421a-99c7-875056a4d3ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=061593798de947d0854672e68f1a4aac, user_id=f72b46341efc48b496a3b422c657e380, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:05.228334 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ea286-cdcb-421a-99c7-875056a4d3ca admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:05.246657 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1032/2065] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:57:05 2022] PUT /identity/v3/projects/061593798de947d0854672e68f1a4aac/users/f72b46341efc48b496a3b422c657e380/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:05.258025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19fb59-3a9d-4326-9263-fa79ebab92ef None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:05.258315 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19fb59-3a9d-4326-9263-fa79ebab92ef None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:05.258587 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19fb59-3a9d-4326-9263-fa79ebab92ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:05.290337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-7e19fb59-3a9d-4326-9263-fa79ebab92ef None None] MFA Rules not processed for user `f72b46341efc48b496a3b422c657e380`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:05.291552 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-7e19fb59-3a9d-4326-9263-fa79ebab92ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:05.325258 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:05.371347 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1034/2066] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:05.385706 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ea286-cdcb-421a-99c7-875056a4d3ca admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:05.387765 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-ce3ea286-cdcb-421a-99c7-875056a4d3ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:05.490836 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ea286-cdcb-421a-99c7-875056a4d3ca admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:05.497375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58725fd8-b33b-4d7c-82bb-8f0c71cd9075 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab3b7ac09599477bb0c6c1d32e2d5dbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:05.498002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58725fd8-b33b-4d7c-82bb-8f0c71cd9075 service glance] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:05.498284 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58725fd8-b33b-4d7c-82bb-8f0c71cd9075 service glance] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:05.498551 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58725fd8-b33b-4d7c-82bb-8f0c71cd9075 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:05.515910 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58725fd8-b33b-4d7c-82bb-8f0c71cd9075 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:05.518519 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58725fd8-b33b-4d7c-82bb-8f0c71cd9075 service glance] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:05.540468 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1033/2067] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:57:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 17:57:15.367067 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=15 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:15.536460 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=57,keystone:INSERT=2 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:17.107111 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553f89f-cbaf-4b45-9713-6fc510835b5d None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:17.107633 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553f89f-cbaf-4b45-9713-6fc510835b5d None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:17.107633 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553f89f-cbaf-4b45-9713-6fc510835b5d None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:17.109092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1035/2068] 10.222.0.62 () {54 vars in 921 bytes} [Mon Sep 26 17:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:57:17.367420 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba7570-6a05-4ac9-a7ca-07478f431cb8 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:17.367971 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba7570-6a05-4ac9-a7ca-07478f431cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:17.370889 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba7570-6a05-4ac9-a7ca-07478f431cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:17.401580 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-49ba7570-6a05-4ac9-a7ca-07478f431cb8 None None] MFA Rules not processed for user `f5043d835c08458c9f3911a4741bdaa8`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:17.403418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-49ba7570-6a05-4ac9-a7ca-07478f431cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:17.450633 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553f89f-cbaf-4b45-9713-6fc510835b5d None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:17.452756 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-f553f89f-cbaf-4b45-9713-6fc510835b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:17.495823 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1034/2069] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Sep 26 17:57:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:17.517432 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba7570-6a05-4ac9-a7ca-07478f431cb8 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:17.519886 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-49ba7570-6a05-4ac9-a7ca-07478f431cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:17.540279 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553f89f-cbaf-4b45-9713-6fc510835b5d None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:17.545379 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a737e0-796e-4a46-bc1c-cc8504fc3f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:17.546013 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a737e0-796e-4a46-bc1c-cc8504fc3f9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:17.546294 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a737e0-796e-4a46-bc1c-cc8504fc3f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:17.546643 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a737e0-796e-4a46-bc1c-cc8504fc3f9d admin admin] PATH_INFO: `/v3/users/27be8cad21f54dcd9a71ff99299d9814` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:17.547741 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba7570-6a05-4ac9-a7ca-07478f431cb8 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:17.547908 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a737e0-796e-4a46-bc1c-cc8504fc3f9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=27be8cad21f54dcd9a71ff99299d9814)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:17.549951 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a737e0-796e-4a46-bc1c-cc8504fc3f9d admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:17.553617 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fcd6b1-cd49-4ae1-a485-eea268c57b2a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5043d835c08458c9f3911a4741bdaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:17.554018 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcd6b1-cd49-4ae1-a485-eea268c57b2a service placement] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:17.554290 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcd6b1-cd49-4ae1-a485-eea268c57b2a service placement] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:17.554556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcd6b1-cd49-4ae1-a485-eea268c57b2a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:17.564519 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fcd6b1-cd49-4ae1-a485-eea268c57b2a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:17.566244 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fcd6b1-cd49-4ae1-a485-eea268c57b2a service placement] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:17.577999 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1035/2070] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:57:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 17:57:17.600546 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-54a737e0-796e-4a46-bc1c-cc8504fc3f9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27be8cad21f54dcd9a71ff99299d9814'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:17.601309 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-54a737e0-796e-4a46-bc1c-cc8504fc3f9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27be8cad21f54dcd9a71ff99299d9814'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:17.601958 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-54a737e0-796e-4a46-bc1c-cc8504fc3f9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27be8cad21f54dcd9a71ff99299d9814'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:17.609664 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-54a737e0-796e-4a46-bc1c-cc8504fc3f9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27be8cad21f54dcd9a71ff99299d9814'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:17.617380 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-54a737e0-796e-4a46-bc1c-cc8504fc3f9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27be8cad21f54dcd9a71ff99299d9814'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:17.641409 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1036/2071] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:57:17 2022] DELETE /identity/v3/users/27be8cad21f54dcd9a71ff99299d9814 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:57:17.815994 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fcd6b1-cd49-4ae1-a485-eea268c57b2a service placement] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:17.840341 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fcd6b1-cd49-4ae1-a485-eea268c57b2a service placement] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:17.918563 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612dbc30-dcb8-4813-a926-fdec5d730770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:17.919202 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612dbc30-dcb8-4813-a926-fdec5d730770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:17.919474 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612dbc30-dcb8-4813-a926-fdec5d730770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:17.919747 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612dbc30-dcb8-4813-a926-fdec5d730770 admin admin] PATH_INFO: `/v3/projects/e0f4f590b1634121a8de1b202c2413ca` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:17.920864 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612dbc30-dcb8-4813-a926-fdec5d730770 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0f4f590b1634121a8de1b202c2413ca)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:17.922801 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612dbc30-dcb8-4813-a926-fdec5d730770 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:17.971956 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-612dbc30-dcb8-4813-a926-fdec5d730770 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0f4f590b1634121a8de1b202c2413ca', 'request_id': 'req-612dbc30-dcb8-4813-a926-fdec5d730770'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:17.977458 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-612dbc30-dcb8-4813-a926-fdec5d730770 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0f4f590b1634121a8de1b202c2413ca', 'request_id': 'req-612dbc30-dcb8-4813-a926-fdec5d730770'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:17.985583 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-612dbc30-dcb8-4813-a926-fdec5d730770 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0f4f590b1634121a8de1b202c2413ca', 'request_id': 'req-612dbc30-dcb8-4813-a926-fdec5d730770'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:17.997436 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-612dbc30-dcb8-4813-a926-fdec5d730770 admin admin] The token cache is being invalidate because project e0f4f590b1634121a8de1b202c2413ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:57:17.997724 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-612dbc30-dcb8-4813-a926-fdec5d730770 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:17.998401 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-612dbc30-dcb8-4813-a926-fdec5d730770 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:18.000153 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1036/2072] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:57:17 2022] DELETE /identity/v3/projects/e0f4f590b1634121a8de1b202c2413ca => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:18.005371 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7301d26-5be3-4d56-97bc-aa9789e37eb5 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:18.005661 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7301d26-5be3-4d56-97bc-aa9789e37eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:18.005933 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7301d26-5be3-4d56-97bc-aa9789e37eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:18.026893 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-e7301d26-5be3-4d56-97bc-aa9789e37eb5 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:18.028027 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-e7301d26-5be3-4d56-97bc-aa9789e37eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:18.097218 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1037/2073] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:18.102306 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe448d85-5592-4880-8862-0819965f5846 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:18.102971 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe448d85-5592-4880-8862-0819965f5846 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:18.103305 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe448d85-5592-4880-8862-0819965f5846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:18.143513 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-fe448d85-5592-4880-8862-0819965f5846 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:18.143513 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-fe448d85-5592-4880-8862-0819965f5846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:18.154108 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1037/2074] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:57:18.158374 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7301d26-5be3-4d56-97bc-aa9789e37eb5 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:18.172819 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7301d26-5be3-4d56-97bc-aa9789e37eb5 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:18.180158 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bd1dd-d2dd-4536-bb2c-839815611dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:18.180774 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bd1dd-d2dd-4536-bb2c-839815611dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:18.181074 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bd1dd-d2dd-4536-bb2c-839815611dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:18.181350 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bd1dd-d2dd-4536-bb2c-839815611dd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:18.182001 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670bd1dd-d2dd-4536-bb2c-839815611dd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:57:18.182307 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670bd1dd-d2dd-4536-bb2c-839815611dd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:18.183944 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670bd1dd-d2dd-4536-bb2c-839815611dd8 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:18.200251 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1038/2075] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:57:18.204832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe448d85-5592-4880-8862-0819965f5846 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:18.220313 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe448d85-5592-4880-8862-0819965f5846 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:18.225812 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2831924-ab46-4205-b8bd-9b04acae1458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:18.225812 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2831924-ab46-4205-b8bd-9b04acae1458 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:18.226051 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2831924-ab46-4205-b8bd-9b04acae1458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:18.226410 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2831924-ab46-4205-b8bd-9b04acae1458 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:18.227144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2831924-ab46-4205-b8bd-9b04acae1458 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:18.229085 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2831924-ab46-4205-b8bd-9b04acae1458 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:18.234537 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:18.269958 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1038/2076] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:57:18 2022] POST /identity/v3/projects => generated 365 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:57:18.273938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bd1dd-d2dd-4536-bb2c-839815611dd8 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:18.288054 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bd1dd-d2dd-4536-bb2c-839815611dd8 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:18.292724 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:18.353565 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5af967-ba26-4a74-a568-3f3d1a40ad4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:18.357625 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5af967-ba26-4a74-a568-3f3d1a40ad4e admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:18.357625 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5af967-ba26-4a74-a568-3f3d1a40ad4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:18.357625 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5af967-ba26-4a74-a568-3f3d1a40ad4e admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:18.357625 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5af967-ba26-4a74-a568-3f3d1a40ad4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:18.358201 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5af967-ba26-4a74-a568-3f3d1a40ad4e admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:18.385746 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1039/2077] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:57:18 2022] POST /identity/v3/users => generated 283 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:57:18.390321 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2831924-ab46-4205-b8bd-9b04acae1458 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:18.404403 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2831924-ab46-4205-b8bd-9b04acae1458 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:18.410964 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e19f0-81d1-453e-8d8e-a5e0a51e6c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:18.411587 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e19f0-81d1-453e-8d8e-a5e0a51e6c6a admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:18.411872 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e19f0-81d1-453e-8d8e-a5e0a51e6c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:18.412149 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e19f0-81d1-453e-8d8e-a5e0a51e6c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:18.412818 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e19f0-81d1-453e-8d8e-a5e0a51e6c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:18.414456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e19f0-81d1-453e-8d8e-a5e0a51e6c6a admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:18.426625 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1039/2078] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 17:57:18.430836 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5af967-ba26-4a74-a568-3f3d1a40ad4e admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:18.442717 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5af967-ba26-4a74-a568-3f3d1a40ad4e admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:18.447643 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c881db-6ba7-426d-912a-9e6552fc85c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:18.448255 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c881db-6ba7-426d-912a-9e6552fc85c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:18.448534 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c881db-6ba7-426d-912a-9e6552fc85c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:18.448804 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c881db-6ba7-426d-912a-9e6552fc85c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:18.449494 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c881db-6ba7-426d-912a-9e6552fc85c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:18.451077 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c881db-6ba7-426d-912a-9e6552fc85c6 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:18.465054 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1040/2079] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 17:57:18.466635 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e19f0-81d1-453e-8d8e-a5e0a51e6c6a admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:18.476572 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e19f0-81d1-453e-8d8e-a5e0a51e6c6a admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:18.481785 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaff25f-d467-459d-ac00-8896b1b47113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:18.482430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaff25f-d467-459d-ac00-8896b1b47113 admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:18.482713 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaff25f-d467-459d-ac00-8896b1b47113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:18.482986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaff25f-d467-459d-ac00-8896b1b47113 admin admin] PATH_INFO: `/v3/projects/13811534a853460fba8cb01c5695278a/users/add7ae6ec25b4305a670ea977d768dfd/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:18.498198 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaff25f-d467-459d-ac00-8896b1b47113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13811534a853460fba8cb01c5695278a, user_id=add7ae6ec25b4305a670ea977d768dfd, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:18.500879 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaff25f-d467-459d-ac00-8896b1b47113 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:18.515448 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1040/2080] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:57:18 2022] PUT /identity/v3/projects/13811534a853460fba8cb01c5695278a/users/add7ae6ec25b4305a670ea977d768dfd/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:18.525698 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f849058-43e3-46bb-ac2a-8794729561f6 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:18.525980 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f849058-43e3-46bb-ac2a-8794729561f6 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:18.526250 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f849058-43e3-46bb-ac2a-8794729561f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:18.555954 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-0f849058-43e3-46bb-ac2a-8794729561f6 None None] MFA Rules not processed for user `add7ae6ec25b4305a670ea977d768dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:18.557176 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-0f849058-43e3-46bb-ac2a-8794729561f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:18.631609 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1041/2081] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:18.643109 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaff25f-d467-459d-ac00-8896b1b47113 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:18.644776 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-3aaff25f-d467-459d-ac00-8896b1b47113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:18.723890 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaff25f-d467-459d-ac00-8896b1b47113 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:18.723890 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4bf49f-337d-4399-800f-adea460be642 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:18.723890 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bf49f-337d-4399-800f-adea460be642 service cinder] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:18.723890 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bf49f-337d-4399-800f-adea460be642 service cinder] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:18.724267 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bf49f-337d-4399-800f-adea460be642 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:18.734804 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4bf49f-337d-4399-800f-adea460be642 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:18.736480 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4bf49f-337d-4399-800f-adea460be642 service cinder] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:18.746511 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1041/2082] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:57:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:57:19.457670 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f849058-43e3-46bb-ac2a-8794729561f6 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:19.459103 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-0f849058-43e3-46bb-ac2a-8794729561f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:19.527257 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f849058-43e3-46bb-ac2a-8794729561f6 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:19.532243 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975574d-a9c9-4c9e-98cd-35f0d44fd57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:19.532881 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975574d-a9c9-4c9e-98cd-35f0d44fd57f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:19.533536 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975574d-a9c9-4c9e-98cd-35f0d44fd57f admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:19.534021 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975574d-a9c9-4c9e-98cd-35f0d44fd57f admin admin] PATH_INFO: `/v3/users/afd3548aa2504e2bb62d2435b576a695` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:19.535471 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8975574d-a9c9-4c9e-98cd-35f0d44fd57f admin admin] RBAC: Authorizing `identity:delete_user(user_id=afd3548aa2504e2bb62d2435b576a695)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:19.538953 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8975574d-a9c9-4c9e-98cd-35f0d44fd57f admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:19.556033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:19.592704 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-8975574d-a9c9-4c9e-98cd-35f0d44fd57f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afd3548aa2504e2bb62d2435b576a695'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:19.593677 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-8975574d-a9c9-4c9e-98cd-35f0d44fd57f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afd3548aa2504e2bb62d2435b576a695'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:19.594649 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-8975574d-a9c9-4c9e-98cd-35f0d44fd57f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afd3548aa2504e2bb62d2435b576a695'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:19.604635 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-8975574d-a9c9-4c9e-98cd-35f0d44fd57f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afd3548aa2504e2bb62d2435b576a695'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:19.615815 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-8975574d-a9c9-4c9e-98cd-35f0d44fd57f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afd3548aa2504e2bb62d2435b576a695'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:19.636216 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1042/2083] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:57:19 2022] DELETE /identity/v3/users/afd3548aa2504e2bb62d2435b576a695 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:19.640822 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fb8cc-82cf-431f-83e2-ba92dc7157f5 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:19.641413 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fb8cc-82cf-431f-83e2-ba92dc7157f5 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:19.641413 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fb8cc-82cf-431f-83e2-ba92dc7157f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:19.660230 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-f33fb8cc-82cf-431f-83e2-ba92dc7157f5 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:19.661458 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-f33fb8cc-82cf-431f-83e2-ba92dc7157f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:19.738439 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1042/2084] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:19.757776 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975574d-a9c9-4c9e-98cd-35f0d44fd57f admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:19.759576 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-8975574d-a9c9-4c9e-98cd-35f0d44fd57f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:19.851512 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975574d-a9c9-4c9e-98cd-35f0d44fd57f admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:19.857235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696b65f-b0b6-4d47-8080-875987f70ca5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:19.858173 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696b65f-b0b6-4d47-8080-875987f70ca5 service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:19.858452 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696b65f-b0b6-4d47-8080-875987f70ca5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:19.858851 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696b65f-b0b6-4d47-8080-875987f70ca5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:19.871192 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696b65f-b0b6-4d47-8080-875987f70ca5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:19.872658 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696b65f-b0b6-4d47-8080-875987f70ca5 service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:19.882961 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1043/2085] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:57:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:57:20.224672 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33fb8cc-82cf-431f-83e2-ba92dc7157f5 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:20.226178 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-f33fb8cc-82cf-431f-83e2-ba92dc7157f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:20.238384 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33fb8cc-82cf-431f-83e2-ba92dc7157f5 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:20.243608 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d11f67-56f7-4c2b-8cd7-cf5cb169d218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:20.244255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d11f67-56f7-4c2b-8cd7-cf5cb169d218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:20.244535 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d11f67-56f7-4c2b-8cd7-cf5cb169d218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:20.245439 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d11f67-56f7-4c2b-8cd7-cf5cb169d218 admin admin] PATH_INFO: `/v3/projects/d46d7a2e73c94ff990a8f2965c34714d` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:20.246733 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d11f67-56f7-4c2b-8cd7-cf5cb169d218 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d46d7a2e73c94ff990a8f2965c34714d)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:20.248840 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d11f67-56f7-4c2b-8cd7-cf5cb169d218 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:20.308360 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:20.309712 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-43d11f67-56f7-4c2b-8cd7-cf5cb169d218 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd46d7a2e73c94ff990a8f2965c34714d', 'request_id': 'req-43d11f67-56f7-4c2b-8cd7-cf5cb169d218'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:20.317667 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-43d11f67-56f7-4c2b-8cd7-cf5cb169d218 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd46d7a2e73c94ff990a8f2965c34714d', 'request_id': 'req-43d11f67-56f7-4c2b-8cd7-cf5cb169d218'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:20.327248 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-43d11f67-56f7-4c2b-8cd7-cf5cb169d218 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd46d7a2e73c94ff990a8f2965c34714d', 'request_id': 'req-43d11f67-56f7-4c2b-8cd7-cf5cb169d218'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:20.343921 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-43d11f67-56f7-4c2b-8cd7-cf5cb169d218 admin admin] The token cache is being invalidate because project d46d7a2e73c94ff990a8f2965c34714d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:57:20.344234 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-43d11f67-56f7-4c2b-8cd7-cf5cb169d218 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:20.344898 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-43d11f67-56f7-4c2b-8cd7-cf5cb169d218 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:20.350931 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1043/2086] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:57:20 2022] DELETE /identity/v3/projects/d46d7a2e73c94ff990a8f2965c34714d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:20.352079 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30906aa3-0192-4032-bbbd-0dd11f8e4661 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:20.352442 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30906aa3-0192-4032-bbbd-0dd11f8e4661 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:20.352818 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30906aa3-0192-4032-bbbd-0dd11f8e4661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:20.385117 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-30906aa3-0192-4032-bbbd-0dd11f8e4661 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:20.387126 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-30906aa3-0192-4032-bbbd-0dd11f8e4661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:20.463996 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1044/2087] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:57:20.472019 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936a8b1-1627-4e6c-b4e7-479c766d0481 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:20.472335 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936a8b1-1627-4e6c-b4e7-479c766d0481 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:20.472613 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936a8b1-1627-4e6c-b4e7-479c766d0481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:20.494138 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-3936a8b1-1627-4e6c-b4e7-479c766d0481 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:20.495990 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-3936a8b1-1627-4e6c-b4e7-479c766d0481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:20.506939 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1044/2088] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:20.511279 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30906aa3-0192-4032-bbbd-0dd11f8e4661 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:20.521175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30906aa3-0192-4032-bbbd-0dd11f8e4661 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:20.526311 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf6911-788a-49c0-bbcb-83dcf24b7254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:20.527019 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf6911-788a-49c0-bbcb-83dcf24b7254 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:20.527300 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf6911-788a-49c0-bbcb-83dcf24b7254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:20.527574 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf6911-788a-49c0-bbcb-83dcf24b7254 admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:20.528223 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf6911-788a-49c0-bbcb-83dcf24b7254 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:57:20.528529 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf6911-788a-49c0-bbcb-83dcf24b7254 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:20.530172 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf6911-788a-49c0-bbcb-83dcf24b7254 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:20.543218 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1045/2089] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:57:20.548254 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936a8b1-1627-4e6c-b4e7-479c766d0481 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:20.558998 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936a8b1-1627-4e6c-b4e7-479c766d0481 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:20.563793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb49e8-a69b-44f0-9d6f-e8cce9ea086f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:20.564469 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb49e8-a69b-44f0-9d6f-e8cce9ea086f admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:20.564894 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb49e8-a69b-44f0-9d6f-e8cce9ea086f admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:20.565206 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb49e8-a69b-44f0-9d6f-e8cce9ea086f admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:20.565838 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb49e8-a69b-44f0-9d6f-e8cce9ea086f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:20.567870 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb49e8-a69b-44f0-9d6f-e8cce9ea086f admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:20.600475 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1045/2090] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:57:20 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:57:20.601778 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf6911-788a-49c0-bbcb-83dcf24b7254 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:20.612448 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf6911-788a-49c0-bbcb-83dcf24b7254 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:20.632721 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:20.670239 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7d50e-7d8b-4b21-be68-6430646acf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:20.670839 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7d50e-7d8b-4b21-be68-6430646acf22 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:20.671120 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7d50e-7d8b-4b21-be68-6430646acf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:20.671394 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7d50e-7d8b-4b21-be68-6430646acf22 admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:20.672029 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7d50e-7d8b-4b21-be68-6430646acf22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:20.674024 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7d50e-7d8b-4b21-be68-6430646acf22 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:20.696699 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1046/2091] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:57:20 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 17:57:20.700927 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb49e8-a69b-44f0-9d6f-e8cce9ea086f admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:20.711675 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb49e8-a69b-44f0-9d6f-e8cce9ea086f admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:20.716453 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f35898-937f-4fe4-b056-09bfc3e6ada2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:20.717082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f35898-937f-4fe4-b056-09bfc3e6ada2 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:20.717366 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f35898-937f-4fe4-b056-09bfc3e6ada2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:20.717640 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f35898-937f-4fe4-b056-09bfc3e6ada2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:20.718306 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f35898-937f-4fe4-b056-09bfc3e6ada2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:20.720054 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f35898-937f-4fe4-b056-09bfc3e6ada2 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:20.732476 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1046/2092] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:57:20.739532 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7d50e-7d8b-4b21-be68-6430646acf22 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:20.750507 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7d50e-7d8b-4b21-be68-6430646acf22 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:20.755418 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06685fd2-9248-4287-9ead-f80e8dc5856f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:20.756021 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06685fd2-9248-4287-9ead-f80e8dc5856f admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:20.756300 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06685fd2-9248-4287-9ead-f80e8dc5856f admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:20.756572 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06685fd2-9248-4287-9ead-f80e8dc5856f admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:20.757245 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06685fd2-9248-4287-9ead-f80e8dc5856f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:20.758876 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06685fd2-9248-4287-9ead-f80e8dc5856f admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:20.769760 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1047/2093] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:57:20.774159 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f35898-937f-4fe4-b056-09bfc3e6ada2 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:20.784792 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f35898-937f-4fe4-b056-09bfc3e6ada2 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:20.789474 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2948a5d0-2b06-4433-a7bc-d85eab16607e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:20.790490 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948a5d0-2b06-4433-a7bc-d85eab16607e admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:20.790768 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948a5d0-2b06-4433-a7bc-d85eab16607e admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:20.791038 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948a5d0-2b06-4433-a7bc-d85eab16607e admin admin] PATH_INFO: `/v3/projects/413e700708504d759b0067bb5e0c343d/users/87e4ecdf8bd3431aa9a4d081dd9d126b/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:20.808937 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2948a5d0-2b06-4433-a7bc-d85eab16607e admin admin] RBAC: Authorizing `identity:create_grant(project_id=413e700708504d759b0067bb5e0c343d, user_id=87e4ecdf8bd3431aa9a4d081dd9d126b, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:20.811721 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2948a5d0-2b06-4433-a7bc-d85eab16607e admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:20.826805 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1047/2094] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:57:20 2022] PUT /identity/v3/projects/413e700708504d759b0067bb5e0c343d/users/87e4ecdf8bd3431aa9a4d081dd9d126b/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:20.837227 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9db7a-0a6c-4bcf-a2a2-6e7c44991793 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:20.837521 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9db7a-0a6c-4bcf-a2a2-6e7c44991793 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:20.837858 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9db7a-0a6c-4bcf-a2a2-6e7c44991793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:20.869031 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-6aa9db7a-0a6c-4bcf-a2a2-6e7c44991793 None None] MFA Rules not processed for user `87e4ecdf8bd3431aa9a4d081dd9d126b`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:20.870289 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-6aa9db7a-0a6c-4bcf-a2a2-6e7c44991793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:20.935523 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1048/2095] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:20.947257 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2948a5d0-2b06-4433-a7bc-d85eab16607e admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:20.949614 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-2948a5d0-2b06-4433-a7bc-d85eab16607e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:21.010431 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2948a5d0-2b06-4433-a7bc-d85eab16607e admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:21.014245 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495bfa6d-44dc-483d-93f5-6a9032eb0f45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:21.014864 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bfa6d-44dc-483d-93f5-6a9032eb0f45 service cinder] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:21.015143 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bfa6d-44dc-483d-93f5-6a9032eb0f45 service cinder] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:21.015412 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bfa6d-44dc-483d-93f5-6a9032eb0f45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:21.023960 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495bfa6d-44dc-483d-93f5-6a9032eb0f45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:21.025765 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495bfa6d-44dc-483d-93f5-6a9032eb0f45 service cinder] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:21.037345 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1048/2096] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:57:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:57:23.631983 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9db7a-0a6c-4bcf-a2a2-6e7c44991793 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:23.696852 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9db7a-0a6c-4bcf-a2a2-6e7c44991793 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:23.701472 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06019372-caa1-4365-9ab9-4b31ba76492f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:23.702096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06019372-caa1-4365-9ab9-4b31ba76492f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:23.702374 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06019372-caa1-4365-9ab9-4b31ba76492f admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:23.702642 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06019372-caa1-4365-9ab9-4b31ba76492f admin admin] PATH_INFO: `/v3/users/87e4ecdf8bd3431aa9a4d081dd9d126b` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:23.703776 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06019372-caa1-4365-9ab9-4b31ba76492f admin admin] RBAC: Authorizing `identity:delete_user(user_id=87e4ecdf8bd3431aa9a4d081dd9d126b)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:23.705843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06019372-caa1-4365-9ab9-4b31ba76492f admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:23.748473 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:23.760310 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-06019372-caa1-4365-9ab9-4b31ba76492f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87e4ecdf8bd3431aa9a4d081dd9d126b'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:23.760980 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-06019372-caa1-4365-9ab9-4b31ba76492f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87e4ecdf8bd3431aa9a4d081dd9d126b'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:23.761944 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-06019372-caa1-4365-9ab9-4b31ba76492f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87e4ecdf8bd3431aa9a4d081dd9d126b'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:23.769193 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-06019372-caa1-4365-9ab9-4b31ba76492f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87e4ecdf8bd3431aa9a4d081dd9d126b'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:23.779171 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-06019372-caa1-4365-9ab9-4b31ba76492f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87e4ecdf8bd3431aa9a4d081dd9d126b'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:23.798031 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1049/2097] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:57:23 2022] DELETE /identity/v3/users/87e4ecdf8bd3431aa9a4d081dd9d126b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:23.802809 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6c94f-e224-4c8a-96cb-c607f926e7ef None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:23.803276 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6c94f-e224-4c8a-96cb-c607f926e7ef None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:23.803463 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6c94f-e224-4c8a-96cb-c607f926e7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:23.823365 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-78a6c94f-e224-4c8a-96cb-c607f926e7ef None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:23.824615 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-78a6c94f-e224-4c8a-96cb-c607f926e7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:23.894304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1049/2098] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:23.904790 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06019372-caa1-4365-9ab9-4b31ba76492f admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:23.906505 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-06019372-caa1-4365-9ab9-4b31ba76492f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:23.973596 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06019372-caa1-4365-9ab9-4b31ba76492f admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:23.977314 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce234854-a27a-4de3-98ca-015f80eb85ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:23.977954 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce234854-a27a-4de3-98ca-015f80eb85ac service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:23.978260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce234854-a27a-4de3-98ca-015f80eb85ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:23.978559 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce234854-a27a-4de3-98ca-015f80eb85ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:23.989320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce234854-a27a-4de3-98ca-015f80eb85ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:23.990866 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce234854-a27a-4de3-98ca-015f80eb85ac service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:24.000623 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1050/2099] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:57:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:57:24.295364 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6c94f-e224-4c8a-96cb-c607f926e7ef None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:24.297164 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-78a6c94f-e224-4c8a-96cb-c607f926e7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:24.309608 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6c94f-e224-4c8a-96cb-c607f926e7ef None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:24.314563 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241de98-9e89-4fb4-8a2d-c72f6e651697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:24.315239 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241de98-9e89-4fb4-8a2d-c72f6e651697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:24.315517 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241de98-9e89-4fb4-8a2d-c72f6e651697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:24.315788 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241de98-9e89-4fb4-8a2d-c72f6e651697 admin admin] PATH_INFO: `/v3/projects/413e700708504d759b0067bb5e0c343d` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:24.316908 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241de98-9e89-4fb4-8a2d-c72f6e651697 admin admin] RBAC: Authorizing `identity:delete_project(project_id=413e700708504d759b0067bb5e0c343d)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:24.319017 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241de98-9e89-4fb4-8a2d-c72f6e651697 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:24.330828 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:24.371882 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-2241de98-9e89-4fb4-8a2d-c72f6e651697 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '413e700708504d759b0067bb5e0c343d', 'request_id': 'req-2241de98-9e89-4fb4-8a2d-c72f6e651697'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:24.377474 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-2241de98-9e89-4fb4-8a2d-c72f6e651697 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '413e700708504d759b0067bb5e0c343d', 'request_id': 'req-2241de98-9e89-4fb4-8a2d-c72f6e651697'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:24.388168 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-2241de98-9e89-4fb4-8a2d-c72f6e651697 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '413e700708504d759b0067bb5e0c343d', 'request_id': 'req-2241de98-9e89-4fb4-8a2d-c72f6e651697'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:24.404077 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-2241de98-9e89-4fb4-8a2d-c72f6e651697 admin admin] The token cache is being invalidate because project 413e700708504d759b0067bb5e0c343d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:57:24.404294 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-2241de98-9e89-4fb4-8a2d-c72f6e651697 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:24.404940 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-2241de98-9e89-4fb4-8a2d-c72f6e651697 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:24.406459 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1050/2100] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:57:24 2022] DELETE /identity/v3/projects/413e700708504d759b0067bb5e0c343d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:24.411537 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d88e4-c634-4bd7-beb1-c6e77c0a252a None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:24.411821 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d88e4-c634-4bd7-beb1-c6e77c0a252a None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:24.412089 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d88e4-c634-4bd7-beb1-c6e77c0a252a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:24.432926 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-981d88e4-c634-4bd7-beb1-c6e77c0a252a None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:24.434809 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-981d88e4-c634-4bd7-beb1-c6e77c0a252a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:24.495498 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1051/2101] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:24.505176 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064afdbd-f2b0-4b4f-959a-46179fffb230 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:24.505484 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064afdbd-f2b0-4b4f-959a-46179fffb230 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:24.505756 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064afdbd-f2b0-4b4f-959a-46179fffb230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:24.526366 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-064afdbd-f2b0-4b4f-959a-46179fffb230 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:24.527654 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-064afdbd-f2b0-4b4f-959a-46179fffb230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:24.536862 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1051/2102] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:24.541124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d88e4-c634-4bd7-beb1-c6e77c0a252a None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:24.552213 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d88e4-c634-4bd7-beb1-c6e77c0a252a None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:24.557281 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce64e40-c748-4315-bcdd-942834351a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:24.557885 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce64e40-c748-4315-bcdd-942834351a33 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:24.558164 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce64e40-c748-4315-bcdd-942834351a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:24.558434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce64e40-c748-4315-bcdd-942834351a33 admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:24.559642 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce64e40-c748-4315-bcdd-942834351a33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:57:24.559966 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce64e40-c748-4315-bcdd-942834351a33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:24.561590 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce64e40-c748-4315-bcdd-942834351a33 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:24.577244 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1052/2103] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:57:24.578358 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064afdbd-f2b0-4b4f-959a-46179fffb230 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:24.589098 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064afdbd-f2b0-4b4f-959a-46179fffb230 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:24.594910 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b2f44-ac10-4c8d-8c50-d5f24c8c093e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:24.595518 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b2f44-ac10-4c8d-8c50-d5f24c8c093e admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:24.595793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b2f44-ac10-4c8d-8c50-d5f24c8c093e admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:24.596058 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b2f44-ac10-4c8d-8c50-d5f24c8c093e admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:24.596714 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053b2f44-ac10-4c8d-8c50-d5f24c8c093e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:24.598667 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053b2f44-ac10-4c8d-8c50-d5f24c8c093e admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:24.629388 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1052/2104] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:57:24 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:57:24.633479 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce64e40-c748-4315-bcdd-942834351a33 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:24.647248 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce64e40-c748-4315-bcdd-942834351a33 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:24.706917 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:24.733222 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329d451-fe61-4c41-bdbb-d70330d1f540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:24.733446 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329d451-fe61-4c41-bdbb-d70330d1f540 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:24.733879 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329d451-fe61-4c41-bdbb-d70330d1f540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:24.734811 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329d451-fe61-4c41-bdbb-d70330d1f540 admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:24.735010 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329d451-fe61-4c41-bdbb-d70330d1f540 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:24.737337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329d451-fe61-4c41-bdbb-d70330d1f540 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:24.762102 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1053/2105] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:57:24 2022] POST /identity/v3/users => generated 292 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 17:57:24.766628 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b2f44-ac10-4c8d-8c50-d5f24c8c093e admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:24.789049 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b2f44-ac10-4c8d-8c50-d5f24c8c093e admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:24.797264 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc1a3a-c84f-41b9-8ee6-eb47de23a9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:24.798421 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc1a3a-c84f-41b9-8ee6-eb47de23a9dc admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:24.798421 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc1a3a-c84f-41b9-8ee6-eb47de23a9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:24.798596 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc1a3a-c84f-41b9-8ee6-eb47de23a9dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:24.799280 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc1a3a-c84f-41b9-8ee6-eb47de23a9dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:24.801043 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc1a3a-c84f-41b9-8ee6-eb47de23a9dc admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:24.817052 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1053/2106] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:57:24.819574 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329d451-fe61-4c41-bdbb-d70330d1f540 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:24.830369 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329d451-fe61-4c41-bdbb-d70330d1f540 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:24.835443 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa9af3-a665-4cef-a78b-8fb67eaa201c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:24.836186 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa9af3-a665-4cef-a78b-8fb67eaa201c admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:24.836578 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa9af3-a665-4cef-a78b-8fb67eaa201c admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:24.836910 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa9af3-a665-4cef-a78b-8fb67eaa201c admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:24.837648 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa9af3-a665-4cef-a78b-8fb67eaa201c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:24.839429 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa9af3-a665-4cef-a78b-8fb67eaa201c admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:24.853039 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1054/2107] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:57:24.854813 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc1a3a-c84f-41b9-8ee6-eb47de23a9dc admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:24.868438 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc1a3a-c84f-41b9-8ee6-eb47de23a9dc admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:24.873484 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a145c04-9944-4fea-9a1e-38cb5355c2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:24.875371 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a145c04-9944-4fea-9a1e-38cb5355c2ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:24.875654 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a145c04-9944-4fea-9a1e-38cb5355c2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:24.875932 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a145c04-9944-4fea-9a1e-38cb5355c2ab admin admin] PATH_INFO: `/v3/projects/6f93c727446e439483aa24b71e2f7ac7/users/7c2171475db2491fb587658613feb080/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:24.891317 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a145c04-9944-4fea-9a1e-38cb5355c2ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f93c727446e439483aa24b71e2f7ac7, user_id=7c2171475db2491fb587658613feb080, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:24.894540 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a145c04-9944-4fea-9a1e-38cb5355c2ab admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:24.909614 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1054/2108] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:57:24 2022] PUT /identity/v3/projects/6f93c727446e439483aa24b71e2f7ac7/users/7c2171475db2491fb587658613feb080/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:24.916294 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbb877-943b-46c8-8d1f-7644538f2505 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:24.916605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbb877-943b-46c8-8d1f-7644538f2505 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:24.916905 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbb877-943b-46c8-8d1f-7644538f2505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:24.938160 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-03dbb877-943b-46c8-8d1f-7644538f2505 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:24.939461 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-03dbb877-943b-46c8-8d1f-7644538f2505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:25.008349 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1055/2109] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:25.020477 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a145c04-9944-4fea-9a1e-38cb5355c2ab admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:25.022329 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-7a145c04-9944-4fea-9a1e-38cb5355c2ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:25.094876 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a145c04-9944-4fea-9a1e-38cb5355c2ab admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:25.106624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39f154-f077-4d10-9172-b7696e5aecdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:25.111072 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39f154-f077-4d10-9172-b7696e5aecdc service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:25.111392 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39f154-f077-4d10-9172-b7696e5aecdc service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:25.111704 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39f154-f077-4d10-9172-b7696e5aecdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:25.139828 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39f154-f077-4d10-9172-b7696e5aecdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:25.141880 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39f154-f077-4d10-9172-b7696e5aecdc service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:25.155304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1055/2110] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:57:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 17:57:25.825141 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdee9f8-5d0d-4e07-8dd8-f1d1d9b006c9 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:25.825620 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdee9f8-5d0d-4e07-8dd8-f1d1d9b006c9 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:25.825791 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdee9f8-5d0d-4e07-8dd8-f1d1d9b006c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:25.856471 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-fcdee9f8-5d0d-4e07-8dd8-f1d1d9b006c9 None None] MFA Rules not processed for user `7c2171475db2491fb587658613feb080`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:25.857704 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-fcdee9f8-5d0d-4e07-8dd8-f1d1d9b006c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:25.946665 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1056/2111] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:25.957262 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39f154-f077-4d10-9172-b7696e5aecdc service neutron] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:25.959286 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-df39f154-f077-4d10-9172-b7696e5aecdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:26.009840 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:26.032499 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39f154-f077-4d10-9172-b7696e5aecdc service neutron] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:26.036119 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8983c-8488-4ec1-a98e-60044891e252 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:26.036871 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8983c-8488-4ec1-a98e-60044891e252 service cinder] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:26.037180 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8983c-8488-4ec1-a98e-60044891e252 service cinder] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:26.037731 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8983c-8488-4ec1-a98e-60044891e252 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:26.046077 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8983c-8488-4ec1-a98e-60044891e252 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:26.047528 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8983c-8488-4ec1-a98e-60044891e252 service cinder] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:26.057790 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1056/2112] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:57:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:57:27.379076 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdee9f8-5d0d-4e07-8dd8-f1d1d9b006c9 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:27.380531 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-fcdee9f8-5d0d-4e07-8dd8-f1d1d9b006c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:27.398228 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdee9f8-5d0d-4e07-8dd8-f1d1d9b006c9 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:27.403020 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93914bb3-7409-4ac7-bd6f-03f5328b7dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:27.403664 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93914bb3-7409-4ac7-bd6f-03f5328b7dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:27.403946 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93914bb3-7409-4ac7-bd6f-03f5328b7dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:27.404227 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93914bb3-7409-4ac7-bd6f-03f5328b7dae admin admin] PATH_INFO: `/v3/users/add7ae6ec25b4305a670ea977d768dfd` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:27.405450 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93914bb3-7409-4ac7-bd6f-03f5328b7dae admin admin] RBAC: Authorizing `identity:delete_user(user_id=add7ae6ec25b4305a670ea977d768dfd)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:27.407437 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93914bb3-7409-4ac7-bd6f-03f5328b7dae admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:27.456339 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98567a-79b2-4939-aa06-ebea083e98af None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:27.456809 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98567a-79b2-4939-aa06-ebea083e98af None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:27.456944 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98567a-79b2-4939-aa06-ebea083e98af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:27.465368 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:27.468074 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-93914bb3-7409-4ac7-bd6f-03f5328b7dae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'add7ae6ec25b4305a670ea977d768dfd'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:27.468839 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-93914bb3-7409-4ac7-bd6f-03f5328b7dae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'add7ae6ec25b4305a670ea977d768dfd'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:27.469820 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-93914bb3-7409-4ac7-bd6f-03f5328b7dae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'add7ae6ec25b4305a670ea977d768dfd'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:27.479846 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-93914bb3-7409-4ac7-bd6f-03f5328b7dae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'add7ae6ec25b4305a670ea977d768dfd'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:27.488459 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-0a98567a-79b2-4939-aa06-ebea083e98af None None] MFA Rules not processed for user `7c2171475db2491fb587658613feb080`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:27.489971 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-0a98567a-79b2-4939-aa06-ebea083e98af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:27.490369 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-93914bb3-7409-4ac7-bd6f-03f5328b7dae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'add7ae6ec25b4305a670ea977d768dfd'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:27.497675 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1057/2113] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:27.509641 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1057/2114] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:57:27 2022] DELETE /identity/v3/users/add7ae6ec25b4305a670ea977d768dfd => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:27.514460 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd4406-ea62-4da0-97e3-44e577a701fd None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:27.514729 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd4406-ea62-4da0-97e3-44e577a701fd None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:27.514999 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd4406-ea62-4da0-97e3-44e577a701fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:27.534370 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-96dd4406-ea62-4da0-97e3-44e577a701fd None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:27.535556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-96dd4406-ea62-4da0-97e3-44e577a701fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:27.610515 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1058/2115] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:27.633931 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93914bb3-7409-4ac7-bd6f-03f5328b7dae admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:27.635624 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-93914bb3-7409-4ac7-bd6f-03f5328b7dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:27.712795 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93914bb3-7409-4ac7-bd6f-03f5328b7dae admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:27.717362 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabdadf-e50a-4696-a9f3-293360dd6bdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:27.718112 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabdadf-e50a-4696-a9f3-293360dd6bdc service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:27.718391 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabdadf-e50a-4696-a9f3-293360dd6bdc service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:27.718662 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabdadf-e50a-4696-a9f3-293360dd6bdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:27.730037 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aabdadf-e50a-4696-a9f3-293360dd6bdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:27.732119 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aabdadf-e50a-4696-a9f3-293360dd6bdc service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:27.746524 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1058/2116] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:57:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:57:28.570682 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd4406-ea62-4da0-97e3-44e577a701fd None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:28.577981 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-96dd4406-ea62-4da0-97e3-44e577a701fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:28.599942 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd4406-ea62-4da0-97e3-44e577a701fd None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:28.613699 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9ac88-59bb-459d-bf64-e10cf9e50766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:28.617106 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9ac88-59bb-459d-bf64-e10cf9e50766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:28.617425 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9ac88-59bb-459d-bf64-e10cf9e50766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:28.617880 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9ac88-59bb-459d-bf64-e10cf9e50766 admin admin] PATH_INFO: `/v3/projects/13811534a853460fba8cb01c5695278a` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:28.619287 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc9ac88-59bb-459d-bf64-e10cf9e50766 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13811534a853460fba8cb01c5695278a)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:28.621928 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc9ac88-59bb-459d-bf64-e10cf9e50766 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:28.678488 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-2bc9ac88-59bb-459d-bf64-e10cf9e50766 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13811534a853460fba8cb01c5695278a', 'request_id': 'req-2bc9ac88-59bb-459d-bf64-e10cf9e50766'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:28.685134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-2bc9ac88-59bb-459d-bf64-e10cf9e50766 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13811534a853460fba8cb01c5695278a', 'request_id': 'req-2bc9ac88-59bb-459d-bf64-e10cf9e50766'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:28.694605 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-2bc9ac88-59bb-459d-bf64-e10cf9e50766 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13811534a853460fba8cb01c5695278a', 'request_id': 'req-2bc9ac88-59bb-459d-bf64-e10cf9e50766'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:28.708034 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-2bc9ac88-59bb-459d-bf64-e10cf9e50766 admin admin] The token cache is being invalidate because project 13811534a853460fba8cb01c5695278a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:57:28.709419 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-2bc9ac88-59bb-459d-bf64-e10cf9e50766 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:28.710367 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-2bc9ac88-59bb-459d-bf64-e10cf9e50766 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:28.712049 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1059/2117] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:57:28 2022] DELETE /identity/v3/projects/13811534a853460fba8cb01c5695278a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:28.717048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeff8c7-8a7b-4098-9bfd-9a9fcd4419d8 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:28.717540 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeff8c7-8a7b-4098-9bfd-9a9fcd4419d8 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:28.717785 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeff8c7-8a7b-4098-9bfd-9a9fcd4419d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:28.739361 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-baeff8c7-8a7b-4098-9bfd-9a9fcd4419d8 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:28.740629 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-baeff8c7-8a7b-4098-9bfd-9a9fcd4419d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:28.818713 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1059/2118] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:28.828139 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc797bae-694e-44f9-bd67-c84501bde9dc None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:28.828423 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc797bae-694e-44f9-bd67-c84501bde9dc None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:28.828693 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc797bae-694e-44f9-bd67-c84501bde9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:28.855955 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-fc797bae-694e-44f9-bd67-c84501bde9dc None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:28.857322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-fc797bae-694e-44f9-bd67-c84501bde9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:28.866469 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1060/2119] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:28.870708 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeff8c7-8a7b-4098-9bfd-9a9fcd4419d8 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:28.888137 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeff8c7-8a7b-4098-9bfd-9a9fcd4419d8 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:28.894607 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d009260-be9c-476c-829b-3d9305413b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:28.896202 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d009260-be9c-476c-829b-3d9305413b82 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:28.896202 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d009260-be9c-476c-829b-3d9305413b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:28.896202 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d009260-be9c-476c-829b-3d9305413b82 admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:28.896498 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d009260-be9c-476c-829b-3d9305413b82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:57:28.896730 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d009260-be9c-476c-829b-3d9305413b82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:28.898447 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d009260-be9c-476c-829b-3d9305413b82 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:28.913498 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1060/2120] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:57:28.918256 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc797bae-694e-44f9-bd67-c84501bde9dc None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:28.928227 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc797bae-694e-44f9-bd67-c84501bde9dc None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:28.947398 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251216e-5a9c-401b-ae63-10d623d7e957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:28.948157 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251216e-5a9c-401b-ae63-10d623d7e957 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:28.948580 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251216e-5a9c-401b-ae63-10d623d7e957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:28.949112 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251216e-5a9c-401b-ae63-10d623d7e957 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:28.950582 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251216e-5a9c-401b-ae63-10d623d7e957 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:28.952901 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251216e-5a9c-401b-ae63-10d623d7e957 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:28.987101 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1061/2121] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:57:28 2022] POST /identity/v3/projects => generated 405 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:57:28.991701 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d009260-be9c-476c-829b-3d9305413b82 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:29.010950 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d009260-be9c-476c-829b-3d9305413b82 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:29.066691 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:29.076746 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97460bda-1bd3-4db0-9559-b7764945f110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:29.077752 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97460bda-1bd3-4db0-9559-b7764945f110 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:29.078590 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97460bda-1bd3-4db0-9559-b7764945f110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:29.078971 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97460bda-1bd3-4db0-9559-b7764945f110 admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:29.079683 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97460bda-1bd3-4db0-9559-b7764945f110 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:29.081933 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97460bda-1bd3-4db0-9559-b7764945f110 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:29.105700 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1061/2122] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:57:28 2022] POST /identity/v3/users => generated 303 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:57:29.110309 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251216e-5a9c-401b-ae63-10d623d7e957 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:29.122293 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251216e-5a9c-401b-ae63-10d623d7e957 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:29.127560 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3082966-7808-4770-9647-94fb6856e6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:29.128376 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3082966-7808-4770-9647-94fb6856e6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:29.128839 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3082966-7808-4770-9647-94fb6856e6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:29.129148 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3082966-7808-4770-9647-94fb6856e6a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:29.130214 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3082966-7808-4770-9647-94fb6856e6a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:29.131399 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3082966-7808-4770-9647-94fb6856e6a0 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:29.143655 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1062/2123] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:57:29.147587 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97460bda-1bd3-4db0-9559-b7764945f110 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:29.158561 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97460bda-1bd3-4db0-9559-b7764945f110 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:29.163918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f01d33-0fee-4971-ac8f-9c5f8c8f3233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:29.165247 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f01d33-0fee-4971-ac8f-9c5f8c8f3233 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:29.165810 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f01d33-0fee-4971-ac8f-9c5f8c8f3233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:29.166228 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f01d33-0fee-4971-ac8f-9c5f8c8f3233 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:29.167173 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f01d33-0fee-4971-ac8f-9c5f8c8f3233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:29.169459 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f01d33-0fee-4971-ac8f-9c5f8c8f3233 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:29.182103 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1062/2124] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:57:29.186988 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3082966-7808-4770-9647-94fb6856e6a0 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:29.195023 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b09b1-8feb-4e08-b0b4-6b6b9902fd0d None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:29.195503 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b09b1-8feb-4e08-b0b4-6b6b9902fd0d None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:29.195950 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b09b1-8feb-4e08-b0b4-6b6b9902fd0d None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:29.197903 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1063/2125] 10.222.0.62 () {54 vars in 921 bytes} [Mon Sep 26 17:57:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 17:57:29.198020 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3082966-7808-4770-9647-94fb6856e6a0 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:29.203474 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321235b4-b5f7-490f-aa81-09927438fe0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:29.204129 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321235b4-b5f7-490f-aa81-09927438fe0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:29.204427 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321235b4-b5f7-490f-aa81-09927438fe0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:29.204866 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321235b4-b5f7-490f-aa81-09927438fe0c admin admin] PATH_INFO: `/v3/projects/7a779ef049a34a4595f648bd56bdeb3f/users/16e163b8f18247e7a5a8022623aaf386/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:29.221686 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321235b4-b5f7-490f-aa81-09927438fe0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a779ef049a34a4595f648bd56bdeb3f, user_id=16e163b8f18247e7a5a8022623aaf386, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:29.224374 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321235b4-b5f7-490f-aa81-09927438fe0c admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:29.227750 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:29.231089 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d60dd1-57ce-492b-b34a-3671c86d3cec None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:29.231448 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d60dd1-57ce-492b-b34a-3671c86d3cec None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:29.231705 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d60dd1-57ce-492b-b34a-3671c86d3cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:29.246853 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1063/2126] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:57:29 2022] PUT /identity/v3/projects/7a779ef049a34a4595f648bd56bdeb3f/users/16e163b8f18247e7a5a8022623aaf386/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:29.252112 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba334e89-9c2a-46ab-8fa0-25a342fac28f None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:29.252768 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba334e89-9c2a-46ab-8fa0-25a342fac28f None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:29.253465 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba334e89-9c2a-46ab-8fa0-25a342fac28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:29.259835 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-91d60dd1-57ce-492b-b34a-3671c86d3cec None None] MFA Rules not processed for user `f5043d835c08458c9f3911a4741bdaa8`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:29.261213 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-91d60dd1-57ce-492b-b34a-3671c86d3cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:29.283471 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-ba334e89-9c2a-46ab-8fa0-25a342fac28f None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:29.284750 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-ba334e89-9c2a-46ab-8fa0-25a342fac28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:29.343789 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1064/2127] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Sep 26 17:57:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:29.350373 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d60dd1-57ce-492b-b34a-3671c86d3cec None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:29.352233 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-91d60dd1-57ce-492b-b34a-3671c86d3cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:29.365150 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1064/2128] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:29.366074 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba334e89-9c2a-46ab-8fa0-25a342fac28f None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:29.367695 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-ba334e89-9c2a-46ab-8fa0-25a342fac28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:29.376797 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d60dd1-57ce-492b-b34a-3671c86d3cec None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:29.381989 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a3ba6-bca1-47f7-a844-71b4e50d6b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:29.382620 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba334e89-9c2a-46ab-8fa0-25a342fac28f None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:29.382741 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a3ba6-bca1-47f7-a844-71b4e50d6b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:29.383094 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a3ba6-bca1-47f7-a844-71b4e50d6b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:29.383442 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a3ba6-bca1-47f7-a844-71b4e50d6b77 admin admin] PATH_INFO: `/v3/users/79701852036c4622aa6f6bde71f7b2b9` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:29.384678 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a3ba6-bca1-47f7-a844-71b4e50d6b77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79701852036c4622aa6f6bde71f7b2b9)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:29.387438 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a3ba6-bca1-47f7-a844-71b4e50d6b77 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:29.393449 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba80f27d-ecec-431b-9956-0b7f5e99de30 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5043d835c08458c9f3911a4741bdaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:29.394328 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80f27d-ecec-431b-9956-0b7f5e99de30 service placement] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:29.394823 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80f27d-ecec-431b-9956-0b7f5e99de30 service placement] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:29.395161 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80f27d-ecec-431b-9956-0b7f5e99de30 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:29.407410 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba80f27d-ecec-431b-9956-0b7f5e99de30 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:29.409700 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba80f27d-ecec-431b-9956-0b7f5e99de30 service placement] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:29.423823 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1065/2129] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:57:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:57:29.424678 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba80f27d-ecec-431b-9956-0b7f5e99de30 service placement] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:29.426118 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-ba80f27d-ecec-431b-9956-0b7f5e99de30 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:29.465547 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-5a6a3ba6-bca1-47f7-a844-71b4e50d6b77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79701852036c4622aa6f6bde71f7b2b9'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:29.469750 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-5a6a3ba6-bca1-47f7-a844-71b4e50d6b77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79701852036c4622aa6f6bde71f7b2b9'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:29.470776 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-5a6a3ba6-bca1-47f7-a844-71b4e50d6b77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79701852036c4622aa6f6bde71f7b2b9'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:29.482634 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-5a6a3ba6-bca1-47f7-a844-71b4e50d6b77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79701852036c4622aa6f6bde71f7b2b9'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:29.492906 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-5a6a3ba6-bca1-47f7-a844-71b4e50d6b77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79701852036c4622aa6f6bde71f7b2b9'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:29.499411 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba80f27d-ecec-431b-9956-0b7f5e99de30 service placement] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:29.503918 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ada08-4a84-4968-a081-c4ce4b8a97d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:29.504596 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ada08-4a84-4968-a081-c4ce4b8a97d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:29.504941 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ada08-4a84-4968-a081-c4ce4b8a97d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:29.507418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ada08-4a84-4968-a081-c4ce4b8a97d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:29.508898 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-739ada08-4a84-4968-a081-c4ce4b8a97d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:29.514525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1065/2130] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:57:29 2022] DELETE /identity/v3/users/79701852036c4622aa6f6bde71f7b2b9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:29.526561 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ada08-4a84-4968-a081-c4ce4b8a97d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:29.528909 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ada08-4a84-4968-a081-c4ce4b8a97d9 service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:29.544807 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1066/2131] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:57:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:57:29.912059 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a3ba6-bca1-47f7-a844-71b4e50d6b77 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:29.913997 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-5a6a3ba6-bca1-47f7-a844-71b4e50d6b77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:29.993794 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:30.024770 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a3ba6-bca1-47f7-a844-71b4e50d6b77 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:30.029620 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488d977-8db1-407f-bd3a-5f0510ca0dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:30.030658 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488d977-8db1-407f-bd3a-5f0510ca0dc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:30.030942 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488d977-8db1-407f-bd3a-5f0510ca0dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:30.031217 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488d977-8db1-407f-bd3a-5f0510ca0dc4 admin admin] PATH_INFO: `/v3/projects/92c069ddb4784266961827ef0304840c` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:30.032392 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c488d977-8db1-407f-bd3a-5f0510ca0dc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92c069ddb4784266961827ef0304840c)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:30.034339 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c488d977-8db1-407f-bd3a-5f0510ca0dc4 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:30.084716 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-c488d977-8db1-407f-bd3a-5f0510ca0dc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92c069ddb4784266961827ef0304840c', 'request_id': 'req-c488d977-8db1-407f-bd3a-5f0510ca0dc4'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:30.090663 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-c488d977-8db1-407f-bd3a-5f0510ca0dc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92c069ddb4784266961827ef0304840c', 'request_id': 'req-c488d977-8db1-407f-bd3a-5f0510ca0dc4'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:30.098215 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-c488d977-8db1-407f-bd3a-5f0510ca0dc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92c069ddb4784266961827ef0304840c', 'request_id': 'req-c488d977-8db1-407f-bd3a-5f0510ca0dc4'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:30.110677 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-c488d977-8db1-407f-bd3a-5f0510ca0dc4 admin admin] The token cache is being invalidate because project 92c069ddb4784266961827ef0304840c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:57:30.110988 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-c488d977-8db1-407f-bd3a-5f0510ca0dc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:30.111658 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-c488d977-8db1-407f-bd3a-5f0510ca0dc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:30.113871 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1066/2132] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:57:29 2022] DELETE /identity/v3/projects/92c069ddb4784266961827ef0304840c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:30.117816 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ada08-4a84-4968-a081-c4ce4b8a97d9 service neutron] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:30.128901 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ada08-4a84-4968-a081-c4ce4b8a97d9 service neutron] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:30.190519 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cdf681-a564-4a5c-9c15-a5404dd5b9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:30.191168 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdf681-a564-4a5c-9c15-a5404dd5b9a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:30.191447 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdf681-a564-4a5c-9c15-a5404dd5b9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:30.191721 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdf681-a564-4a5c-9c15-a5404dd5b9a5 admin admin] PATH_INFO: `/v3/users/8d89e2fcfc5f4025b91653f90ced4af9` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:30.192987 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cdf681-a564-4a5c-9c15-a5404dd5b9a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d89e2fcfc5f4025b91653f90ced4af9)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:30.195844 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cdf681-a564-4a5c-9c15-a5404dd5b9a5 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:30.228235 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:INSERT=1,keystone:SELECT=95,keystone:DELETE=4 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:30.251180 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-82cdf681-a564-4a5c-9c15-a5404dd5b9a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d89e2fcfc5f4025b91653f90ced4af9'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:30.260295 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-82cdf681-a564-4a5c-9c15-a5404dd5b9a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d89e2fcfc5f4025b91653f90ced4af9'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:30.261126 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-82cdf681-a564-4a5c-9c15-a5404dd5b9a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d89e2fcfc5f4025b91653f90ced4af9'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:30.261863 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-82cdf681-a564-4a5c-9c15-a5404dd5b9a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d89e2fcfc5f4025b91653f90ced4af9'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:30.269436 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-82cdf681-a564-4a5c-9c15-a5404dd5b9a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d89e2fcfc5f4025b91653f90ced4af9'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:30.291632 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1067/2133] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:57:30 2022] DELETE /identity/v3/users/8d89e2fcfc5f4025b91653f90ced4af9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:30.484082 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488d977-8db1-407f-bd3a-5f0510ca0dc4 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:30.486024 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-c488d977-8db1-407f-bd3a-5f0510ca0dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:30.505186 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488d977-8db1-407f-bd3a-5f0510ca0dc4 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:30.559217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c14e40-33f9-4663-8ac4-d461e3acadd8 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:30.559713 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c14e40-33f9-4663-8ac4-d461e3acadd8 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:30.560262 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c14e40-33f9-4663-8ac4-d461e3acadd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:30.579869 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f6164-1dd1-4935-8ff6-6aff7b47430d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:30.580535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f6164-1dd1-4935-8ff6-6aff7b47430d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:30.580815 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f6164-1dd1-4935-8ff6-6aff7b47430d admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:30.581127 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f6164-1dd1-4935-8ff6-6aff7b47430d admin admin] PATH_INFO: `/v3/projects/ca2163a5cd33422f96a95e4c2c6c23d9` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:30.583132 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f6164-1dd1-4935-8ff6-6aff7b47430d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca2163a5cd33422f96a95e4c2c6c23d9)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:30.585822 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f6164-1dd1-4935-8ff6-6aff7b47430d admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:30.627372 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-45c14e40-33f9-4663-8ac4-d461e3acadd8 None None] MFA Rules not processed for user `16e163b8f18247e7a5a8022623aaf386`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:30.630473 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-45c14e40-33f9-4663-8ac4-d461e3acadd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:30.659106 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-833f6164-1dd1-4935-8ff6-6aff7b47430d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca2163a5cd33422f96a95e4c2c6c23d9', 'request_id': 'req-833f6164-1dd1-4935-8ff6-6aff7b47430d'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:30.675889 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-833f6164-1dd1-4935-8ff6-6aff7b47430d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca2163a5cd33422f96a95e4c2c6c23d9', 'request_id': 'req-833f6164-1dd1-4935-8ff6-6aff7b47430d'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:30.686627 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-833f6164-1dd1-4935-8ff6-6aff7b47430d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca2163a5cd33422f96a95e4c2c6c23d9', 'request_id': 'req-833f6164-1dd1-4935-8ff6-6aff7b47430d'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:30.699323 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:30.704414 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-833f6164-1dd1-4935-8ff6-6aff7b47430d admin admin] The token cache is being invalidate because project ca2163a5cd33422f96a95e4c2c6c23d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:57:30.704838 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-833f6164-1dd1-4935-8ff6-6aff7b47430d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:30.705614 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-833f6164-1dd1-4935-8ff6-6aff7b47430d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:30.722503 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1067/2134] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:57:30 2022] DELETE /identity/v3/projects/ca2163a5cd33422f96a95e4c2c6c23d9 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:30.727788 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c610d-a4ac-4d30-842c-ec2d8f3814f9 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:30.728438 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c610d-a4ac-4d30-842c-ec2d8f3814f9 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:30.729688 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c610d-a4ac-4d30-842c-ec2d8f3814f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:30.777264 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-ef1c610d-a4ac-4d30-842c-ec2d8f3814f9 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:30.778206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-ef1c610d-a4ac-4d30-842c-ec2d8f3814f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:30.782619 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1068/2135] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:30 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:57:30.786331 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c14e40-33f9-4663-8ac4-d461e3acadd8 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:30.787744 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-45c14e40-33f9-4663-8ac4-d461e3acadd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:30.803814 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c14e40-33f9-4663-8ac4-d461e3acadd8 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:30.873238 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1068/2136] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:57:30.881602 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766d749-2244-4203-b571-5420b5b7d12d None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:30.882614 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766d749-2244-4203-b571-5420b5b7d12d None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:30.883023 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766d749-2244-4203-b571-5420b5b7d12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:30.898540 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65eeaa-ee23-4e21-b85f-ab3cc79e1f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:30.899154 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65eeaa-ee23-4e21-b85f-ab3cc79e1f76 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:30.899441 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65eeaa-ee23-4e21-b85f-ab3cc79e1f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:30.899708 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65eeaa-ee23-4e21-b85f-ab3cc79e1f76 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:30.900799 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65eeaa-ee23-4e21-b85f-ab3cc79e1f76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:30.902289 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65eeaa-ee23-4e21-b85f-ab3cc79e1f76 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:30.905139 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-d766d749-2244-4203-b571-5420b5b7d12d None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:30.906791 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-d766d749-2244-4203-b571-5420b5b7d12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:30.915233 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1069/2137] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:30.919380 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766d749-2244-4203-b571-5420b5b7d12d None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:30.929146 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766d749-2244-4203-b571-5420b5b7d12d None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:30.935241 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55250f-ca28-4f4b-8ea3-814c1683d23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:30.935855 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55250f-ca28-4f4b-8ea3-814c1683d23c admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:30.936134 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55250f-ca28-4f4b-8ea3-814c1683d23c admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:30.936596 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1069/2138] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:57:30 2022] POST /identity/v3/projects => generated 405 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 17:57:30.936712 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55250f-ca28-4f4b-8ea3-814c1683d23c admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:30.937930 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55250f-ca28-4f4b-8ea3-814c1683d23c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:57:30.938246 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55250f-ca28-4f4b-8ea3-814c1683d23c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:30.940410 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55250f-ca28-4f4b-8ea3-814c1683d23c admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:30.940621 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65eeaa-ee23-4e21-b85f-ab3cc79e1f76 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:30.954423 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1070/2139] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:57:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:57:30.958809 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55250f-ca28-4f4b-8ea3-814c1683d23c admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:30.966605 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:30.969110 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55250f-ca28-4f4b-8ea3-814c1683d23c admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:31.032694 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65eeaa-ee23-4e21-b85f-ab3cc79e1f76 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:31.041309 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32af837-f4ff-46ae-a765-aabb30ed55b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:31.041309 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32af837-f4ff-46ae-a765-aabb30ed55b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:31.041309 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32af837-f4ff-46ae-a765-aabb30ed55b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:31.041309 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32af837-f4ff-46ae-a765-aabb30ed55b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:31.041811 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32af837-f4ff-46ae-a765-aabb30ed55b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:31.043041 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32af837-f4ff-46ae-a765-aabb30ed55b7 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:31.058453 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192b498-459d-4ecb-bf3c-39a48185730b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:31.059117 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192b498-459d-4ecb-bf3c-39a48185730b admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:31.059408 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192b498-459d-4ecb-bf3c-39a48185730b admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:31.059684 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192b498-459d-4ecb-bf3c-39a48185730b admin admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:31.060436 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a192b498-459d-4ecb-bf3c-39a48185730b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:31.063041 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a192b498-459d-4ecb-bf3c-39a48185730b admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:31.067283 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1070/2140] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:57:30 2022] POST /identity/v3/users => generated 309 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:57:31.071049 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32af837-f4ff-46ae-a765-aabb30ed55b7 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:31.081867 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32af837-f4ff-46ae-a765-aabb30ed55b7 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:31.088372 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14651b-7d1e-4d06-9c9e-9988b3b87cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:31.088899 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14651b-7d1e-4d06-9c9e-9988b3b87cea admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:31.089673 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14651b-7d1e-4d06-9c9e-9988b3b87cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:31.090763 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14651b-7d1e-4d06-9c9e-9988b3b87cea admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:31.091533 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de14651b-7d1e-4d06-9c9e-9988b3b87cea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:31.093450 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de14651b-7d1e-4d06-9c9e-9988b3b87cea admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:31.096750 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1071/2141] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:57:30 2022] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 17:57:31.101048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192b498-459d-4ecb-bf3c-39a48185730b admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:31.108833 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1071/2142] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 17:57:31.113452 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14651b-7d1e-4d06-9c9e-9988b3b87cea admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:31.124573 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14651b-7d1e-4d06-9c9e-9988b3b87cea admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:31.181968 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192b498-459d-4ecb-bf3c-39a48185730b admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:31.186866 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e42d6-cb72-41b5-b96c-91877978a009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:31.187496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e42d6-cb72-41b5-b96c-91877978a009 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:31.187775 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e42d6-cb72-41b5-b96c-91877978a009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:31.188048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e42d6-cb72-41b5-b96c-91877978a009 admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:31.188693 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e42d6-cb72-41b5-b96c-91877978a009 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:31.192069 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e42d6-cb72-41b5-b96c-91877978a009 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:31.205757 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:31.213697 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada015c-6f4e-4b71-b9bf-11fc8d41dfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:31.214764 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada015c-6f4e-4b71-b9bf-11fc8d41dfda admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:31.215173 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada015c-6f4e-4b71-b9bf-11fc8d41dfda admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:31.216335 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada015c-6f4e-4b71-b9bf-11fc8d41dfda admin admin] PATH_INFO: `/v3/projects/f345555fec344596a56a14727aec382f/users/9c6db2ea884c494aa52f62d63cc1601b/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:31.221830 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1072/2143] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:57:31 2022] POST /identity/v3/users => generated 288 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 17:57:31.225467 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e42d6-cb72-41b5-b96c-91877978a009 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:31.234415 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada015c-6f4e-4b71-b9bf-11fc8d41dfda admin admin] RBAC: Authorizing `identity:create_grant(project_id=f345555fec344596a56a14727aec382f, user_id=9c6db2ea884c494aa52f62d63cc1601b, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:31.239017 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada015c-6f4e-4b71-b9bf-11fc8d41dfda admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:31.239464 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e42d6-cb72-41b5-b96c-91877978a009 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:31.250348 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7a1f2-070f-454a-a770-93e723d6cffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:31.251268 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7a1f2-070f-454a-a770-93e723d6cffc admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:31.251601 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7a1f2-070f-454a-a770-93e723d6cffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:31.251943 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7a1f2-070f-454a-a770-93e723d6cffc admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:31.253612 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7a1f2-070f-454a-a770-93e723d6cffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:31.255431 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7a1f2-070f-454a-a770-93e723d6cffc admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:31.259085 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1072/2144] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:57:31 2022] PUT /identity/v3/projects/f345555fec344596a56a14727aec382f/users/9c6db2ea884c494aa52f62d63cc1601b/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:57:31.269204 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada015c-6f4e-4b71-b9bf-11fc8d41dfda admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:31.269378 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1073/2145] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 17:57:31.271607 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7a1f2-070f-454a-a770-93e723d6cffc admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:31.284770 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7a1f2-070f-454a-a770-93e723d6cffc admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:31.343961 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada015c-6f4e-4b71-b9bf-11fc8d41dfda admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:31.349277 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e55b2-2eb1-499e-a047-718da1ad8af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:31.349945 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e55b2-2eb1-499e-a047-718da1ad8af0 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:31.350222 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e55b2-2eb1-499e-a047-718da1ad8af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:31.350498 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e55b2-2eb1-499e-a047-718da1ad8af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:31.352074 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e55b2-2eb1-499e-a047-718da1ad8af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:31.352304 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321760e-b0be-4610-9c39-314181be2fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:31.352304 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321760e-b0be-4610-9c39-314181be2fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:31.352524 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321760e-b0be-4610-9c39-314181be2fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:31.352918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321760e-b0be-4610-9c39-314181be2fa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:31.353615 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e55b2-2eb1-499e-a047-718da1ad8af0 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:31.353807 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c321760e-b0be-4610-9c39-314181be2fa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:31.355769 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c321760e-b0be-4610-9c39-314181be2fa3 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:31.367019 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1074/2146] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 17:57:31.368523 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1073/2147] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:57:31.372964 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321760e-b0be-4610-9c39-314181be2fa3 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:31.375204 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e55b2-2eb1-499e-a047-718da1ad8af0 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:31.384867 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321760e-b0be-4610-9c39-314181be2fa3 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:31.389518 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e55b2-2eb1-499e-a047-718da1ad8af0 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:31.395243 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840222b-a2ce-4e82-87b2-c00aabd26746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:31.395910 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840222b-a2ce-4e82-87b2-c00aabd26746 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:31.396192 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840222b-a2ce-4e82-87b2-c00aabd26746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:31.396467 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840222b-a2ce-4e82-87b2-c00aabd26746 admin admin] PATH_INFO: `/v3/projects/f345555fec344596a56a14727aec382f/users/9c6db2ea884c494aa52f62d63cc1601b/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:31.397837 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38386f-9057-4ad9-b9c0-a87d6059df27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:31.398467 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840222b-a2ce-4e82-87b2-c00aabd26746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f345555fec344596a56a14727aec382f, user_id=9c6db2ea884c494aa52f62d63cc1601b, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:31.398690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38386f-9057-4ad9-b9c0-a87d6059df27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:31.399063 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38386f-9057-4ad9-b9c0-a87d6059df27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:31.399434 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38386f-9057-4ad9-b9c0-a87d6059df27 admin admin] PATH_INFO: `/v3/projects/9bb002bb5f564a62bc3a26e80da079e6/users/672c0a555c54422da68ec83e97f7dc5d/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:31.401182 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840222b-a2ce-4e82-87b2-c00aabd26746 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:31.414325 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1075/2148] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:57:31 2022] PUT /identity/v3/projects/f345555fec344596a56a14727aec382f/users/9c6db2ea884c494aa52f62d63cc1601b/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:57:31.415884 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:31.420026 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38386f-9057-4ad9-b9c0-a87d6059df27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bb002bb5f564a62bc3a26e80da079e6, user_id=672c0a555c54422da68ec83e97f7dc5d, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:31.423245 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38386f-9057-4ad9-b9c0-a87d6059df27 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:31.441102 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1074/2149] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:57:31 2022] PUT /identity/v3/projects/9bb002bb5f564a62bc3a26e80da079e6/users/672c0a555c54422da68ec83e97f7dc5d/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:57:31.450926 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bddfa7-604e-4a20-afb1-50b31c9b2d80 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:31.451215 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bddfa7-604e-4a20-afb1-50b31c9b2d80 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:31.451488 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bddfa7-604e-4a20-afb1-50b31c9b2d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:31.483987 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-d5bddfa7-604e-4a20-afb1-50b31c9b2d80 None None] MFA Rules not processed for user `672c0a555c54422da68ec83e97f7dc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:31.485728 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-d5bddfa7-604e-4a20-afb1-50b31c9b2d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:31.571663 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1076/2150] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:57:31.579841 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38386f-9057-4ad9-b9c0-a87d6059df27 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:31.582318 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-3d38386f-9057-4ad9-b9c0-a87d6059df27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:31.667811 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38386f-9057-4ad9-b9c0-a87d6059df27 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:31.673784 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878e91a-874b-42af-9712-c6624aae340f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:31.674619 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878e91a-874b-42af-9712-c6624aae340f service cinder] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:31.674903 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878e91a-874b-42af-9712-c6624aae340f service cinder] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:31.675177 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878e91a-874b-42af-9712-c6624aae340f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:31.685510 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6878e91a-874b-42af-9712-c6624aae340f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:31.687013 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6878e91a-874b-42af-9712-c6624aae340f service cinder] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:31.698802 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1075/2151] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:57:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:57:32.382780 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c3862-914b-4ddb-821c-f447f13ab4dd None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:32.383289 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c3862-914b-4ddb-821c-f447f13ab4dd None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:32.383289 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c3862-914b-4ddb-821c-f447f13ab4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:32.425070 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-d56c3862-914b-4ddb-821c-f447f13ab4dd None None] MFA Rules not processed for user `9c6db2ea884c494aa52f62d63cc1601b`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:32.426348 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-d56c3862-914b-4ddb-821c-f447f13ab4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:32.485953 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:32.520620 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1077/2152] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:32 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:33.702533 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878e91a-874b-42af-9712-c6624aae340f service cinder] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:33.765905 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878e91a-874b-42af-9712-c6624aae340f service cinder] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:33.770361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb172df8-0a1a-4405-8afd-47c07eb62447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:33.770979 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb172df8-0a1a-4405-8afd-47c07eb62447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:33.771256 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb172df8-0a1a-4405-8afd-47c07eb62447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:33.771526 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb172df8-0a1a-4405-8afd-47c07eb62447 admin admin] PATH_INFO: `/v3/users/16e163b8f18247e7a5a8022623aaf386` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:33.772630 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb172df8-0a1a-4405-8afd-47c07eb62447 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16e163b8f18247e7a5a8022623aaf386)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:33.774709 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb172df8-0a1a-4405-8afd-47c07eb62447 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:33.826129 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-fb172df8-0a1a-4405-8afd-47c07eb62447 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16e163b8f18247e7a5a8022623aaf386'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:33.835044 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-fb172df8-0a1a-4405-8afd-47c07eb62447 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16e163b8f18247e7a5a8022623aaf386'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:33.836132 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-fb172df8-0a1a-4405-8afd-47c07eb62447 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16e163b8f18247e7a5a8022623aaf386'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:33.836981 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-fb172df8-0a1a-4405-8afd-47c07eb62447 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16e163b8f18247e7a5a8022623aaf386'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:33.845397 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-fb172df8-0a1a-4405-8afd-47c07eb62447 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16e163b8f18247e7a5a8022623aaf386'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:33.873138 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1076/2153] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:57:33 2022] DELETE /identity/v3/users/16e163b8f18247e7a5a8022623aaf386 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:34.069430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c3862-914b-4ddb-821c-f447f13ab4dd None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:34.083970 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c3862-914b-4ddb-821c-f447f13ab4dd None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:34.150364 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b5729-3187-4a05-9de7-61ff26c060f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:34.151000 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b5729-3187-4a05-9de7-61ff26c060f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:34.151283 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b5729-3187-4a05-9de7-61ff26c060f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:34.151557 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b5729-3187-4a05-9de7-61ff26c060f5 admin admin] PATH_INFO: `/v3/projects/7a779ef049a34a4595f648bd56bdeb3f` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:34.152745 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767b5729-3187-4a05-9de7-61ff26c060f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a779ef049a34a4595f648bd56bdeb3f)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:34.154699 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767b5729-3187-4a05-9de7-61ff26c060f5 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:34.215007 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-767b5729-3187-4a05-9de7-61ff26c060f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a779ef049a34a4595f648bd56bdeb3f', 'request_id': 'req-767b5729-3187-4a05-9de7-61ff26c060f5'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:34.232863 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-767b5729-3187-4a05-9de7-61ff26c060f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a779ef049a34a4595f648bd56bdeb3f', 'request_id': 'req-767b5729-3187-4a05-9de7-61ff26c060f5'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:34.241354 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-767b5729-3187-4a05-9de7-61ff26c060f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a779ef049a34a4595f648bd56bdeb3f', 'request_id': 'req-767b5729-3187-4a05-9de7-61ff26c060f5'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:34.257654 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-767b5729-3187-4a05-9de7-61ff26c060f5 admin admin] The token cache is being invalidate because project 7a779ef049a34a4595f648bd56bdeb3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:57:34.258088 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-767b5729-3187-4a05-9de7-61ff26c060f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:34.258872 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-767b5729-3187-4a05-9de7-61ff26c060f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:34.260907 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1078/2154] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:57:34 2022] DELETE /identity/v3/projects/7a779ef049a34a4595f648bd56bdeb3f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:34.266090 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb172df8-0a1a-4405-8afd-47c07eb62447 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:34.270407 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-fb172df8-0a1a-4405-8afd-47c07eb62447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:34.285311 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb172df8-0a1a-4405-8afd-47c07eb62447 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:34.299776 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:34.358857 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afae0b5-aafe-4567-b206-29b8f63dbf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:34.359493 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afae0b5-aafe-4567-b206-29b8f63dbf30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:34.359777 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afae0b5-aafe-4567-b206-29b8f63dbf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:34.360052 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afae0b5-aafe-4567-b206-29b8f63dbf30 admin admin] PATH_INFO: `/v3/users/9c6db2ea884c494aa52f62d63cc1601b` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:34.361209 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afae0b5-aafe-4567-b206-29b8f63dbf30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c6db2ea884c494aa52f62d63cc1601b)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:34.363763 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afae0b5-aafe-4567-b206-29b8f63dbf30 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:34.436051 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-1afae0b5-aafe-4567-b206-29b8f63dbf30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c6db2ea884c494aa52f62d63cc1601b'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:34.444128 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-1afae0b5-aafe-4567-b206-29b8f63dbf30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c6db2ea884c494aa52f62d63cc1601b'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:34.444885 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-1afae0b5-aafe-4567-b206-29b8f63dbf30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c6db2ea884c494aa52f62d63cc1601b'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:34.445643 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-1afae0b5-aafe-4567-b206-29b8f63dbf30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c6db2ea884c494aa52f62d63cc1601b'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:34.457482 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-1afae0b5-aafe-4567-b206-29b8f63dbf30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c6db2ea884c494aa52f62d63cc1601b'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:34.477045 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1077/2155] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:57:34 2022] DELETE /identity/v3/users/9c6db2ea884c494aa52f62d63cc1601b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:34.701975 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b5729-3187-4a05-9de7-61ff26c060f5 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:34.703540 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-767b5729-3187-4a05-9de7-61ff26c060f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:34.717682 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b5729-3187-4a05-9de7-61ff26c060f5 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:34.791906 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e6b0a-b57e-4f02-98e6-cd4caa45de3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:34.792560 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e6b0a-b57e-4f02-98e6-cd4caa45de3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:34.792834 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e6b0a-b57e-4f02-98e6-cd4caa45de3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:34.793136 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e6b0a-b57e-4f02-98e6-cd4caa45de3d admin admin] PATH_INFO: `/v3/projects/f345555fec344596a56a14727aec382f` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:34.794981 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e6b0a-b57e-4f02-98e6-cd4caa45de3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f345555fec344596a56a14727aec382f)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:34.796898 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e6b0a-b57e-4f02-98e6-cd4caa45de3d admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:34.816844 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:34.853881 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-c44e6b0a-b57e-4f02-98e6-cd4caa45de3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f345555fec344596a56a14727aec382f', 'request_id': 'req-c44e6b0a-b57e-4f02-98e6-cd4caa45de3d'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:34.858273 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-c44e6b0a-b57e-4f02-98e6-cd4caa45de3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f345555fec344596a56a14727aec382f', 'request_id': 'req-c44e6b0a-b57e-4f02-98e6-cd4caa45de3d'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:34.866204 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-c44e6b0a-b57e-4f02-98e6-cd4caa45de3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f345555fec344596a56a14727aec382f', 'request_id': 'req-c44e6b0a-b57e-4f02-98e6-cd4caa45de3d'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:34.878261 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-c44e6b0a-b57e-4f02-98e6-cd4caa45de3d admin admin] The token cache is being invalidate because project f345555fec344596a56a14727aec382f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:57:34.878546 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-c44e6b0a-b57e-4f02-98e6-cd4caa45de3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:34.879178 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-c44e6b0a-b57e-4f02-98e6-cd4caa45de3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:34.880845 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1079/2156] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:57:34 2022] DELETE /identity/v3/projects/f345555fec344596a56a14727aec382f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:34.885675 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d992bda-b626-4052-9171-28de73ce8cc7 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:34.886116 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d992bda-b626-4052-9171-28de73ce8cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:34.886207 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d992bda-b626-4052-9171-28de73ce8cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:34.906906 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-2d992bda-b626-4052-9171-28de73ce8cc7 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:34.908179 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-2d992bda-b626-4052-9171-28de73ce8cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:34.972919 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1078/2157] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:34.980649 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a29ae-dbe0-4a6b-88fc-08b5df2ef63b None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:34.981466 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a29ae-dbe0-4a6b-88fc-08b5df2ef63b None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:34.981743 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a29ae-dbe0-4a6b-88fc-08b5df2ef63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:35.004192 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-e67a29ae-dbe0-4a6b-88fc-08b5df2ef63b None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:35.005443 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-e67a29ae-dbe0-4a6b-88fc-08b5df2ef63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:35.016981 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1080/2158] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:35.021496 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d992bda-b626-4052-9171-28de73ce8cc7 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:35.032949 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d992bda-b626-4052-9171-28de73ce8cc7 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:35.037796 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d98ab7-58da-4355-b478-87687527a4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:35.038407 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d98ab7-58da-4355-b478-87687527a4e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:35.038681 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d98ab7-58da-4355-b478-87687527a4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:35.038975 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d98ab7-58da-4355-b478-87687527a4e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:35.039723 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d98ab7-58da-4355-b478-87687527a4e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:57:35.039971 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d98ab7-58da-4355-b478-87687527a4e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:35.042076 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d98ab7-58da-4355-b478-87687527a4e3 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:35.056265 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1079/2159] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:57:35.061337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a29ae-dbe0-4a6b-88fc-08b5df2ef63b None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:35.071600 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a29ae-dbe0-4a6b-88fc-08b5df2ef63b None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:35.076431 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a59ee0-2f08-468a-92a5-426eb7f09b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:35.077137 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a59ee0-2f08-468a-92a5-426eb7f09b46 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:35.077413 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a59ee0-2f08-468a-92a5-426eb7f09b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:35.077683 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a59ee0-2f08-468a-92a5-426eb7f09b46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:35.078387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a59ee0-2f08-468a-92a5-426eb7f09b46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:35.080892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a59ee0-2f08-468a-92a5-426eb7f09b46 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:35.112429 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1081/2160] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:57:35 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:57:35.116884 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d98ab7-58da-4355-b478-87687527a4e3 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:35.128451 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d98ab7-58da-4355-b478-87687527a4e3 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:35.146843 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:35.203122 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8cbb1-282e-4860-93b7-96247676ef75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:35.203766 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8cbb1-282e-4860-93b7-96247676ef75 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:35.204072 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8cbb1-282e-4860-93b7-96247676ef75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:35.204343 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8cbb1-282e-4860-93b7-96247676ef75 admin admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:35.205002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8cbb1-282e-4860-93b7-96247676ef75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:35.207015 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8cbb1-282e-4860-93b7-96247676ef75 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:35.227719 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1080/2161] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:57:35 2022] POST /identity/v3/users => generated 283 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:57:35.231822 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a59ee0-2f08-468a-92a5-426eb7f09b46 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:35.242588 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a59ee0-2f08-468a-92a5-426eb7f09b46 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:35.247898 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816ba09-7160-4733-87ef-5f9b3f992344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:35.248498 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816ba09-7160-4733-87ef-5f9b3f992344 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:35.248780 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816ba09-7160-4733-87ef-5f9b3f992344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:35.249078 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816ba09-7160-4733-87ef-5f9b3f992344 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:35.249724 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f816ba09-7160-4733-87ef-5f9b3f992344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:35.251454 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f816ba09-7160-4733-87ef-5f9b3f992344 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:35.262142 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1082/2162] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:57:35.266707 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8cbb1-282e-4860-93b7-96247676ef75 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:35.277212 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8cbb1-282e-4860-93b7-96247676ef75 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:35.282021 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13d730-5d68-4db6-9cb7-a6db50564352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:35.282637 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13d730-5d68-4db6-9cb7-a6db50564352 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:35.282912 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13d730-5d68-4db6-9cb7-a6db50564352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:35.283192 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13d730-5d68-4db6-9cb7-a6db50564352 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:35.283833 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c13d730-5d68-4db6-9cb7-a6db50564352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:35.285478 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c13d730-5d68-4db6-9cb7-a6db50564352 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:35.296671 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1081/2163] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:57:35.303599 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816ba09-7160-4733-87ef-5f9b3f992344 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:35.314527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816ba09-7160-4733-87ef-5f9b3f992344 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:35.319153 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec112411-01f7-4fe0-9afa-cd9427ef0cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:35.319800 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec112411-01f7-4fe0-9afa-cd9427ef0cb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:35.320077 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec112411-01f7-4fe0-9afa-cd9427ef0cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:35.320351 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec112411-01f7-4fe0-9afa-cd9427ef0cb8 admin admin] PATH_INFO: `/v3/projects/098f83b9ae614c038a82636fac8feaab/users/a0a5bd2870e14818b6952b94d161e499/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:35.337886 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec112411-01f7-4fe0-9afa-cd9427ef0cb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=098f83b9ae614c038a82636fac8feaab, user_id=a0a5bd2870e14818b6952b94d161e499, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:35.341099 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec112411-01f7-4fe0-9afa-cd9427ef0cb8 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:35.355596 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1083/2164] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:57:35 2022] PUT /identity/v3/projects/098f83b9ae614c038a82636fac8feaab/users/a0a5bd2870e14818b6952b94d161e499/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:35.366099 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7b7fe-8eee-4663-bae0-8378f62a5c14 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:35.366381 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7b7fe-8eee-4663-bae0-8378f62a5c14 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:35.366652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7b7fe-8eee-4663-bae0-8378f62a5c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:35.395759 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-c9a7b7fe-8eee-4663-bae0-8378f62a5c14 None None] MFA Rules not processed for user `a0a5bd2870e14818b6952b94d161e499`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:35.396959 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-c9a7b7fe-8eee-4663-bae0-8378f62a5c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:35.459669 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1082/2165] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:35.464511 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec112411-01f7-4fe0-9afa-cd9427ef0cb8 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:35.525537 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec112411-01f7-4fe0-9afa-cd9427ef0cb8 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:35.530223 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d04a5-d4b7-465a-94a3-85f5a7d65b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:35.530820 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d04a5-d4b7-465a-94a3-85f5a7d65b77 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:35.531107 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d04a5-d4b7-465a-94a3-85f5a7d65b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:35.531374 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d04a5-d4b7-465a-94a3-85f5a7d65b77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:35.532013 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d04a5-d4b7-465a-94a3-85f5a7d65b77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:35.533972 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d04a5-d4b7-465a-94a3-85f5a7d65b77 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:35.562941 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1084/2166] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:57:35 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:57:35.565368 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7b7fe-8eee-4663-bae0-8378f62a5c14 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:35.575721 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7b7fe-8eee-4663-bae0-8378f62a5c14 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:35.634414 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42011b2d-a364-434b-bef5-f44f197c66c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:35.635027 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42011b2d-a364-434b-bef5-f44f197c66c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:35.635306 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42011b2d-a364-434b-bef5-f44f197c66c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:35.635578 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42011b2d-a364-434b-bef5-f44f197c66c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:35.636229 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42011b2d-a364-434b-bef5-f44f197c66c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:35.638192 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42011b2d-a364-434b-bef5-f44f197c66c8 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:35.659781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1083/2167] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:57:35 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:57:35.663993 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d04a5-d4b7-465a-94a3-85f5a7d65b77 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:35.674991 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d04a5-d4b7-465a-94a3-85f5a7d65b77 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:35.679922 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83ccc3-3019-45d4-bf0c-8fd7e153bbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:35.680531 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83ccc3-3019-45d4-bf0c-8fd7e153bbad admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:35.680810 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83ccc3-3019-45d4-bf0c-8fd7e153bbad admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:35.681111 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83ccc3-3019-45d4-bf0c-8fd7e153bbad admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:35.681760 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83ccc3-3019-45d4-bf0c-8fd7e153bbad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:35.683363 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83ccc3-3019-45d4-bf0c-8fd7e153bbad admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:35.694895 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1085/2168] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:57:35.698978 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42011b2d-a364-434b-bef5-f44f197c66c8 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:35.709667 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42011b2d-a364-434b-bef5-f44f197c66c8 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:35.714562 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04529bac-9015-4dbd-9c95-e166eb7b2adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:35.715262 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04529bac-9015-4dbd-9c95-e166eb7b2adf admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:35.715539 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04529bac-9015-4dbd-9c95-e166eb7b2adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:35.715816 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04529bac-9015-4dbd-9c95-e166eb7b2adf admin admin] PATH_INFO: `/v3/projects/f8b5d287ef9a4778baad1555195afc61/users/18a38fb3bf394c549a737cafdc4b2351/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:35.731479 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04529bac-9015-4dbd-9c95-e166eb7b2adf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8b5d287ef9a4778baad1555195afc61, user_id=18a38fb3bf394c549a737cafdc4b2351, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:35.734210 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04529bac-9015-4dbd-9c95-e166eb7b2adf admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:35.736465 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:35.749937 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1084/2169] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:57:35 2022] PUT /identity/v3/projects/f8b5d287ef9a4778baad1555195afc61/users/18a38fb3bf394c549a737cafdc4b2351/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:57:35.753916 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83ccc3-3019-45d4-bf0c-8fd7e153bbad admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:35.764134 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83ccc3-3019-45d4-bf0c-8fd7e153bbad admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:35.775739 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:35.825965 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b206ee1-436a-4ab0-b4c6-fd623e4b01fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:35.826494 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b206ee1-436a-4ab0-b4c6-fd623e4b01fc admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:35.826770 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b206ee1-436a-4ab0-b4c6-fd623e4b01fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:35.827039 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b206ee1-436a-4ab0-b4c6-fd623e4b01fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:35.827673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b206ee1-436a-4ab0-b4c6-fd623e4b01fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:35.829386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b206ee1-436a-4ab0-b4c6-fd623e4b01fc admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:35.839436 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1086/2170] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:57:35.844249 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04529bac-9015-4dbd-9c95-e166eb7b2adf admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:35.854410 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04529bac-9015-4dbd-9c95-e166eb7b2adf admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:35.859588 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c02c8a-d445-4f2c-aba2-3c5c439f1a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:35.860232 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c02c8a-d445-4f2c-aba2-3c5c439f1a04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:35.860508 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c02c8a-d445-4f2c-aba2-3c5c439f1a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:35.860780 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c02c8a-d445-4f2c-aba2-3c5c439f1a04 admin admin] PATH_INFO: `/v3/projects/f8b5d287ef9a4778baad1555195afc61/users/18a38fb3bf394c549a737cafdc4b2351/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:35.862730 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c02c8a-d445-4f2c-aba2-3c5c439f1a04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8b5d287ef9a4778baad1555195afc61, user_id=18a38fb3bf394c549a737cafdc4b2351, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:35.865409 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c02c8a-d445-4f2c-aba2-3c5c439f1a04 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:35.875440 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1085/2171] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:57:35 2022] PUT /identity/v3/projects/f8b5d287ef9a4778baad1555195afc61/users/18a38fb3bf394c549a737cafdc4b2351/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:35.886573 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e65eca-a3b5-4932-8a45-217fa28e43ca None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:35.886889 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e65eca-a3b5-4932-8a45-217fa28e43ca None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:35.887233 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e65eca-a3b5-4932-8a45-217fa28e43ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:35.916746 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-a3e65eca-a3b5-4932-8a45-217fa28e43ca None None] MFA Rules not processed for user `18a38fb3bf394c549a737cafdc4b2351`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:35.917980 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-a3e65eca-a3b5-4932-8a45-217fa28e43ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:35.985868 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1087/2172] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:35 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:35.990329 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c02c8a-d445-4f2c-aba2-3c5c439f1a04 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:35.992081 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-b4c02c8a-d445-4f2c-aba2-3c5c439f1a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:35.997221 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e65eca-a3b5-4932-8a45-217fa28e43ca None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:35.998582 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-a3e65eca-a3b5-4932-8a45-217fa28e43ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:36.064734 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c02c8a-d445-4f2c-aba2-3c5c439f1a04 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:36.069324 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e65eca-a3b5-4932-8a45-217fa28e43ca None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:36.070172 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d191be66-7768-4213-b710-688142ffc45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:36.070804 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191be66-7768-4213-b710-688142ffc45c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:36.071204 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191be66-7768-4213-b710-688142ffc45c admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:36.071481 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191be66-7768-4213-b710-688142ffc45c admin admin] PATH_INFO: `/v3/users/672c0a555c54422da68ec83e97f7dc5d` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:36.072602 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d191be66-7768-4213-b710-688142ffc45c admin admin] RBAC: Authorizing `identity:delete_user(user_id=672c0a555c54422da68ec83e97f7dc5d)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:36.073110 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bb6e2-1d6e-41ce-a423-f82f2caca599 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:36.073709 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bb6e2-1d6e-41ce-a423-f82f2caca599 service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:36.073982 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bb6e2-1d6e-41ce-a423-f82f2caca599 service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:36.074269 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bb6e2-1d6e-41ce-a423-f82f2caca599 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:36.074567 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d191be66-7768-4213-b710-688142ffc45c admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:36.083375 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449bb6e2-1d6e-41ce-a423-f82f2caca599 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:36.084796 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449bb6e2-1d6e-41ce-a423-f82f2caca599 service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:36.095171 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1088/2173] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:57:35 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 17:57:36.122855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-d191be66-7768-4213-b710-688142ffc45c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '672c0a555c54422da68ec83e97f7dc5d'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:36.133238 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-d191be66-7768-4213-b710-688142ffc45c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '672c0a555c54422da68ec83e97f7dc5d'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:36.133890 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-d191be66-7768-4213-b710-688142ffc45c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '672c0a555c54422da68ec83e97f7dc5d'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:36.134515 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-d191be66-7768-4213-b710-688142ffc45c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '672c0a555c54422da68ec83e97f7dc5d'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:36.141893 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-d191be66-7768-4213-b710-688142ffc45c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '672c0a555c54422da68ec83e97f7dc5d'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:36.159558 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1086/2174] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:57:35 2022] DELETE /identity/v3/users/672c0a555c54422da68ec83e97f7dc5d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:36.164256 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab4260-1aa4-4fe5-84cb-37b959610097 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:36.164425 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab4260-1aa4-4fe5-84cb-37b959610097 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:36.164697 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab4260-1aa4-4fe5-84cb-37b959610097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:36.186271 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-f5ab4260-1aa4-4fe5-84cb-37b959610097 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:36.187481 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-f5ab4260-1aa4-4fe5-84cb-37b959610097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:36.227375 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:36.257707 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1089/2175] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:36.272374 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d191be66-7768-4213-b710-688142ffc45c admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:36.273872 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-d191be66-7768-4213-b710-688142ffc45c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:36.358101 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d191be66-7768-4213-b710-688142ffc45c admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:36.361909 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389836af-f6bc-46cc-ab71-ce3377aad19e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:36.362719 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389836af-f6bc-46cc-ab71-ce3377aad19e service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:36.363064 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389836af-f6bc-46cc-ab71-ce3377aad19e service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:36.363397 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389836af-f6bc-46cc-ab71-ce3377aad19e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:36.398401 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389836af-f6bc-46cc-ab71-ce3377aad19e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:36.399996 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389836af-f6bc-46cc-ab71-ce3377aad19e service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:36.413443 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1087/2176] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:57:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:57:36.592307 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab4260-1aa4-4fe5-84cb-37b959610097 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:36.593775 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-f5ab4260-1aa4-4fe5-84cb-37b959610097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:36.612821 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab4260-1aa4-4fe5-84cb-37b959610097 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:36.622469 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317dc1c-e01a-41f6-a64f-99e0d73f50b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:36.623126 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317dc1c-e01a-41f6-a64f-99e0d73f50b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:36.623410 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317dc1c-e01a-41f6-a64f-99e0d73f50b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:36.623680 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317dc1c-e01a-41f6-a64f-99e0d73f50b3 admin admin] PATH_INFO: `/v3/users/a0a5bd2870e14818b6952b94d161e499` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:36.624923 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317dc1c-e01a-41f6-a64f-99e0d73f50b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0a5bd2870e14818b6952b94d161e499)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:36.626974 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317dc1c-e01a-41f6-a64f-99e0d73f50b3 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:36.676850 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-a317dc1c-e01a-41f6-a64f-99e0d73f50b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0a5bd2870e14818b6952b94d161e499'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:36.677539 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-a317dc1c-e01a-41f6-a64f-99e0d73f50b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0a5bd2870e14818b6952b94d161e499'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:36.678160 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-a317dc1c-e01a-41f6-a64f-99e0d73f50b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0a5bd2870e14818b6952b94d161e499'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:36.687174 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-a317dc1c-e01a-41f6-a64f-99e0d73f50b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0a5bd2870e14818b6952b94d161e499'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:36.695681 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-a317dc1c-e01a-41f6-a64f-99e0d73f50b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0a5bd2870e14818b6952b94d161e499'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:36.715758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1090/2177] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:57:36 2022] DELETE /identity/v3/users/a0a5bd2870e14818b6952b94d161e499 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:36.720253 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a261c-f397-400b-be02-3bfccca1f5ec None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:36.720543 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a261c-f397-400b-be02-3bfccca1f5ec None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:36.720854 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a261c-f397-400b-be02-3bfccca1f5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:36.730165 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:36.746180 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-062a261c-f397-400b-be02-3bfccca1f5ec None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:36.748076 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-062a261c-f397-400b-be02-3bfccca1f5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:36.751207 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317dc1c-e01a-41f6-a64f-99e0d73f50b3 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:36.752661 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-a317dc1c-e01a-41f6-a64f-99e0d73f50b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:36.821322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1088/2178] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:36.830274 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a261c-f397-400b-be02-3bfccca1f5ec None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:36.831773 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-062a261c-f397-400b-be02-3bfccca1f5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:36.839299 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317dc1c-e01a-41f6-a64f-99e0d73f50b3 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:36.844170 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff768e9-c2ff-46ec-a2a8-0441bf15238f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:36.844855 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff768e9-c2ff-46ec-a2a8-0441bf15238f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:36.845157 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff768e9-c2ff-46ec-a2a8-0441bf15238f admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:36.845429 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff768e9-c2ff-46ec-a2a8-0441bf15238f admin admin] PATH_INFO: `/v3/projects/9bb002bb5f564a62bc3a26e80da079e6` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:36.846751 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff768e9-c2ff-46ec-a2a8-0441bf15238f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bb002bb5f564a62bc3a26e80da079e6)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:36.848504 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff768e9-c2ff-46ec-a2a8-0441bf15238f admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:36.899587 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a261c-f397-400b-be02-3bfccca1f5ec None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:36.901671 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-7ff768e9-c2ff-46ec-a2a8-0441bf15238f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bb002bb5f564a62bc3a26e80da079e6', 'request_id': 'req-7ff768e9-c2ff-46ec-a2a8-0441bf15238f'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:36.905054 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:36.912010 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-7ff768e9-c2ff-46ec-a2a8-0441bf15238f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bb002bb5f564a62bc3a26e80da079e6', 'request_id': 'req-7ff768e9-c2ff-46ec-a2a8-0441bf15238f'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:36.921053 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-7ff768e9-c2ff-46ec-a2a8-0441bf15238f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bb002bb5f564a62bc3a26e80da079e6', 'request_id': 'req-7ff768e9-c2ff-46ec-a2a8-0441bf15238f'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:36.933106 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-7ff768e9-c2ff-46ec-a2a8-0441bf15238f admin admin] The token cache is being invalidate because project 9bb002bb5f564a62bc3a26e80da079e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:57:36.940942 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-7ff768e9-c2ff-46ec-a2a8-0441bf15238f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:36.941610 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-7ff768e9-c2ff-46ec-a2a8-0441bf15238f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:36.943381 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1091/2179] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:57:36 2022] DELETE /identity/v3/projects/9bb002bb5f564a62bc3a26e80da079e6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:57:36.949196 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e785a0-b78d-48e4-a3f6-1cc23eb8ef6f None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:36.949196 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e785a0-b78d-48e4-a3f6-1cc23eb8ef6f None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:36.949196 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e785a0-b78d-48e4-a3f6-1cc23eb8ef6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:36.963386 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bab098-27d7-46c0-9e7c-b91dbb864688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:36.964095 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bab098-27d7-46c0-9e7c-b91dbb864688 service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:36.964375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bab098-27d7-46c0-9e7c-b91dbb864688 service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:36.964647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bab098-27d7-46c0-9e7c-b91dbb864688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:36.966472 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-d1bab098-27d7-46c0-9e7c-b91dbb864688 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:36.969748 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-51e785a0-b78d-48e4-a3f6-1cc23eb8ef6f None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:36.970938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-51e785a0-b78d-48e4-a3f6-1cc23eb8ef6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:37.033126 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bab098-27d7-46c0-9e7c-b91dbb864688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:37.033802 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1092/2180] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:57:37.034573 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bab098-27d7-46c0-9e7c-b91dbb864688 service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:37.041312 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3783c-9365-4f8e-8795-05781f4b783d None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:37.041599 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3783c-9365-4f8e-8795-05781f4b783d None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:37.041872 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3783c-9365-4f8e-8795-05781f4b783d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:37.044420 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1089/2181] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:57:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 17:57:37.062590 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-def3783c-9365-4f8e-8795-05781f4b783d None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:37.063841 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-def3783c-9365-4f8e-8795-05781f4b783d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:37.072260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1093/2182] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:57:37.076644 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bab098-27d7-46c0-9e7c-b91dbb864688 service neutron] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:37.087415 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bab098-27d7-46c0-9e7c-b91dbb864688 service neutron] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:37.093732 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d3858-cdca-4000-8122-4169bc80f5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:37.094285 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d3858-cdca-4000-8122-4169bc80f5da admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:37.094579 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d3858-cdca-4000-8122-4169bc80f5da admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:37.094910 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d3858-cdca-4000-8122-4169bc80f5da admin admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:37.095815 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d3858-cdca-4000-8122-4169bc80f5da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:57:37.095926 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d3858-cdca-4000-8122-4169bc80f5da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:37.097995 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d3858-cdca-4000-8122-4169bc80f5da admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:37.102031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:37.113635 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1090/2183] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:57:37.126155 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3783c-9365-4f8e-8795-05781f4b783d None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:37.136447 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3783c-9365-4f8e-8795-05781f4b783d None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:37.142148 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd6cb0-2e27-49a9-bd24-f9ad8d0e7140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:37.142766 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd6cb0-2e27-49a9-bd24-f9ad8d0e7140 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:37.143178 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd6cb0-2e27-49a9-bd24-f9ad8d0e7140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:37.143456 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd6cb0-2e27-49a9-bd24-f9ad8d0e7140 admin admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:37.144096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd6cb0-2e27-49a9-bd24-f9ad8d0e7140 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:37.146068 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd6cb0-2e27-49a9-bd24-f9ad8d0e7140 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:37.179020 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1094/2184] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:57:37 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:57:37.180458 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d3858-cdca-4000-8122-4169bc80f5da admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:37.190646 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d3858-cdca-4000-8122-4169bc80f5da admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:37.269475 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3563398-6c7f-49eb-922f-e8088d4d9396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:37.270112 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3563398-6c7f-49eb-922f-e8088d4d9396 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:37.270391 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3563398-6c7f-49eb-922f-e8088d4d9396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:37.270664 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3563398-6c7f-49eb-922f-e8088d4d9396 admin admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:37.271311 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3563398-6c7f-49eb-922f-e8088d4d9396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:37.273274 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3563398-6c7f-49eb-922f-e8088d4d9396 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:37.298328 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1091/2185] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:57:37 2022] POST /identity/v3/users => generated 292 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:57:37.299628 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd6cb0-2e27-49a9-bd24-f9ad8d0e7140 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:37.310278 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd6cb0-2e27-49a9-bd24-f9ad8d0e7140 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:37.315856 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278c4a9-6c68-492b-9a69-7d312484a94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:37.316791 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278c4a9-6c68-492b-9a69-7d312484a94d admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:37.317168 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278c4a9-6c68-492b-9a69-7d312484a94d admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:37.317896 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278c4a9-6c68-492b-9a69-7d312484a94d admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:37.318328 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e278c4a9-6c68-492b-9a69-7d312484a94d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:37.320261 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e278c4a9-6c68-492b-9a69-7d312484a94d admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:37.333717 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1095/2186] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:57:37.338423 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3563398-6c7f-49eb-922f-e8088d4d9396 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:37.345296 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278c4a9-6c68-492b-9a69-7d312484a94d admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:37.347578 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-e278c4a9-6c68-492b-9a69-7d312484a94d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:37.350924 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3563398-6c7f-49eb-922f-e8088d4d9396 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:37.355882 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e593a9-0e02-4761-a543-75f5e618f918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:37.356502 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e593a9-0e02-4761-a543-75f5e618f918 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:37.356783 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e593a9-0e02-4761-a543-75f5e618f918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:37.357083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e593a9-0e02-4761-a543-75f5e618f918 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:37.357743 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e593a9-0e02-4761-a543-75f5e618f918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:37.359348 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e593a9-0e02-4761-a543-75f5e618f918 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:37.372866 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278c4a9-6c68-492b-9a69-7d312484a94d admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:37.377063 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1092/2187] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:57:37.380292 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e593a9-0e02-4761-a543-75f5e618f918 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:37.383262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a27342-50db-4b6e-a8ca-5953efb41e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:37.384090 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a27342-50db-4b6e-a8ca-5953efb41e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:37.384550 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a27342-50db-4b6e-a8ca-5953efb41e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:37.384830 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a27342-50db-4b6e-a8ca-5953efb41e72 admin admin] PATH_INFO: `/v3/projects/098f83b9ae614c038a82636fac8feaab` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:37.386139 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a27342-50db-4b6e-a8ca-5953efb41e72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=098f83b9ae614c038a82636fac8feaab)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:37.394194 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a27342-50db-4b6e-a8ca-5953efb41e72 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:37.399468 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e593a9-0e02-4761-a543-75f5e618f918 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:37.404912 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02639199-2d8c-47b6-a95f-48ff0cfc2a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:37.405878 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02639199-2d8c-47b6-a95f-48ff0cfc2a35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:37.406163 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02639199-2d8c-47b6-a95f-48ff0cfc2a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:37.406433 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02639199-2d8c-47b6-a95f-48ff0cfc2a35 admin admin] PATH_INFO: `/v3/projects/542a2b4f73894073808e9384c8a40c5c/users/61b45a6567cc41ffba7f77c8261152ea/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:37.422485 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02639199-2d8c-47b6-a95f-48ff0cfc2a35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=542a2b4f73894073808e9384c8a40c5c, user_id=61b45a6567cc41ffba7f77c8261152ea, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:37.425190 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02639199-2d8c-47b6-a95f-48ff0cfc2a35 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:37.440464 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1093/2188] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:57:37 2022] PUT /identity/v3/projects/542a2b4f73894073808e9384c8a40c5c/users/61b45a6567cc41ffba7f77c8261152ea/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:57:37.452936 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a2de4-4375-4e66-b4b8-ac8697660591 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:37.453256 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a2de4-4375-4e66-b4b8-ac8697660591 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:37.453631 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-66a27342-50db-4b6e-a8ca-5953efb41e72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '098f83b9ae614c038a82636fac8feaab', 'request_id': 'req-66a27342-50db-4b6e-a8ca-5953efb41e72'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:37.453760 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a2de4-4375-4e66-b4b8-ac8697660591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:37.462840 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-66a27342-50db-4b6e-a8ca-5953efb41e72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '098f83b9ae614c038a82636fac8feaab', 'request_id': 'req-66a27342-50db-4b6e-a8ca-5953efb41e72'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:37.471545 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-66a27342-50db-4b6e-a8ca-5953efb41e72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '098f83b9ae614c038a82636fac8feaab', 'request_id': 'req-66a27342-50db-4b6e-a8ca-5953efb41e72'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:37.485179 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-e96a2de4-4375-4e66-b4b8-ac8697660591 None None] MFA Rules not processed for user `61b45a6567cc41ffba7f77c8261152ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:37.486668 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-e96a2de4-4375-4e66-b4b8-ac8697660591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:37.486930 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-66a27342-50db-4b6e-a8ca-5953efb41e72 admin admin] The token cache is being invalidate because project 098f83b9ae614c038a82636fac8feaab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:57:37.487205 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-66a27342-50db-4b6e-a8ca-5953efb41e72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:37.487929 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-66a27342-50db-4b6e-a8ca-5953efb41e72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:37.490095 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1096/2189] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:57:37 2022] DELETE /identity/v3/projects/098f83b9ae614c038a82636fac8feaab => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:37.494034 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a27342-50db-4b6e-a8ca-5953efb41e72 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:37.495839 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-66a27342-50db-4b6e-a8ca-5953efb41e72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:37.531642 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:37.563544 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1094/2190] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:57:37.568005 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a2de4-4375-4e66-b4b8-ac8697660591 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:37.570453 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-e96a2de4-4375-4e66-b4b8-ac8697660591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:37.574346 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a27342-50db-4b6e-a8ca-5953efb41e72 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:37.581223 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba90d1-b2ce-404f-9171-b694f6f95a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:37.581915 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba90d1-b2ce-404f-9171-b694f6f95a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:37.582268 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba90d1-b2ce-404f-9171-b694f6f95a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:37.582603 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba90d1-b2ce-404f-9171-b694f6f95a15 admin admin] PATH_INFO: `/v3/users/18a38fb3bf394c549a737cafdc4b2351` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:37.583730 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba90d1-b2ce-404f-9171-b694f6f95a15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18a38fb3bf394c549a737cafdc4b2351)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:37.586024 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba90d1-b2ce-404f-9171-b694f6f95a15 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:37.588644 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a2de4-4375-4e66-b4b8-ac8697660591 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:37.594426 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8d8af-a91b-43ec-a672-e21e5f487d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:37.595090 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8d8af-a91b-43ec-a672-e21e5f487d7d admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:37.595422 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8d8af-a91b-43ec-a672-e21e5f487d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:37.595640 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8d8af-a91b-43ec-a672-e21e5f487d7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:37.596710 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d8d8af-a91b-43ec-a672-e21e5f487d7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:37.599286 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d8d8af-a91b-43ec-a672-e21e5f487d7d admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:37.631944 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1095/2191] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:57:37 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 17:57:37.635654 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8d8af-a91b-43ec-a672-e21e5f487d7d admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:37.638795 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-56ba90d1-b2ce-404f-9171-b694f6f95a15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18a38fb3bf394c549a737cafdc4b2351'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:37.639460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-56ba90d1-b2ce-404f-9171-b694f6f95a15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18a38fb3bf394c549a737cafdc4b2351'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:37.647078 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-56ba90d1-b2ce-404f-9171-b694f6f95a15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18a38fb3bf394c549a737cafdc4b2351'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:37.654894 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-56ba90d1-b2ce-404f-9171-b694f6f95a15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18a38fb3bf394c549a737cafdc4b2351'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:37.656997 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:37.664543 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-56ba90d1-b2ce-404f-9171-b694f6f95a15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18a38fb3bf394c549a737cafdc4b2351'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:37.685219 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1097/2192] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:57:37 2022] DELETE /identity/v3/users/18a38fb3bf394c549a737cafdc4b2351 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:37.713437 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8d8af-a91b-43ec-a672-e21e5f487d7d admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:37.785136 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be423bf-89d1-46f7-bc5c-b3f2ccf109ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:37.785705 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be423bf-89d1-46f7-bc5c-b3f2ccf109ca admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:37.786023 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be423bf-89d1-46f7-bc5c-b3f2ccf109ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:37.786251 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be423bf-89d1-46f7-bc5c-b3f2ccf109ca admin admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:37.786887 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be423bf-89d1-46f7-bc5c-b3f2ccf109ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:37.788983 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be423bf-89d1-46f7-bc5c-b3f2ccf109ca admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:37.818354 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1096/2193] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:57:37 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 17:57:37.822492 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba90d1-b2ce-404f-9171-b694f6f95a15 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:37.823960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-56ba90d1-b2ce-404f-9171-b694f6f95a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:37.841224 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba90d1-b2ce-404f-9171-b694f6f95a15 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:37.844433 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9280f1b-008c-4e12-a722-f6b68e606add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:37.845063 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9280f1b-008c-4e12-a722-f6b68e606add admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:37.845349 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9280f1b-008c-4e12-a722-f6b68e606add admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:37.845675 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9280f1b-008c-4e12-a722-f6b68e606add admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:37.846451 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9280f1b-008c-4e12-a722-f6b68e606add admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:37.848076 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9280f1b-008c-4e12-a722-f6b68e606add admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:37.863048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1098/2194] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:57:37.864328 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be423bf-89d1-46f7-bc5c-b3f2ccf109ca admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:37.875214 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be423bf-89d1-46f7-bc5c-b3f2ccf109ca admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:37.881460 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399eab2a-e724-4eba-b5cf-533c9ae027a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:37.882271 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399eab2a-e724-4eba-b5cf-533c9ae027a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:37.882917 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399eab2a-e724-4eba-b5cf-533c9ae027a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:37.883304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399eab2a-e724-4eba-b5cf-533c9ae027a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:37.884074 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399eab2a-e724-4eba-b5cf-533c9ae027a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:37.885643 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399eab2a-e724-4eba-b5cf-533c9ae027a5 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:37.896407 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1097/2195] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:57:37.900561 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9280f1b-008c-4e12-a722-f6b68e606add admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:37.911562 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9280f1b-008c-4e12-a722-f6b68e606add admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:37.916234 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82b70f-5a30-4f8e-91da-a752ef7ec552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:37.916886 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82b70f-5a30-4f8e-91da-a752ef7ec552 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:37.917323 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82b70f-5a30-4f8e-91da-a752ef7ec552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:37.917602 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82b70f-5a30-4f8e-91da-a752ef7ec552 admin admin] PATH_INFO: `/v3/projects/e5cc6d3eb4c9476ca5c1fd1a276271c3/users/7657f1c55f984a468e9ad88a060de51d/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:37.933617 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82b70f-5a30-4f8e-91da-a752ef7ec552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5cc6d3eb4c9476ca5c1fd1a276271c3, user_id=7657f1c55f984a468e9ad88a060de51d, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:37.936869 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82b70f-5a30-4f8e-91da-a752ef7ec552 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:37.955929 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1099/2196] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:57:37 2022] PUT /identity/v3/projects/e5cc6d3eb4c9476ca5c1fd1a276271c3/users/7657f1c55f984a468e9ad88a060de51d/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:57:37.967317 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a017aa-e41c-4e3d-975c-ce83adcae654 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:37.967607 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a017aa-e41c-4e3d-975c-ce83adcae654 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:37.967880 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a017aa-e41c-4e3d-975c-ce83adcae654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:38.020793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-85a017aa-e41c-4e3d-975c-ce83adcae654 None None] MFA Rules not processed for user `7657f1c55f984a468e9ad88a060de51d`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:38.023870 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-85a017aa-e41c-4e3d-975c-ce83adcae654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:38.120811 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1098/2197] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:38.123561 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82b70f-5a30-4f8e-91da-a752ef7ec552 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:38.158107 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a017aa-e41c-4e3d-975c-ce83adcae654 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:38.159573 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-85a017aa-e41c-4e3d-975c-ce83adcae654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:38.239519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82b70f-5a30-4f8e-91da-a752ef7ec552 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:38.247222 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:38.252058 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1a79a-73b8-489b-8f73-e11b675c8699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:38.253474 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1a79a-73b8-489b-8f73-e11b675c8699 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:38.254445 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1a79a-73b8-489b-8f73-e11b675c8699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:38.259932 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1a79a-73b8-489b-8f73-e11b675c8699 admin admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:38.261037 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca1a79a-73b8-489b-8f73-e11b675c8699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:38.263239 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca1a79a-73b8-489b-8f73-e11b675c8699 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:38.289051 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a017aa-e41c-4e3d-975c-ce83adcae654 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:38.294219 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:38.295104 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf1d1f-0eea-4792-9043-abc5fab2bf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:38.295767 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf1d1f-0eea-4792-9043-abc5fab2bf99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:38.296681 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf1d1f-0eea-4792-9043-abc5fab2bf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:38.297143 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf1d1f-0eea-4792-9043-abc5fab2bf99 admin admin] PATH_INFO: `/v3/projects/f8b5d287ef9a4778baad1555195afc61` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:38.298740 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf1d1f-0eea-4792-9043-abc5fab2bf99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8b5d287ef9a4778baad1555195afc61)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:38.301138 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf1d1f-0eea-4792-9043-abc5fab2bf99 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:38.317143 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1100/2198] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:57:38 2022] POST /identity/v3/projects => generated 383 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:57:38.318162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1a79a-73b8-489b-8f73-e11b675c8699 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:38.359579 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-60bf1d1f-0eea-4792-9043-abc5fab2bf99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8b5d287ef9a4778baad1555195afc61', 'request_id': 'req-60bf1d1f-0eea-4792-9043-abc5fab2bf99'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:38.367969 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-60bf1d1f-0eea-4792-9043-abc5fab2bf99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8b5d287ef9a4778baad1555195afc61', 'request_id': 'req-60bf1d1f-0eea-4792-9043-abc5fab2bf99'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:38.379341 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-60bf1d1f-0eea-4792-9043-abc5fab2bf99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8b5d287ef9a4778baad1555195afc61', 'request_id': 'req-60bf1d1f-0eea-4792-9043-abc5fab2bf99'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:38.397436 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-60bf1d1f-0eea-4792-9043-abc5fab2bf99 admin admin] The token cache is being invalidate because project f8b5d287ef9a4778baad1555195afc61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:57:38.397733 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-60bf1d1f-0eea-4792-9043-abc5fab2bf99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:38.398424 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-60bf1d1f-0eea-4792-9043-abc5fab2bf99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:38.400167 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1099/2199] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:57:38 2022] DELETE /identity/v3/projects/f8b5d287ef9a4778baad1555195afc61 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:38.404307 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1a79a-73b8-489b-8f73-e11b675c8699 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:38.406587 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672932c-863e-4e62-817c-52977576328a None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:38.407051 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672932c-863e-4e62-817c-52977576328a None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:38.407528 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672932c-863e-4e62-817c-52977576328a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:38.429992 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-4672932c-863e-4e62-817c-52977576328a None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:38.431202 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-4672932c-863e-4e62-817c-52977576328a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:38.465426 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d7cf5-7d96-4d4a-8c04-246aaa872720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:38.466073 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d7cf5-7d96-4d4a-8c04-246aaa872720 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:38.466356 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d7cf5-7d96-4d4a-8c04-246aaa872720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:38.466634 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d7cf5-7d96-4d4a-8c04-246aaa872720 admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:38.467270 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d7cf5-7d96-4d4a-8c04-246aaa872720 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:38.469263 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d7cf5-7d96-4d4a-8c04-246aaa872720 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:38.499907 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1101/2200] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:57:38 2022] POST /identity/v3/users => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 17:57:38.501439 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d7cf5-7d96-4d4a-8c04-246aaa872720 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:38.503879 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-dd2d7cf5-7d96-4d4a-8c04-246aaa872720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:38.504560 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1100/2201] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:38.512693 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee86a5-1c8d-4a2c-8226-ad9c63b73c8f None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:38.513050 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee86a5-1c8d-4a2c-8226-ad9c63b73c8f None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:38.513442 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee86a5-1c8d-4a2c-8226-ad9c63b73c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:38.517913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d7cf5-7d96-4d4a-8c04-246aaa872720 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:38.523563 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c44c32-b416-4e10-baaf-599dcd366eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:38.524606 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c44c32-b416-4e10-baaf-599dcd366eeb admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:38.524606 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c44c32-b416-4e10-baaf-599dcd366eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:38.524822 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c44c32-b416-4e10-baaf-599dcd366eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:38.525448 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c44c32-b416-4e10-baaf-599dcd366eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:38.527210 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c44c32-b416-4e10-baaf-599dcd366eeb admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:38.537448 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-01ee86a5-1c8d-4a2c-8226-ad9c63b73c8f None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:38.538077 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1102/2202] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:57:38.538748 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-01ee86a5-1c8d-4a2c-8226-ad9c63b73c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:38.542092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c44c32-b416-4e10-baaf-599dcd366eeb admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:38.547594 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1101/2203] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:57:38.552908 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c44c32-b416-4e10-baaf-599dcd366eeb admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:38.554418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee86a5-1c8d-4a2c-8226-ad9c63b73c8f None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:38.563050 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326919a-4de2-4d47-9429-085e84b95b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:38.564000 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326919a-4de2-4d47-9429-085e84b95b85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:38.564286 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326919a-4de2-4d47-9429-085e84b95b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:38.564677 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326919a-4de2-4d47-9429-085e84b95b85 admin admin] PATH_INFO: `/v3/projects/0363f92314c34f9cb5bad093f60758e3/users/918d6c9feb4040b1bf6c967b1c42af82/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:38.564802 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee86a5-1c8d-4a2c-8226-ad9c63b73c8f None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:38.569635 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b172f3-4cf1-427b-9fdf-48494eddbfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:38.570708 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b172f3-4cf1-427b-9fdf-48494eddbfb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:38.570708 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b172f3-4cf1-427b-9fdf-48494eddbfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:38.570937 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b172f3-4cf1-427b-9fdf-48494eddbfb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:38.571593 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b172f3-4cf1-427b-9fdf-48494eddbfb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:57:38.572335 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b172f3-4cf1-427b-9fdf-48494eddbfb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:38.573690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b172f3-4cf1-427b-9fdf-48494eddbfb4 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:38.581074 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b326919a-4de2-4d47-9429-085e84b95b85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0363f92314c34f9cb5bad093f60758e3, user_id=918d6c9feb4040b1bf6c967b1c42af82, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:38.584995 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b326919a-4de2-4d47-9429-085e84b95b85 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:38.590596 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1102/2204] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:57:38.595184 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b172f3-4cf1-427b-9fdf-48494eddbfb4 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:38.603682 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1103/2205] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:57:38 2022] PUT /identity/v3/projects/0363f92314c34f9cb5bad093f60758e3/users/918d6c9feb4040b1bf6c967b1c42af82/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:57:38.608231 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326919a-4de2-4d47-9429-085e84b95b85 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:38.611602 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b172f3-4cf1-427b-9fdf-48494eddbfb4 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:38.659303 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:38.685143 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e14145-c8a3-4360-9c9d-de8e18720348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:38.685988 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e14145-c8a3-4360-9c9d-de8e18720348 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:38.686330 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e14145-c8a3-4360-9c9d-de8e18720348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:38.687055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:38.687654 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e14145-c8a3-4360-9c9d-de8e18720348 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:38.689296 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e14145-c8a3-4360-9c9d-de8e18720348 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:38.691962 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e14145-c8a3-4360-9c9d-de8e18720348 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:38.694051 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326919a-4de2-4d47-9429-085e84b95b85 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:38.699850 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5516b5-54b9-4c64-8db7-ee4550489afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:38.700619 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5516b5-54b9-4c64-8db7-ee4550489afc admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:38.700895 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5516b5-54b9-4c64-8db7-ee4550489afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:38.701188 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5516b5-54b9-4c64-8db7-ee4550489afc admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:38.701826 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5516b5-54b9-4c64-8db7-ee4550489afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:38.703893 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5516b5-54b9-4c64-8db7-ee4550489afc admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:38.720752 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1104/2206] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:57:38.721881 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5516b5-54b9-4c64-8db7-ee4550489afc admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:38.728583 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1103/2207] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:57:38 2022] POST /identity/v3/projects => generated 367 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:57:38.729711 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e14145-c8a3-4360-9c9d-de8e18720348 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:38.733080 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5516b5-54b9-4c64-8db7-ee4550489afc admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:38.802441 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e14145-c8a3-4360-9c9d-de8e18720348 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:38.806970 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406ed6e-e980-486d-aa84-8f51f3ca64e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:38.807596 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d9e42-502a-485c-a665-759974c476cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:38.808024 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406ed6e-e980-486d-aa84-8f51f3ca64e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:38.808232 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d9e42-502a-485c-a665-759974c476cb admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:38.808336 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406ed6e-e980-486d-aa84-8f51f3ca64e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:38.808516 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d9e42-502a-485c-a665-759974c476cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:38.808631 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406ed6e-e980-486d-aa84-8f51f3ca64e9 admin admin] PATH_INFO: `/v3/projects/0363f92314c34f9cb5bad093f60758e3/users/918d6c9feb4040b1bf6c967b1c42af82/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:38.808789 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d9e42-502a-485c-a665-759974c476cb admin admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:38.809506 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d9e42-502a-485c-a665-759974c476cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:38.810562 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406ed6e-e980-486d-aa84-8f51f3ca64e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0363f92314c34f9cb5bad093f60758e3, user_id=918d6c9feb4040b1bf6c967b1c42af82, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:38.811513 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d9e42-502a-485c-a665-759974c476cb admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:38.813304 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406ed6e-e980-486d-aa84-8f51f3ca64e9 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:38.828764 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1105/2208] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:57:38 2022] PUT /identity/v3/projects/0363f92314c34f9cb5bad093f60758e3/users/918d6c9feb4040b1bf6c967b1c42af82/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:38.840111 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89020a0c-e516-413a-a13f-a4b70ba1601e None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:38.841088 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89020a0c-e516-413a-a13f-a4b70ba1601e None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:38.841649 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89020a0c-e516-413a-a13f-a4b70ba1601e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:38.849194 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1104/2209] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:57:38 2022] POST /identity/v3/users => generated 284 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:57:38.850424 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d9e42-502a-485c-a665-759974c476cb admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:38.862384 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d9e42-502a-485c-a665-759974c476cb admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:38.881458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-89020a0c-e516-413a-a13f-a4b70ba1601e None None] MFA Rules not processed for user `918d6c9feb4040b1bf6c967b1c42af82`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:38.882736 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-89020a0c-e516-413a-a13f-a4b70ba1601e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:38.961220 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f0750-3f19-4005-99c9-be890989c755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:38.961859 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f0750-3f19-4005-99c9-be890989c755 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:38.962147 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f0750-3f19-4005-99c9-be890989c755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:38.962423 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f0750-3f19-4005-99c9-be890989c755 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:38.963073 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f0750-3f19-4005-99c9-be890989c755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:38.964714 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f0750-3f19-4005-99c9-be890989c755 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:38.977950 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1106/2210] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:38 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:38.982287 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1105/2211] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:57:38.990233 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89020a0c-e516-413a-a13f-a4b70ba1601e None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:38.998442 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f0750-3f19-4005-99c9-be890989c755 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:39.000143 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-d34f0750-3f19-4005-99c9-be890989c755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:39.002798 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89020a0c-e516-413a-a13f-a4b70ba1601e None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:39.007864 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d5748-70cb-4e59-8b7d-81fd785c388d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:39.008544 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d5748-70cb-4e59-8b7d-81fd785c388d admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:39.008890 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d5748-70cb-4e59-8b7d-81fd785c388d admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:39.009370 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d5748-70cb-4e59-8b7d-81fd785c388d admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:39.010181 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d5748-70cb-4e59-8b7d-81fd785c388d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:39.011808 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d5748-70cb-4e59-8b7d-81fd785c388d admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:39.023196 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1107/2212] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:57:39.027321 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d5748-70cb-4e59-8b7d-81fd785c388d admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:39.042465 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d5748-70cb-4e59-8b7d-81fd785c388d admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:39.048018 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc9851-f41e-4639-b14e-882074940041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:39.048831 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc9851-f41e-4639-b14e-882074940041 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:39.049199 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc9851-f41e-4639-b14e-882074940041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:39.049534 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc9851-f41e-4639-b14e-882074940041 admin admin] PATH_INFO: `/v3/projects/dd51b6133eb7415fb2d3cdfbd16c9259/users/f3f56045c94c435ba69cea6bc9e21eba/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:39.072284 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc9851-f41e-4639-b14e-882074940041 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd51b6133eb7415fb2d3cdfbd16c9259, user_id=f3f56045c94c435ba69cea6bc9e21eba, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:39.076556 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc9851-f41e-4639-b14e-882074940041 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:39.079277 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f0750-3f19-4005-99c9-be890989c755 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:39.083720 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5590747-148d-4014-ad5c-7b1106819e13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:39.084329 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5590747-148d-4014-ad5c-7b1106819e13 service cinder] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:39.084810 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5590747-148d-4014-ad5c-7b1106819e13 service cinder] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:39.085203 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5590747-148d-4014-ad5c-7b1106819e13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:39.087484 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-f5590747-148d-4014-ad5c-7b1106819e13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:39.090775 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1108/2213] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:57:39 2022] PUT /identity/v3/projects/dd51b6133eb7415fb2d3cdfbd16c9259/users/f3f56045c94c435ba69cea6bc9e21eba/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:57:39.097455 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:39.101962 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fd99c-c7a9-42d6-bee5-04ac7d87ee96 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:39.102253 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fd99c-c7a9-42d6-bee5-04ac7d87ee96 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:39.102552 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fd99c-c7a9-42d6-bee5-04ac7d87ee96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:39.132103 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-3f3fd99c-c7a9-42d6-bee5-04ac7d87ee96 None None] MFA Rules not processed for user `f3f56045c94c435ba69cea6bc9e21eba`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:39.133294 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-3f3fd99c-c7a9-42d6-bee5-04ac7d87ee96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:39.149604 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5590747-148d-4014-ad5c-7b1106819e13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:39.151047 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5590747-148d-4014-ad5c-7b1106819e13 service cinder] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:39.159011 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:39.160561 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1106/2214] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:57:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:57:39.205815 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1109/2215] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:57:39.207983 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5590747-148d-4014-ad5c-7b1106819e13 service cinder] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:39.219763 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5590747-148d-4014-ad5c-7b1106819e13 service cinder] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:39.290707 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dba1d7-5d6f-4867-a67c-ba397597ef52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:39.291318 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dba1d7-5d6f-4867-a67c-ba397597ef52 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:39.291605 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dba1d7-5d6f-4867-a67c-ba397597ef52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:39.291878 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dba1d7-5d6f-4867-a67c-ba397597ef52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:39.292741 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dba1d7-5d6f-4867-a67c-ba397597ef52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:39.294738 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dba1d7-5d6f-4867-a67c-ba397597ef52 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:39.326603 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1107/2216] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:57:39 2022] POST /identity/v3/projects => generated 365 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:57:39.331150 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3fd99c-c7a9-42d6-bee5-04ac7d87ee96 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:39.344522 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3fd99c-c7a9-42d6-bee5-04ac7d87ee96 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:39.429324 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb6300-4060-4e60-80d7-97ac30330c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:39.430755 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb6300-4060-4e60-80d7-97ac30330c4b admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:39.430937 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb6300-4060-4e60-80d7-97ac30330c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:39.431263 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb6300-4060-4e60-80d7-97ac30330c4b admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:39.431983 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb6300-4060-4e60-80d7-97ac30330c4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:39.433967 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb6300-4060-4e60-80d7-97ac30330c4b admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:39.475042 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1110/2217] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:57:39 2022] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:57:39.479372 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dba1d7-5d6f-4867-a67c-ba397597ef52 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:39.491478 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dba1d7-5d6f-4867-a67c-ba397597ef52 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:39.508407 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8dfcfc-b1c8-4051-aeb2-ed3ba2de9d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:39.509053 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8dfcfc-b1c8-4051-aeb2-ed3ba2de9d41 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:39.509603 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8dfcfc-b1c8-4051-aeb2-ed3ba2de9d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:39.509877 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8dfcfc-b1c8-4051-aeb2-ed3ba2de9d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:39.510691 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8dfcfc-b1c8-4051-aeb2-ed3ba2de9d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:39.512838 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8dfcfc-b1c8-4051-aeb2-ed3ba2de9d41 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:39.541122 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1108/2218] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:57:39.544629 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb6300-4060-4e60-80d7-97ac30330c4b admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:39.556336 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb6300-4060-4e60-80d7-97ac30330c4b admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:39.561101 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9b844-0333-4e02-815e-7bd5b5b3096a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:39.561760 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9b844-0333-4e02-815e-7bd5b5b3096a admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:39.562118 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9b844-0333-4e02-815e-7bd5b5b3096a admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:39.562313 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9b844-0333-4e02-815e-7bd5b5b3096a admin admin] PATH_INFO: `/v3/projects/3cb7d896cb104a27b05a1b669460e9fc/users/9d4483c116d748469a796ba751fc6541/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:39.582549 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d9b844-0333-4e02-815e-7bd5b5b3096a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cb7d896cb104a27b05a1b669460e9fc, user_id=9d4483c116d748469a796ba751fc6541, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:39.585246 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d9b844-0333-4e02-815e-7bd5b5b3096a admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:39.600456 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1111/2219] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:57:39 2022] PUT /identity/v3/projects/3cb7d896cb104a27b05a1b669460e9fc/users/9d4483c116d748469a796ba751fc6541/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:39.604442 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8dfcfc-b1c8-4051-aeb2-ed3ba2de9d41 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:39.615914 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8dfcfc-b1c8-4051-aeb2-ed3ba2de9d41 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:39.677145 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176c03a-95db-48df-9fd8-dbbaebe4ba44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:39.677755 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176c03a-95db-48df-9fd8-dbbaebe4ba44 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:39.678037 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176c03a-95db-48df-9fd8-dbbaebe4ba44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:39.678309 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176c03a-95db-48df-9fd8-dbbaebe4ba44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:39.678944 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176c03a-95db-48df-9fd8-dbbaebe4ba44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:39.680537 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176c03a-95db-48df-9fd8-dbbaebe4ba44 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:39.690909 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1109/2220] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:57:39.695150 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9b844-0333-4e02-815e-7bd5b5b3096a admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:39.705842 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9b844-0333-4e02-815e-7bd5b5b3096a admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:39.710406 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1838283-6ea6-46b4-af34-778ff5ac8d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:39.711312 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1838283-6ea6-46b4-af34-778ff5ac8d66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:39.711588 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1838283-6ea6-46b4-af34-778ff5ac8d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:39.711858 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1838283-6ea6-46b4-af34-778ff5ac8d66 admin admin] PATH_INFO: `/v3/projects/3cb7d896cb104a27b05a1b669460e9fc/users/9d4483c116d748469a796ba751fc6541/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:39.713762 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1838283-6ea6-46b4-af34-778ff5ac8d66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cb7d896cb104a27b05a1b669460e9fc, user_id=9d4483c116d748469a796ba751fc6541, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:39.716458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1838283-6ea6-46b4-af34-778ff5ac8d66 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:39.726587 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1112/2221] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:57:39 2022] PUT /identity/v3/projects/3cb7d896cb104a27b05a1b669460e9fc/users/9d4483c116d748469a796ba751fc6541/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:39.737940 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8919f3-a888-4bbc-9ddc-46bded1a27db None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:39.738228 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8919f3-a888-4bbc-9ddc-46bded1a27db None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:39.738503 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8919f3-a888-4bbc-9ddc-46bded1a27db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:39.766690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-4a8919f3-a888-4bbc-9ddc-46bded1a27db None None] MFA Rules not processed for user `9d4483c116d748469a796ba751fc6541`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:39.767897 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-4a8919f3-a888-4bbc-9ddc-46bded1a27db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:39.776386 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:39.841444 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1110/2222] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:39 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:39.853604 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1838283-6ea6-46b4-af34-778ff5ac8d66 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:39.910923 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1838283-6ea6-46b4-af34-778ff5ac8d66 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:39.914585 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa38159-d677-45ed-b490-6cb7120c97df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:39.915192 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa38159-d677-45ed-b490-6cb7120c97df service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:39.915470 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa38159-d677-45ed-b490-6cb7120c97df service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:39.915741 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa38159-d677-45ed-b490-6cb7120c97df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:39.930230 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa38159-d677-45ed-b490-6cb7120c97df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:39.931703 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa38159-d677-45ed-b490-6cb7120c97df service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:39.947712 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1113/2223] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:57:39 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:57:39.992113 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8919f3-a888-4bbc-9ddc-46bded1a27db None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:39.993564 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-4a8919f3-a888-4bbc-9ddc-46bded1a27db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:40.006065 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8919f3-a888-4bbc-9ddc-46bded1a27db None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:40.010185 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7c507-a50b-4a2b-ad72-8d02eeee21f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:40.010792 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7c507-a50b-4a2b-ad72-8d02eeee21f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:40.011075 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7c507-a50b-4a2b-ad72-8d02eeee21f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:40.011337 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7c507-a50b-4a2b-ad72-8d02eeee21f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:40.066944 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7c507-a50b-4a2b-ad72-8d02eeee21f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:40.068368 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7c507-a50b-4a2b-ad72-8d02eeee21f4 service cinder] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:40.077074 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1111/2224] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:57:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:57:40.752656 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa38159-d677-45ed-b490-6cb7120c97df service cinder] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:40.762139 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa38159-d677-45ed-b490-6cb7120c97df service cinder] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:40.767252 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc94afa-3fc4-437a-a821-b1900cb06209 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:40.767842 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc94afa-3fc4-437a-a821-b1900cb06209 service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:40.768121 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc94afa-3fc4-437a-a821-b1900cb06209 service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:40.768387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc94afa-3fc4-437a-a821-b1900cb06209 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:40.770152 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-9fc94afa-3fc4-437a-a821-b1900cb06209 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:40.789251 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:40.831553 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc94afa-3fc4-437a-a821-b1900cb06209 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:40.832985 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc94afa-3fc4-437a-a821-b1900cb06209 service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:40.842552 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1114/2225] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:57:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 17:57:41.516906 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7c507-a50b-4a2b-ad72-8d02eeee21f4 service cinder] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:41.526573 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7c507-a50b-4a2b-ad72-8d02eeee21f4 service cinder] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:41.530709 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d2a42-b77c-4fc6-a168-bbc3c38d8a37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:41.531311 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d2a42-b77c-4fc6-a168-bbc3c38d8a37 service cinder] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:41.531611 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d2a42-b77c-4fc6-a168-bbc3c38d8a37 service cinder] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:41.531879 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d2a42-b77c-4fc6-a168-bbc3c38d8a37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:41.595571 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d2a42-b77c-4fc6-a168-bbc3c38d8a37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:41.597411 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d2a42-b77c-4fc6-a168-bbc3c38d8a37 service cinder] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:41.609747 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1112/2226] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:57:41 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 17:57:43.457689 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc94afa-3fc4-437a-a821-b1900cb06209 service cinder] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:43.460490 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-9fc94afa-3fc4-437a-a821-b1900cb06209 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:43.564799 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc94afa-3fc4-437a-a821-b1900cb06209 service cinder] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:43.569531 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb934414-dccb-46d0-b7e9-ef50a390fdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:43.570157 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb934414-dccb-46d0-b7e9-ef50a390fdf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:43.570477 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb934414-dccb-46d0-b7e9-ef50a390fdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:43.570754 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb934414-dccb-46d0-b7e9-ef50a390fdf1 admin admin] PATH_INFO: `/v3/users/a461e3ea6ea54ca8a046c47b7f79a47d` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:43.571902 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb934414-dccb-46d0-b7e9-ef50a390fdf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a461e3ea6ea54ca8a046c47b7f79a47d)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:43.573953 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb934414-dccb-46d0-b7e9-ef50a390fdf1 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:43.625400 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-eb934414-dccb-46d0-b7e9-ef50a390fdf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a461e3ea6ea54ca8a046c47b7f79a47d'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:43.626072 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-eb934414-dccb-46d0-b7e9-ef50a390fdf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a461e3ea6ea54ca8a046c47b7f79a47d'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:43.626761 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-eb934414-dccb-46d0-b7e9-ef50a390fdf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a461e3ea6ea54ca8a046c47b7f79a47d'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:43.633986 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-eb934414-dccb-46d0-b7e9-ef50a390fdf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a461e3ea6ea54ca8a046c47b7f79a47d'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:43.643244 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-eb934414-dccb-46d0-b7e9-ef50a390fdf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a461e3ea6ea54ca8a046c47b7f79a47d'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:43.672056 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1115/2227] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:57:43 2022] DELETE /identity/v3/users/a461e3ea6ea54ca8a046c47b7f79a47d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:43.687075 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe181161-a3dd-4779-affe-a49370251761 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:43.687520 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe181161-a3dd-4779-affe-a49370251761 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:43.687815 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe181161-a3dd-4779-affe-a49370251761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:43.708463 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-fe181161-a3dd-4779-affe-a49370251761 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:43.710033 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-fe181161-a3dd-4779-affe-a49370251761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:43.747959 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:43.760239 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb934414-dccb-46d0-b7e9-ef50a390fdf1 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:43.761676 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-eb934414-dccb-46d0-b7e9-ef50a390fdf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:43.777501 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1113/2228] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:57:43.787083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe181161-a3dd-4779-affe-a49370251761 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:43.788442 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-fe181161-a3dd-4779-affe-a49370251761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:43.808544 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:43.838288 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb934414-dccb-46d0-b7e9-ef50a390fdf1 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:43.843517 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180e677-e188-4d47-b254-e50354b89175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:43.844238 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180e677-e188-4d47-b254-e50354b89175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:43.844578 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180e677-e188-4d47-b254-e50354b89175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:43.844915 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180e677-e188-4d47-b254-e50354b89175 admin admin] PATH_INFO: `/v3/users/f3f56045c94c435ba69cea6bc9e21eba` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:43.846187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180e677-e188-4d47-b254-e50354b89175 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3f56045c94c435ba69cea6bc9e21eba)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:43.848215 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180e677-e188-4d47-b254-e50354b89175 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:43.865208 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe181161-a3dd-4779-affe-a49370251761 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:43.870537 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea191e9-902a-4e1e-b8f9-a24cc4757ed0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:43.871147 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea191e9-902a-4e1e-b8f9-a24cc4757ed0 service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:43.871467 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea191e9-902a-4e1e-b8f9-a24cc4757ed0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:43.871856 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea191e9-902a-4e1e-b8f9-a24cc4757ed0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:43.886113 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea191e9-902a-4e1e-b8f9-a24cc4757ed0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:43.887593 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea191e9-902a-4e1e-b8f9-a24cc4757ed0 service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:43.899522 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1114/2229] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:57:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 17:57:43.900260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-7180e677-e188-4d47-b254-e50354b89175 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3f56045c94c435ba69cea6bc9e21eba'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:43.900997 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-7180e677-e188-4d47-b254-e50354b89175 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3f56045c94c435ba69cea6bc9e21eba'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:43.902098 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-7180e677-e188-4d47-b254-e50354b89175 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3f56045c94c435ba69cea6bc9e21eba'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:43.909719 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-7180e677-e188-4d47-b254-e50354b89175 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3f56045c94c435ba69cea6bc9e21eba'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:43.920116 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-7180e677-e188-4d47-b254-e50354b89175 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3f56045c94c435ba69cea6bc9e21eba'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:43.942925 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1116/2230] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:57:43 2022] DELETE /identity/v3/users/f3f56045c94c435ba69cea6bc9e21eba => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:57:43.947932 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02b655-0e8e-419c-a3bf-0f1072a7c562 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:43.948219 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02b655-0e8e-419c-a3bf-0f1072a7c562 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:43.948515 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02b655-0e8e-419c-a3bf-0f1072a7c562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:43.972137 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-bb02b655-0e8e-419c-a3bf-0f1072a7c562 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:43.973819 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-bb02b655-0e8e-419c-a3bf-0f1072a7c562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:44.069629 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1115/2231] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:44.077684 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180e677-e188-4d47-b254-e50354b89175 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:44.079375 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-7180e677-e188-4d47-b254-e50354b89175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:44.154570 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180e677-e188-4d47-b254-e50354b89175 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:44.158873 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f15d18-e049-4654-8712-7045a3270401 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:44.159563 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f15d18-e049-4654-8712-7045a3270401 service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:44.159909 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f15d18-e049-4654-8712-7045a3270401 service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:44.160271 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f15d18-e049-4654-8712-7045a3270401 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:44.174697 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f15d18-e049-4654-8712-7045a3270401 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:44.176561 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f15d18-e049-4654-8712-7045a3270401 service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:44.188888 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1117/2232] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:57:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:57:44.231653 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02b655-0e8e-419c-a3bf-0f1072a7c562 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:44.233154 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-bb02b655-0e8e-419c-a3bf-0f1072a7c562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:44.259524 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02b655-0e8e-419c-a3bf-0f1072a7c562 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:44.265170 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c5c0e-1868-4c84-aaa7-f12c7d30c879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:44.265820 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c5c0e-1868-4c84-aaa7-f12c7d30c879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:44.266102 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c5c0e-1868-4c84-aaa7-f12c7d30c879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:44.266389 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c5c0e-1868-4c84-aaa7-f12c7d30c879 admin admin] PATH_INFO: `/v3/projects/8d1248d01df94a6597ffc3c890e835e0` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:44.268076 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c5c0e-1868-4c84-aaa7-f12c7d30c879 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d1248d01df94a6597ffc3c890e835e0)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:44.271542 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c5c0e-1868-4c84-aaa7-f12c7d30c879 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:44.347815 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-ff4c5c0e-1868-4c84-aaa7-f12c7d30c879 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d1248d01df94a6597ffc3c890e835e0', 'request_id': 'req-ff4c5c0e-1868-4c84-aaa7-f12c7d30c879'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:44.354663 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-ff4c5c0e-1868-4c84-aaa7-f12c7d30c879 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d1248d01df94a6597ffc3c890e835e0', 'request_id': 'req-ff4c5c0e-1868-4c84-aaa7-f12c7d30c879'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:44.373363 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-ff4c5c0e-1868-4c84-aaa7-f12c7d30c879 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d1248d01df94a6597ffc3c890e835e0', 'request_id': 'req-ff4c5c0e-1868-4c84-aaa7-f12c7d30c879'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:44.393514 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-ff4c5c0e-1868-4c84-aaa7-f12c7d30c879 admin admin] The token cache is being invalidate because project 8d1248d01df94a6597ffc3c890e835e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:57:44.394076 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-ff4c5c0e-1868-4c84-aaa7-f12c7d30c879 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:44.395166 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-ff4c5c0e-1868-4c84-aaa7-f12c7d30c879 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:44.398767 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1116/2233] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:57:44 2022] DELETE /identity/v3/projects/8d1248d01df94a6597ffc3c890e835e0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:44.404486 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc0dbd-3464-41b4-8a8d-be92cb22340f None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:44.404782 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc0dbd-3464-41b4-8a8d-be92cb22340f None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:44.405082 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc0dbd-3464-41b4-8a8d-be92cb22340f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:44.431350 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-83fc0dbd-3464-41b4-8a8d-be92cb22340f None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:44.433583 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-83fc0dbd-3464-41b4-8a8d-be92cb22340f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:44.513450 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:44.533067 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1118/2234] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:44.537177 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3ddd8-d99f-4e1d-a905-6ba454a47ef7 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:44.537498 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3ddd8-d99f-4e1d-a905-6ba454a47ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:44.537786 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3ddd8-d99f-4e1d-a905-6ba454a47ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:44.551314 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:44.574489 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-34e3ddd8-d99f-4e1d-a905-6ba454a47ef7 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:44.576557 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-34e3ddd8-d99f-4e1d-a905-6ba454a47ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:44.593869 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1117/2235] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:44.594898 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc0dbd-3464-41b4-8a8d-be92cb22340f None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:44.607025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc0dbd-3464-41b4-8a8d-be92cb22340f None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:44.613945 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd63056-62e6-491d-96ff-e41a7827fa9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:44.614525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd63056-62e6-491d-96ff-e41a7827fa9b admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:44.614798 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd63056-62e6-491d-96ff-e41a7827fa9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:44.615158 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd63056-62e6-491d-96ff-e41a7827fa9b admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:44.622710 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd63056-62e6-491d-96ff-e41a7827fa9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:57:44.622976 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd63056-62e6-491d-96ff-e41a7827fa9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:44.624752 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd63056-62e6-491d-96ff-e41a7827fa9b admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:44.661526 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1119/2236] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 17:57:44.664864 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3ddd8-d99f-4e1d-a905-6ba454a47ef7 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:44.676882 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3ddd8-d99f-4e1d-a905-6ba454a47ef7 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:44.682019 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06743b4-8a6d-4eb7-a4e5-f1ee5ba0a680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:44.682918 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06743b4-8a6d-4eb7-a4e5-f1ee5ba0a680 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:44.683345 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06743b4-8a6d-4eb7-a4e5-f1ee5ba0a680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:44.683694 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06743b4-8a6d-4eb7-a4e5-f1ee5ba0a680 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:44.684543 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06743b4-8a6d-4eb7-a4e5-f1ee5ba0a680 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:44.686820 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06743b4-8a6d-4eb7-a4e5-f1ee5ba0a680 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:44.725900 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1118/2237] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:57:44 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:57:44.731530 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd63056-62e6-491d-96ff-e41a7827fa9b admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:44.742947 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06743b4-8a6d-4eb7-a4e5-f1ee5ba0a680 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:44.748477 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd63056-62e6-491d-96ff-e41a7827fa9b admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:44.750667 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-c06743b4-8a6d-4eb7-a4e5-f1ee5ba0a680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:44.851673 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06743b4-8a6d-4eb7-a4e5-f1ee5ba0a680 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:44.859026 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c3a24-e1e4-4e64-b97d-e28b1d5f4f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:44.859863 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c3a24-e1e4-4e64-b97d-e28b1d5f4f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:44.860350 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c3a24-e1e4-4e64-b97d-e28b1d5f4f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:44.861807 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c3a24-e1e4-4e64-b97d-e28b1d5f4f31 admin admin] PATH_INFO: `/v3/projects/dd51b6133eb7415fb2d3cdfbd16c9259` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:44.863599 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c3a24-e1e4-4e64-b97d-e28b1d5f4f31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd51b6133eb7415fb2d3cdfbd16c9259)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:44.865742 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c3a24-e1e4-4e64-b97d-e28b1d5f4f31 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:44.918435 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c55822-6885-4499-a398-276f80428728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:44.919233 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c55822-6885-4499-a398-276f80428728 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:44.925306 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c55822-6885-4499-a398-276f80428728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:44.926712 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c55822-6885-4499-a398-276f80428728 admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:44.927330 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c55822-6885-4499-a398-276f80428728 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:44.930795 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-f24c3a24-e1e4-4e64-b97d-e28b1d5f4f31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd51b6133eb7415fb2d3cdfbd16c9259', 'request_id': 'req-f24c3a24-e1e4-4e64-b97d-e28b1d5f4f31'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:44.931286 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c55822-6885-4499-a398-276f80428728 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:44.960521 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-f24c3a24-e1e4-4e64-b97d-e28b1d5f4f31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd51b6133eb7415fb2d3cdfbd16c9259', 'request_id': 'req-f24c3a24-e1e4-4e64-b97d-e28b1d5f4f31'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:44.968040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1120/2238] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:57:44 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:57:44.971835 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-f24c3a24-e1e4-4e64-b97d-e28b1d5f4f31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd51b6133eb7415fb2d3cdfbd16c9259', 'request_id': 'req-f24c3a24-e1e4-4e64-b97d-e28b1d5f4f31'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:44.973144 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c55822-6885-4499-a398-276f80428728 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:44.985865 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-f24c3a24-e1e4-4e64-b97d-e28b1d5f4f31 admin admin] The token cache is being invalidate because project dd51b6133eb7415fb2d3cdfbd16c9259 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:57:44.986242 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-f24c3a24-e1e4-4e64-b97d-e28b1d5f4f31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:44.987350 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-f24c3a24-e1e4-4e64-b97d-e28b1d5f4f31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:44.989247 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1119/2239] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:57:44 2022] DELETE /identity/v3/projects/dd51b6133eb7415fb2d3cdfbd16c9259 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:44.994306 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c3a24-e1e4-4e64-b97d-e28b1d5f4f31 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:44.996310 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-f24c3a24-e1e4-4e64-b97d-e28b1d5f4f31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:44.998611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c55822-6885-4499-a398-276f80428728 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:45.089364 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c3a24-e1e4-4e64-b97d-e28b1d5f4f31 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:45.094930 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621604c9-b309-4c57-b724-21a08df5329d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:45.095771 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621604c9-b309-4c57-b724-21a08df5329d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:45.096141 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621604c9-b309-4c57-b724-21a08df5329d admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:45.096751 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621604c9-b309-4c57-b724-21a08df5329d admin admin] PATH_INFO: `/v3/users/9d4483c116d748469a796ba751fc6541` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:45.098115 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621604c9-b309-4c57-b724-21a08df5329d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d4483c116d748469a796ba751fc6541)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:45.098232 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535dc1ba-fb92-4c87-b842-026854f4e3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:45.098733 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535dc1ba-fb92-4c87-b842-026854f4e3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:45.099009 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535dc1ba-fb92-4c87-b842-026854f4e3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:45.099322 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535dc1ba-fb92-4c87-b842-026854f4e3d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:45.100112 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535dc1ba-fb92-4c87-b842-026854f4e3d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:45.100381 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621604c9-b309-4c57-b724-21a08df5329d admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:45.101884 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535dc1ba-fb92-4c87-b842-026854f4e3d1 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:45.107002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:45.123141 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1121/2240] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:57:45.124438 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535dc1ba-fb92-4c87-b842-026854f4e3d1 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:45.127497 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-535dc1ba-fb92-4c87-b842-026854f4e3d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:45.148681 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535dc1ba-fb92-4c87-b842-026854f4e3d1 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:45.154320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce1ac1-8434-4a8f-990b-4711318170ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:45.155020 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce1ac1-8434-4a8f-990b-4711318170ac admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:45.155300 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce1ac1-8434-4a8f-990b-4711318170ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:45.155569 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce1ac1-8434-4a8f-990b-4711318170ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:45.156321 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce1ac1-8434-4a8f-990b-4711318170ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:45.158341 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce1ac1-8434-4a8f-990b-4711318170ac admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:45.177329 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1122/2241] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:57:45.182276 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce1ac1-8434-4a8f-990b-4711318170ac admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:45.198532 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce1ac1-8434-4a8f-990b-4711318170ac admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:45.205159 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac078fc1-a3e8-4549-a022-709fb245d2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:45.206202 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac078fc1-a3e8-4549-a022-709fb245d2de admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:45.206555 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac078fc1-a3e8-4549-a022-709fb245d2de admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:45.207071 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac078fc1-a3e8-4549-a022-709fb245d2de admin admin] PATH_INFO: `/v3/projects/626632c9969f44af80a374084afbafe2/users/6384580cf2804b39bb9dbca582adcc4d/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:45.219037 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-621604c9-b309-4c57-b724-21a08df5329d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d4483c116d748469a796ba751fc6541'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:45.232181 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac078fc1-a3e8-4549-a022-709fb245d2de admin admin] RBAC: Authorizing `identity:create_grant(project_id=626632c9969f44af80a374084afbafe2, user_id=6384580cf2804b39bb9dbca582adcc4d, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:45.235918 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-621604c9-b309-4c57-b724-21a08df5329d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d4483c116d748469a796ba751fc6541'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:45.236671 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac078fc1-a3e8-4549-a022-709fb245d2de admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:45.237476 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-621604c9-b309-4c57-b724-21a08df5329d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d4483c116d748469a796ba751fc6541'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:45.238647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-621604c9-b309-4c57-b724-21a08df5329d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d4483c116d748469a796ba751fc6541'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:45.251290 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-621604c9-b309-4c57-b724-21a08df5329d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d4483c116d748469a796ba751fc6541'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:45.258376 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1123/2242] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:57:45 2022] PUT /identity/v3/projects/626632c9969f44af80a374084afbafe2/users/6384580cf2804b39bb9dbca582adcc4d/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:45.264163 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48651485-11e2-4c25-8c13-6e88d78e1c7b None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:45.264765 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48651485-11e2-4c25-8c13-6e88d78e1c7b None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:45.265278 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48651485-11e2-4c25-8c13-6e88d78e1c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:45.276469 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1120/2243] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:57:44 2022] DELETE /identity/v3/users/9d4483c116d748469a796ba751fc6541 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:57:45.287834 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-48651485-11e2-4c25-8c13-6e88d78e1c7b None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:45.289093 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-48651485-11e2-4c25-8c13-6e88d78e1c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:45.348448 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:45.426893 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1124/2244] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:57:45.447352 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621604c9-b309-4c57-b724-21a08df5329d admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:45.449351 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-621604c9-b309-4c57-b724-21a08df5329d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:45.558877 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621604c9-b309-4c57-b724-21a08df5329d admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:45.564543 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5760d93-8524-4a9f-a84e-601790d28e89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:45.565533 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5760d93-8524-4a9f-a84e-601790d28e89 service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:45.565921 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5760d93-8524-4a9f-a84e-601790d28e89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:45.566304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5760d93-8524-4a9f-a84e-601790d28e89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:45.581233 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5760d93-8524-4a9f-a84e-601790d28e89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:45.583049 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5760d93-8524-4a9f-a84e-601790d28e89 service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:45.597366 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1121/2245] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:57:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:57:45.681818 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48651485-11e2-4c25-8c13-6e88d78e1c7b None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:45.692259 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-48651485-11e2-4c25-8c13-6e88d78e1c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:45.716237 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48651485-11e2-4c25-8c13-6e88d78e1c7b None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:45.725246 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5760d93-8524-4a9f-a84e-601790d28e89 service neutron] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:45.728754 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-a5760d93-8524-4a9f-a84e-601790d28e89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:45.745060 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9f310-157d-4322-8fcc-4dcd7676cceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:45.747224 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9f310-157d-4322-8fcc-4dcd7676cceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:45.747546 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9f310-157d-4322-8fcc-4dcd7676cceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:45.747824 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9f310-157d-4322-8fcc-4dcd7676cceb admin admin] PATH_INFO: `/v3/users/61b45a6567cc41ffba7f77c8261152ea` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:45.757951 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5760d93-8524-4a9f-a84e-601790d28e89 service neutron] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:45.758760 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9f310-157d-4322-8fcc-4dcd7676cceb admin admin] RBAC: Authorizing `identity:delete_user(user_id=61b45a6567cc41ffba7f77c8261152ea)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:45.761059 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9f310-157d-4322-8fcc-4dcd7676cceb admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:45.769377 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c94e17-75f8-4d96-a5b0-6bf9b5a6c699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:45.771769 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c94e17-75f8-4d96-a5b0-6bf9b5a6c699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:45.772121 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c94e17-75f8-4d96-a5b0-6bf9b5a6c699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:45.773087 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c94e17-75f8-4d96-a5b0-6bf9b5a6c699 admin admin] PATH_INFO: `/v3/projects/3cb7d896cb104a27b05a1b669460e9fc` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:45.775879 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c94e17-75f8-4d96-a5b0-6bf9b5a6c699 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cb7d896cb104a27b05a1b669460e9fc)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:45.782254 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c94e17-75f8-4d96-a5b0-6bf9b5a6c699 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:45.855828 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-77b9f310-157d-4322-8fcc-4dcd7676cceb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61b45a6567cc41ffba7f77c8261152ea'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:45.857452 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-77b9f310-157d-4322-8fcc-4dcd7676cceb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61b45a6567cc41ffba7f77c8261152ea'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:45.858472 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-77b9f310-157d-4322-8fcc-4dcd7676cceb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61b45a6567cc41ffba7f77c8261152ea'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:45.867155 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-60c94e17-75f8-4d96-a5b0-6bf9b5a6c699 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cb7d896cb104a27b05a1b669460e9fc', 'request_id': 'req-60c94e17-75f8-4d96-a5b0-6bf9b5a6c699'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:45.869236 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-77b9f310-157d-4322-8fcc-4dcd7676cceb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61b45a6567cc41ffba7f77c8261152ea'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:45.875529 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-60c94e17-75f8-4d96-a5b0-6bf9b5a6c699 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cb7d896cb104a27b05a1b669460e9fc', 'request_id': 'req-60c94e17-75f8-4d96-a5b0-6bf9b5a6c699'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:45.880310 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-77b9f310-157d-4322-8fcc-4dcd7676cceb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61b45a6567cc41ffba7f77c8261152ea'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:45.885484 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-60c94e17-75f8-4d96-a5b0-6bf9b5a6c699 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cb7d896cb104a27b05a1b669460e9fc', 'request_id': 'req-60c94e17-75f8-4d96-a5b0-6bf9b5a6c699'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:45.899270 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-60c94e17-75f8-4d96-a5b0-6bf9b5a6c699 admin admin] The token cache is being invalidate because project 3cb7d896cb104a27b05a1b669460e9fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:57:45.899637 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-60c94e17-75f8-4d96-a5b0-6bf9b5a6c699 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:45.900617 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-60c94e17-75f8-4d96-a5b0-6bf9b5a6c699 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:45.902689 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1122/2246] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:57:45 2022] DELETE /identity/v3/projects/3cb7d896cb104a27b05a1b669460e9fc => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:57:45.908070 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cde92-cd73-41ea-8e33-e3ebf8bf1574 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:45.908622 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1125/2247] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:57:45 2022] DELETE /identity/v3/users/61b45a6567cc41ffba7f77c8261152ea => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:45.911672 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cde92-cd73-41ea-8e33-e3ebf8bf1574 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:45.911672 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cde92-cd73-41ea-8e33-e3ebf8bf1574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:45.915343 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87909b9a-01f5-4af8-9101-a2f1bcf4590a None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:45.916244 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87909b9a-01f5-4af8-9101-a2f1bcf4590a None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:45.916617 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87909b9a-01f5-4af8-9101-a2f1bcf4590a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:45.931934 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-458cde92-cd73-41ea-8e33-e3ebf8bf1574 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:45.933275 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-458cde92-cd73-41ea-8e33-e3ebf8bf1574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:45.939626 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:45.942177 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-87909b9a-01f5-4af8-9101-a2f1bcf4590a None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:45.943866 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-87909b9a-01f5-4af8-9101-a2f1bcf4590a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:46.033541 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1126/2248] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:46.037142 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1123/2249] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:57:46.038140 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc45706-6344-4d08-8956-569d842e49ee None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:46.038432 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc45706-6344-4d08-8956-569d842e49ee None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:46.038705 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc45706-6344-4d08-8956-569d842e49ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:46.045440 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458cde92-cd73-41ea-8e33-e3ebf8bf1574 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:46.047302 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-458cde92-cd73-41ea-8e33-e3ebf8bf1574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:46.062920 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-1dc45706-6344-4d08-8956-569d842e49ee None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:46.064422 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-1dc45706-6344-4d08-8956-569d842e49ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:46.074719 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1127/2250] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:46.081623 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc45706-6344-4d08-8956-569d842e49ee None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:46.095472 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc45706-6344-4d08-8956-569d842e49ee None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:46.102345 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d8ad1-a016-49c0-ac08-292e82f3d839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:46.103707 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d8ad1-a016-49c0-ac08-292e82f3d839 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:46.104182 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d8ad1-a016-49c0-ac08-292e82f3d839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:46.105412 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d8ad1-a016-49c0-ac08-292e82f3d839 admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:46.106439 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512d8ad1-a016-49c0-ac08-292e82f3d839 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:57:46.107310 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512d8ad1-a016-49c0-ac08-292e82f3d839 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:46.109616 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512d8ad1-a016-49c0-ac08-292e82f3d839 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:46.157039 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1128/2251] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:57:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:57:46.162003 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458cde92-cd73-41ea-8e33-e3ebf8bf1574 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:46.162231 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d8ad1-a016-49c0-ac08-292e82f3d839 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:46.171324 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd407cb-e9de-4da0-b2b4-5513440e8e3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:46.171958 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd407cb-e9de-4da0-b2b4-5513440e8e3d service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:46.174515 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd407cb-e9de-4da0-b2b4-5513440e8e3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:46.174515 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd407cb-e9de-4da0-b2b4-5513440e8e3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:46.179613 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d8ad1-a016-49c0-ac08-292e82f3d839 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:46.185907 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0858dbe-0318-451b-b364-4ebdc817127c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:46.186709 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0858dbe-0318-451b-b364-4ebdc817127c admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:46.187666 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0858dbe-0318-451b-b364-4ebdc817127c admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:46.187939 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0858dbe-0318-451b-b364-4ebdc817127c admin admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:46.188823 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0858dbe-0318-451b-b364-4ebdc817127c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:46.193228 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd407cb-e9de-4da0-b2b4-5513440e8e3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:46.204553 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0858dbe-0318-451b-b364-4ebdc817127c admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:46.206788 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd407cb-e9de-4da0-b2b4-5513440e8e3d service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:46.227876 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1124/2252] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:57:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 17:57:46.279333 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1129/2253] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:57:46 2022] POST /identity/v3/projects => generated 407 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:57:46.284343 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd407cb-e9de-4da0-b2b4-5513440e8e3d service neutron] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:46.299456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd407cb-e9de-4da0-b2b4-5513440e8e3d service neutron] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:46.452871 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67a8d3-9c7f-4bc6-be7b-cd5945fc947b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:46.452871 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67a8d3-9c7f-4bc6-be7b-cd5945fc947b admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:46.452871 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67a8d3-9c7f-4bc6-be7b-cd5945fc947b admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:46.452871 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67a8d3-9c7f-4bc6-be7b-cd5945fc947b admin admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:46.453543 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67a8d3-9c7f-4bc6-be7b-cd5945fc947b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:46.453543 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67a8d3-9c7f-4bc6-be7b-cd5945fc947b admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:46.479005 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1125/2254] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:57:46 2022] POST /identity/v3/users => generated 304 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:57:46.483814 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0858dbe-0318-451b-b364-4ebdc817127c admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:46.496080 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0858dbe-0318-451b-b364-4ebdc817127c admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:46.503845 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801db061-04b5-401a-8dbb-3217d3886756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:46.504799 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801db061-04b5-401a-8dbb-3217d3886756 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:46.505222 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801db061-04b5-401a-8dbb-3217d3886756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:46.505537 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801db061-04b5-401a-8dbb-3217d3886756 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:46.506253 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801db061-04b5-401a-8dbb-3217d3886756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:46.508043 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801db061-04b5-401a-8dbb-3217d3886756 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:46.511686 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:46.527230 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67a8d3-9c7f-4bc6-be7b-cd5945fc947b admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:46.528664 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1130/2255] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:57:46.540115 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67a8d3-9c7f-4bc6-be7b-cd5945fc947b admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:46.557358 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf723cd-5836-4de2-aac2-cf69ccd0b27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:46.557358 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf723cd-5836-4de2-aac2-cf69ccd0b27e admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:46.557358 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf723cd-5836-4de2-aac2-cf69ccd0b27e admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:46.557358 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf723cd-5836-4de2-aac2-cf69ccd0b27e admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:46.557659 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf723cd-5836-4de2-aac2-cf69ccd0b27e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:46.557659 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf723cd-5836-4de2-aac2-cf69ccd0b27e admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:46.563677 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1126/2256] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:57:46.568167 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801db061-04b5-401a-8dbb-3217d3886756 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:46.599386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801db061-04b5-401a-8dbb-3217d3886756 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:46.611274 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01bb13-2c23-4bdd-9d8f-d9d85683eaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:46.612940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01bb13-2c23-4bdd-9d8f-d9d85683eaf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:46.613425 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01bb13-2c23-4bdd-9d8f-d9d85683eaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:46.613707 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01bb13-2c23-4bdd-9d8f-d9d85683eaf7 admin admin] PATH_INFO: `/v3/projects/a25807b9681341f08214d41ea6881308/users/40e772ffa6884f2f8c1b30ec707e6d4f/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:46.649136 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01bb13-2c23-4bdd-9d8f-d9d85683eaf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a25807b9681341f08214d41ea6881308, user_id=40e772ffa6884f2f8c1b30ec707e6d4f, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:46.650411 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01bb13-2c23-4bdd-9d8f-d9d85683eaf7 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:46.680447 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1131/2257] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:57:46 2022] PUT /identity/v3/projects/a25807b9681341f08214d41ea6881308/users/40e772ffa6884f2f8c1b30ec707e6d4f/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:46.696852 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2d71e-f58e-4ade-b6a1-aee216306ca2 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:46.697444 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2d71e-f58e-4ade-b6a1-aee216306ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:46.698007 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2d71e-f58e-4ade-b6a1-aee216306ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:46.752008 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-94d2d71e-f58e-4ade-b6a1-aee216306ca2 None None] MFA Rules not processed for user `40e772ffa6884f2f8c1b30ec707e6d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:46.754263 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-94d2d71e-f58e-4ade-b6a1-aee216306ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:46.779819 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:46.839838 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01bb13-2c23-4bdd-9d8f-d9d85683eaf7 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:46.843286 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-ff01bb13-2c23-4bdd-9d8f-d9d85683eaf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:46.850207 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1127/2258] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:46 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:46.856863 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2d71e-f58e-4ade-b6a1-aee216306ca2 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:46.993125 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01bb13-2c23-4bdd-9d8f-d9d85683eaf7 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:47.010685 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2d71e-f58e-4ade-b6a1-aee216306ca2 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:47.011918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3502f-83ae-41b7-b67d-ce77dcbb8ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:47.013124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3502f-83ae-41b7-b67d-ce77dcbb8ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:47.013533 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3502f-83ae-41b7-b67d-ce77dcbb8ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:47.013816 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3502f-83ae-41b7-b67d-ce77dcbb8ce0 admin admin] PATH_INFO: `/v3/projects/542a2b4f73894073808e9384c8a40c5c` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:47.015274 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3502f-83ae-41b7-b67d-ce77dcbb8ce0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=542a2b4f73894073808e9384c8a40c5c)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:47.017256 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3502f-83ae-41b7-b67d-ce77dcbb8ce0 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:47.026838 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9e17e-52bf-48e8-8db5-43096febec97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:47.027547 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9e17e-52bf-48e8-8db5-43096febec97 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:47.027921 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9e17e-52bf-48e8-8db5-43096febec97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:47.028823 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9e17e-52bf-48e8-8db5-43096febec97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:47.029574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9e17e-52bf-48e8-8db5-43096febec97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:47.032537 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9e17e-52bf-48e8-8db5-43096febec97 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:47.068391 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1128/2259] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:57:46 2022] POST /identity/v3/projects => generated 409 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 17:57:47.072592 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9e17e-52bf-48e8-8db5-43096febec97 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:47.127850 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-c9e3502f-83ae-41b7-b67d-ce77dcbb8ce0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '542a2b4f73894073808e9384c8a40c5c', 'request_id': 'req-c9e3502f-83ae-41b7-b67d-ce77dcbb8ce0'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:47.147137 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-c9e3502f-83ae-41b7-b67d-ce77dcbb8ce0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '542a2b4f73894073808e9384c8a40c5c', 'request_id': 'req-c9e3502f-83ae-41b7-b67d-ce77dcbb8ce0'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:47.161221 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-c9e3502f-83ae-41b7-b67d-ce77dcbb8ce0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '542a2b4f73894073808e9384c8a40c5c', 'request_id': 'req-c9e3502f-83ae-41b7-b67d-ce77dcbb8ce0'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:47.210764 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-c9e3502f-83ae-41b7-b67d-ce77dcbb8ce0 admin admin] The token cache is being invalidate because project 542a2b4f73894073808e9384c8a40c5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:57:47.211407 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-c9e3502f-83ae-41b7-b67d-ce77dcbb8ce0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:47.214749 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-c9e3502f-83ae-41b7-b67d-ce77dcbb8ce0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:47.220245 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1132/2260] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:57:46 2022] DELETE /identity/v3/projects/542a2b4f73894073808e9384c8a40c5c => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:57:47.221676 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3502f-83ae-41b7-b67d-ce77dcbb8ce0 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:47.224739 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-c9e3502f-83ae-41b7-b67d-ce77dcbb8ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:47.271621 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9e17e-52bf-48e8-8db5-43096febec97 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:47.421040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:47.435504 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9462e5-4ead-49b1-aa21-620583be237b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:47.437386 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9462e5-4ead-49b1-aa21-620583be237b admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:47.438061 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9462e5-4ead-49b1-aa21-620583be237b admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:47.444936 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9462e5-4ead-49b1-aa21-620583be237b admin admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:47.449043 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9462e5-4ead-49b1-aa21-620583be237b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:47.455355 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9462e5-4ead-49b1-aa21-620583be237b admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:47.460139 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3502f-83ae-41b7-b67d-ce77dcbb8ce0 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:47.474052 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19d371-78e8-40e9-b360-898a61506eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:47.474523 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19d371-78e8-40e9-b360-898a61506eb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:47.474903 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19d371-78e8-40e9-b360-898a61506eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:47.475314 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19d371-78e8-40e9-b360-898a61506eb7 admin admin] PATH_INFO: `/v3/users/7657f1c55f984a468e9ad88a060de51d` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:47.476592 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19d371-78e8-40e9-b360-898a61506eb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7657f1c55f984a468e9ad88a060de51d)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:47.480683 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19d371-78e8-40e9-b360-898a61506eb7 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:47.495934 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:47.521862 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1129/2261] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:57:47 2022] POST /identity/v3/users => generated 311 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:57:47.522869 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9462e5-4ead-49b1-aa21-620583be237b admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:47.526300 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-5c9462e5-4ead-49b1-aa21-620583be237b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:47.558200 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9462e5-4ead-49b1-aa21-620583be237b admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:47.565035 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0f915-8950-40bd-8612-2f68c62648f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:47.565706 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0f915-8950-40bd-8612-2f68c62648f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:47.566127 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0f915-8950-40bd-8612-2f68c62648f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:47.566427 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0f915-8950-40bd-8612-2f68c62648f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:47.567189 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0f915-8950-40bd-8612-2f68c62648f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:47.568803 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0f915-8950-40bd-8612-2f68c62648f4 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:47.583080 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1130/2262] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:57:47.587727 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0f915-8950-40bd-8612-2f68c62648f4 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:47.592166 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-cc19d371-78e8-40e9-b360-898a61506eb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7657f1c55f984a468e9ad88a060de51d'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:47.596475 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-cc19d371-78e8-40e9-b360-898a61506eb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7657f1c55f984a468e9ad88a060de51d'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:47.596475 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-cc19d371-78e8-40e9-b360-898a61506eb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7657f1c55f984a468e9ad88a060de51d'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:47.611872 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0f915-8950-40bd-8612-2f68c62648f4 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:47.616628 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-cc19d371-78e8-40e9-b360-898a61506eb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7657f1c55f984a468e9ad88a060de51d'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:47.626442 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9acc05-65a5-4f1d-bd03-f53037150bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:47.629706 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-cc19d371-78e8-40e9-b360-898a61506eb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7657f1c55f984a468e9ad88a060de51d'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:47.634278 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9acc05-65a5-4f1d-bd03-f53037150bdd admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:47.634278 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9acc05-65a5-4f1d-bd03-f53037150bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:47.634278 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9acc05-65a5-4f1d-bd03-f53037150bdd admin admin] PATH_INFO: `/v3/projects/d1c8e07cf0cd4aa88d1738bdfaf661c8/users/50f15f05439d42a0a5bfadac85552d43/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:47.688912 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1133/2263] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:57:47 2022] DELETE /identity/v3/users/7657f1c55f984a468e9ad88a060de51d => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:47.692787 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9acc05-65a5-4f1d-bd03-f53037150bdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1c8e07cf0cd4aa88d1738bdfaf661c8, user_id=50f15f05439d42a0a5bfadac85552d43, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:47.695548 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9acc05-65a5-4f1d-bd03-f53037150bdd admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:47.722092 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1131/2264] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:57:47 2022] PUT /identity/v3/projects/d1c8e07cf0cd4aa88d1738bdfaf661c8/users/50f15f05439d42a0a5bfadac85552d43/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:47.735332 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19d371-78e8-40e9-b360-898a61506eb7 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:47.739654 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-cc19d371-78e8-40e9-b360-898a61506eb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:47.874738 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19d371-78e8-40e9-b360-898a61506eb7 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:48.031165 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5560bb-ef89-43d6-aad0-2c55c842d81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:48.032045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5560bb-ef89-43d6-aad0-2c55c842d81d admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:48.032045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5560bb-ef89-43d6-aad0-2c55c842d81d admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:48.032363 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5560bb-ef89-43d6-aad0-2c55c842d81d admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:48.033246 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5560bb-ef89-43d6-aad0-2c55c842d81d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:48.034926 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5560bb-ef89-43d6-aad0-2c55c842d81d admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:48.064277 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1134/2265] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:57:48.069000 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9acc05-65a5-4f1d-bd03-f53037150bdd admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:48.094134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9acc05-65a5-4f1d-bd03-f53037150bdd admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:48.101407 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041104c-2618-46c7-97d6-44bbe5b59bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:48.102666 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041104c-2618-46c7-97d6-44bbe5b59bfc admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:48.102961 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041104c-2618-46c7-97d6-44bbe5b59bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:48.103234 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041104c-2618-46c7-97d6-44bbe5b59bfc admin admin] PATH_INFO: `/v3/projects/d1c8e07cf0cd4aa88d1738bdfaf661c8/users/50f15f05439d42a0a5bfadac85552d43/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:48.105708 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041104c-2618-46c7-97d6-44bbe5b59bfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1c8e07cf0cd4aa88d1738bdfaf661c8, user_id=50f15f05439d42a0a5bfadac85552d43, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:48.109301 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041104c-2618-46c7-97d6-44bbe5b59bfc admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:48.140726 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1132/2266] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:57:48 2022] PUT /identity/v3/projects/d1c8e07cf0cd4aa88d1738bdfaf661c8/users/50f15f05439d42a0a5bfadac85552d43/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:48.146926 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b53de7-4213-4bf9-a827-e1cc8684b3cb None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:48.147325 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b53de7-4213-4bf9-a827-e1cc8684b3cb None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:48.147750 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b53de7-4213-4bf9-a827-e1cc8684b3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:48.246449 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-65b53de7-4213-4bf9-a827-e1cc8684b3cb None None] MFA Rules not processed for user `50f15f05439d42a0a5bfadac85552d43`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:48.247759 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-65b53de7-4213-4bf9-a827-e1cc8684b3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:48.282427 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:48.462398 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1135/2267] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:48 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:48.476411 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041104c-2618-46c7-97d6-44bbe5b59bfc admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:48.484404 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-4041104c-2618-46c7-97d6-44bbe5b59bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:48.571341 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041104c-2618-46c7-97d6-44bbe5b59bfc admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:48.576464 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acf070-9aad-4a18-92a2-61c6f5221baa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:48.577451 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acf070-9aad-4a18-92a2-61c6f5221baa service cinder] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:48.578075 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acf070-9aad-4a18-92a2-61c6f5221baa service cinder] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:48.578681 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acf070-9aad-4a18-92a2-61c6f5221baa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:48.590050 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84acf070-9aad-4a18-92a2-61c6f5221baa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:48.592571 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84acf070-9aad-4a18-92a2-61c6f5221baa service cinder] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:48.607768 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1133/2268] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:57:48 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 17:57:48.618719 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b53de7-4213-4bf9-a827-e1cc8684b3cb None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:48.620147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-65b53de7-4213-4bf9-a827-e1cc8684b3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:48.739056 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b53de7-4213-4bf9-a827-e1cc8684b3cb None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:48.744580 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc94ffe-3771-4773-8277-3a3bdddbf2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:48.745711 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc94ffe-3771-4773-8277-3a3bdddbf2c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:48.746145 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc94ffe-3771-4773-8277-3a3bdddbf2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:48.746423 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc94ffe-3771-4773-8277-3a3bdddbf2c6 admin admin] PATH_INFO: `/v3/projects/e5cc6d3eb4c9476ca5c1fd1a276271c3` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:48.747729 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc94ffe-3771-4773-8277-3a3bdddbf2c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5cc6d3eb4c9476ca5c1fd1a276271c3)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:48.749733 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc94ffe-3771-4773-8277-3a3bdddbf2c6 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:48.823312 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-bdc94ffe-3771-4773-8277-3a3bdddbf2c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5cc6d3eb4c9476ca5c1fd1a276271c3', 'request_id': 'req-bdc94ffe-3771-4773-8277-3a3bdddbf2c6'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:48.853960 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acf070-9aad-4a18-92a2-61c6f5221baa service cinder] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:48.860571 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-bdc94ffe-3771-4773-8277-3a3bdddbf2c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5cc6d3eb4c9476ca5c1fd1a276271c3', 'request_id': 'req-bdc94ffe-3771-4773-8277-3a3bdddbf2c6'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:48.870398 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acf070-9aad-4a18-92a2-61c6f5221baa service cinder] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:48.875697 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-bdc94ffe-3771-4773-8277-3a3bdddbf2c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5cc6d3eb4c9476ca5c1fd1a276271c3', 'request_id': 'req-bdc94ffe-3771-4773-8277-3a3bdddbf2c6'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:48.902472 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-bdc94ffe-3771-4773-8277-3a3bdddbf2c6 admin admin] The token cache is being invalidate because project e5cc6d3eb4c9476ca5c1fd1a276271c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:57:48.903568 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-bdc94ffe-3771-4773-8277-3a3bdddbf2c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:48.904444 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-bdc94ffe-3771-4773-8277-3a3bdddbf2c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:48.910943 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1136/2269] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:57:48 2022] DELETE /identity/v3/projects/e5cc6d3eb4c9476ca5c1fd1a276271c3 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:48.912038 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc94ffe-3771-4773-8277-3a3bdddbf2c6 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:48.917716 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-bdc94ffe-3771-4773-8277-3a3bdddbf2c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:48.942146 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446f5da-1097-4e66-b81f-aea71cef0133 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:48.943297 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446f5da-1097-4e66-b81f-aea71cef0133 service cinder] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:48.943699 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446f5da-1097-4e66-b81f-aea71cef0133 service cinder] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:48.943979 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446f5da-1097-4e66-b81f-aea71cef0133 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:48.955662 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-b446f5da-1097-4e66-b81f-aea71cef0133 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:49.000584 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:49.049448 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc94ffe-3771-4773-8277-3a3bdddbf2c6 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:49.067027 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb91da-b225-4f0d-9074-1a9b1e72f19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:49.067690 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb91da-b225-4f0d-9074-1a9b1e72f19f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:49.070374 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb91da-b225-4f0d-9074-1a9b1e72f19f admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:49.070374 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb91da-b225-4f0d-9074-1a9b1e72f19f admin admin] PATH_INFO: `/v3/users/918d6c9feb4040b1bf6c967b1c42af82` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:49.073060 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb91da-b225-4f0d-9074-1a9b1e72f19f admin admin] RBAC: Authorizing `identity:delete_user(user_id=918d6c9feb4040b1bf6c967b1c42af82)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:49.078407 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb91da-b225-4f0d-9074-1a9b1e72f19f admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:49.092977 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:49.105274 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446f5da-1097-4e66-b81f-aea71cef0133 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:49.107561 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446f5da-1097-4e66-b81f-aea71cef0133 service cinder] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:49.129487 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1134/2270] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:57:48 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:57:49.194339 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-53eb91da-b225-4f0d-9074-1a9b1e72f19f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '918d6c9feb4040b1bf6c967b1c42af82'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:49.196081 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-53eb91da-b225-4f0d-9074-1a9b1e72f19f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '918d6c9feb4040b1bf6c967b1c42af82'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:49.198384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-53eb91da-b225-4f0d-9074-1a9b1e72f19f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '918d6c9feb4040b1bf6c967b1c42af82'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:49.217707 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-53eb91da-b225-4f0d-9074-1a9b1e72f19f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '918d6c9feb4040b1bf6c967b1c42af82'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:49.234531 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-53eb91da-b225-4f0d-9074-1a9b1e72f19f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '918d6c9feb4040b1bf6c967b1c42af82'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:49.269116 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1137/2271] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:57:48 2022] DELETE /identity/v3/users/918d6c9feb4040b1bf6c967b1c42af82 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:49.826676 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446f5da-1097-4e66-b81f-aea71cef0133 service cinder] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:49.846839 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446f5da-1097-4e66-b81f-aea71cef0133 service cinder] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:49.968297 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137784ae-e8e8-453a-874a-198888038fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:49.971246 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137784ae-e8e8-453a-874a-198888038fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:49.971541 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137784ae-e8e8-453a-874a-198888038fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:49.971821 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137784ae-e8e8-453a-874a-198888038fc1 admin admin] PATH_INFO: `/v3/projects/0363f92314c34f9cb5bad093f60758e3` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:49.973508 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137784ae-e8e8-453a-874a-198888038fc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0363f92314c34f9cb5bad093f60758e3)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:49.976175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137784ae-e8e8-453a-874a-198888038fc1 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:50.036823 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-137784ae-e8e8-453a-874a-198888038fc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0363f92314c34f9cb5bad093f60758e3', 'request_id': 'req-137784ae-e8e8-453a-874a-198888038fc1'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:50.044376 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-137784ae-e8e8-453a-874a-198888038fc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0363f92314c34f9cb5bad093f60758e3', 'request_id': 'req-137784ae-e8e8-453a-874a-198888038fc1'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:50.053350 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-137784ae-e8e8-453a-874a-198888038fc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0363f92314c34f9cb5bad093f60758e3', 'request_id': 'req-137784ae-e8e8-453a-874a-198888038fc1'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:50.066994 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-137784ae-e8e8-453a-874a-198888038fc1 admin admin] The token cache is being invalidate because project 0363f92314c34f9cb5bad093f60758e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:57:50.067370 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-137784ae-e8e8-453a-874a-198888038fc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:50.068127 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-137784ae-e8e8-453a-874a-198888038fc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:50.073112 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1135/2272] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:57:49 2022] DELETE /identity/v3/projects/0363f92314c34f9cb5bad093f60758e3 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:50.075086 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665200d-fca1-4ebc-adc5-cf405373a868 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:50.075572 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665200d-fca1-4ebc-adc5-cf405373a868 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:50.075752 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665200d-fca1-4ebc-adc5-cf405373a868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:50.096823 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-d665200d-fca1-4ebc-adc5-cf405373a868 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:50.098375 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-d665200d-fca1-4ebc-adc5-cf405373a868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:50.170142 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1138/2273] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:57:50.174225 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c49cb-0ee8-4e38-950c-bb139202ac08 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:50.174767 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c49cb-0ee8-4e38-950c-bb139202ac08 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:50.174860 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c49cb-0ee8-4e38-950c-bb139202ac08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:50.220265 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-2f6c49cb-0ee8-4e38-950c-bb139202ac08 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:50.225315 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-2f6c49cb-0ee8-4e38-950c-bb139202ac08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:50.242308 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1136/2274] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:57:50.249990 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665200d-fca1-4ebc-adc5-cf405373a868 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:50.264136 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665200d-fca1-4ebc-adc5-cf405373a868 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:50.273652 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e43f1-1228-4f8f-b6c4-0c97dea9d4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:50.274288 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e43f1-1228-4f8f-b6c4-0c97dea9d4f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:50.275005 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e43f1-1228-4f8f-b6c4-0c97dea9d4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:50.275328 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e43f1-1228-4f8f-b6c4-0c97dea9d4f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:50.275972 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e43f1-1228-4f8f-b6c4-0c97dea9d4f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:57:50.276372 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e43f1-1228-4f8f-b6c4-0c97dea9d4f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:50.279417 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e43f1-1228-4f8f-b6c4-0c97dea9d4f4 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:50.297657 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1139/2275] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:57:50.299790 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c49cb-0ee8-4e38-950c-bb139202ac08 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:50.321486 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c49cb-0ee8-4e38-950c-bb139202ac08 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:50.331175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ceb96-d2e4-4950-ae0d-7520bef466c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:50.333851 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ceb96-d2e4-4950-ae0d-7520bef466c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:50.335396 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ceb96-d2e4-4950-ae0d-7520bef466c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:50.335909 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ceb96-d2e4-4950-ae0d-7520bef466c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:50.337148 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ceb96-d2e4-4950-ae0d-7520bef466c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:50.340313 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ceb96-d2e4-4950-ae0d-7520bef466c6 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:50.398999 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1137/2276] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:57:50 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:57:50.400820 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e43f1-1228-4f8f-b6c4-0c97dea9d4f4 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:50.423299 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e43f1-1228-4f8f-b6c4-0c97dea9d4f4 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:50.484833 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:50.509068 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a6cc9-c220-400c-959f-5dc1efbf1d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:50.509691 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a6cc9-c220-400c-959f-5dc1efbf1d4e admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:50.509966 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a6cc9-c220-400c-959f-5dc1efbf1d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:50.510233 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a6cc9-c220-400c-959f-5dc1efbf1d4e admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:50.510872 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a6cc9-c220-400c-959f-5dc1efbf1d4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:50.512885 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a6cc9-c220-400c-959f-5dc1efbf1d4e admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:50.544828 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1140/2277] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:57:50 2022] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:57:50.547476 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ceb96-d2e4-4950-ae0d-7520bef466c6 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:50.564784 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ceb96-d2e4-4950-ae0d-7520bef466c6 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:50.572416 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a73bcb-80d9-4070-a714-99543034a599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:50.573141 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a73bcb-80d9-4070-a714-99543034a599 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:50.573550 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a73bcb-80d9-4070-a714-99543034a599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:50.573953 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a73bcb-80d9-4070-a714-99543034a599 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:50.574691 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a73bcb-80d9-4070-a714-99543034a599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:50.578076 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a73bcb-80d9-4070-a714-99543034a599 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:50.595439 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1138/2278] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:57:50.596462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a6cc9-c220-400c-959f-5dc1efbf1d4e admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:50.608488 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a6cc9-c220-400c-959f-5dc1efbf1d4e admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:50.619997 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f98f8-60c2-48b8-8835-5aa49bf89240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:50.620637 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f98f8-60c2-48b8-8835-5aa49bf89240 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:50.620913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f98f8-60c2-48b8-8835-5aa49bf89240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:50.621206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f98f8-60c2-48b8-8835-5aa49bf89240 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:50.622740 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f98f8-60c2-48b8-8835-5aa49bf89240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:50.624537 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f98f8-60c2-48b8-8835-5aa49bf89240 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:50.640862 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1141/2279] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 17:57:50.648865 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a73bcb-80d9-4070-a714-99543034a599 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:50.676854 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a73bcb-80d9-4070-a714-99543034a599 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:50.688517 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8fe63-c07d-41df-a073-566c81e6b735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:50.689370 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8fe63-c07d-41df-a073-566c81e6b735 admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:50.692560 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8fe63-c07d-41df-a073-566c81e6b735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:50.692946 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8fe63-c07d-41df-a073-566c81e6b735 admin admin] PATH_INFO: `/v3/projects/0c43bc6156044684933b5646d7e4a060/users/bf06e56994824fda8e42a37f43282600/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:50.737921 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c8fe63-c07d-41df-a073-566c81e6b735 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c43bc6156044684933b5646d7e4a060, user_id=bf06e56994824fda8e42a37f43282600, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:50.741482 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c8fe63-c07d-41df-a073-566c81e6b735 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:50.770278 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1139/2280] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:57:50 2022] PUT /identity/v3/projects/0c43bc6156044684933b5646d7e4a060/users/bf06e56994824fda8e42a37f43282600/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:50.782380 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04037d-119c-4777-b4da-400e17ca0558 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:50.782857 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04037d-119c-4777-b4da-400e17ca0558 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:50.785646 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04037d-119c-4777-b4da-400e17ca0558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:50.842153 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-0e04037d-119c-4777-b4da-400e17ca0558 None None] MFA Rules not processed for user `bf06e56994824fda8e42a37f43282600`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:50.844523 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-0e04037d-119c-4777-b4da-400e17ca0558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:51.010016 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1142/2281] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:57:51.015789 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8fe63-c07d-41df-a073-566c81e6b735 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:51.099169 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:51.262736 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8fe63-c07d-41df-a073-566c81e6b735 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:51.270708 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e84fd-a421-48b7-8107-d1a352221971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:51.271847 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e84fd-a421-48b7-8107-d1a352221971 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:51.272320 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e84fd-a421-48b7-8107-d1a352221971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:51.272665 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e84fd-a421-48b7-8107-d1a352221971 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:51.273408 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e84fd-a421-48b7-8107-d1a352221971 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:51.275644 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e84fd-a421-48b7-8107-d1a352221971 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:51.338540 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1140/2282] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:57:51 2022] POST /identity/v3/projects => generated 385 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:57:51.343155 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04037d-119c-4777-b4da-400e17ca0558 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:51.354993 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04037d-119c-4777-b4da-400e17ca0558 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:51.435852 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636ac9d-b651-4e51-b56f-7298ae392ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:51.437059 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636ac9d-b651-4e51-b56f-7298ae392ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:51.437211 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636ac9d-b651-4e51-b56f-7298ae392ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:51.437643 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636ac9d-b651-4e51-b56f-7298ae392ae6 admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:51.438401 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1636ac9d-b651-4e51-b56f-7298ae392ae6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:51.440619 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1636ac9d-b651-4e51-b56f-7298ae392ae6 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:51.483208 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1143/2283] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:57:51 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:57:51.484573 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e84fd-a421-48b7-8107-d1a352221971 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:51.504908 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e84fd-a421-48b7-8107-d1a352221971 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:51.510291 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb98175-4ec5-4dad-8ec6-077e1d060248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:51.510758 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb98175-4ec5-4dad-8ec6-077e1d060248 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:51.511036 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb98175-4ec5-4dad-8ec6-077e1d060248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:51.511306 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb98175-4ec5-4dad-8ec6-077e1d060248 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:51.512007 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb98175-4ec5-4dad-8ec6-077e1d060248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:51.514727 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb98175-4ec5-4dad-8ec6-077e1d060248 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:51.526946 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1141/2284] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:57:51.531994 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636ac9d-b651-4e51-b56f-7298ae392ae6 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:51.547476 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636ac9d-b651-4e51-b56f-7298ae392ae6 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:51.553189 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545e1a7-beea-4b48-82df-259570f15588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:51.553870 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545e1a7-beea-4b48-82df-259570f15588 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:51.554323 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545e1a7-beea-4b48-82df-259570f15588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:51.554730 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545e1a7-beea-4b48-82df-259570f15588 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:51.555256 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545e1a7-beea-4b48-82df-259570f15588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:51.556884 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545e1a7-beea-4b48-82df-259570f15588 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:51.571436 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1144/2285] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:57:51.577994 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb98175-4ec5-4dad-8ec6-077e1d060248 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:51.590216 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb98175-4ec5-4dad-8ec6-077e1d060248 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:51.596432 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0f932-fbf6-4cd6-82e8-0a2a734546ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:51.597152 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0f932-fbf6-4cd6-82e8-0a2a734546ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:51.597431 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0f932-fbf6-4cd6-82e8-0a2a734546ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:51.597702 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0f932-fbf6-4cd6-82e8-0a2a734546ab admin admin] PATH_INFO: `/v3/projects/c997236ea1564cba8cf42997714a09fd/users/f3a8402359684460824a3015eaa2d8c2/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:51.617974 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0f932-fbf6-4cd6-82e8-0a2a734546ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=c997236ea1564cba8cf42997714a09fd, user_id=f3a8402359684460824a3015eaa2d8c2, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:51.622156 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0f932-fbf6-4cd6-82e8-0a2a734546ab admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:51.643757 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1142/2286] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:57:51 2022] PUT /identity/v3/projects/c997236ea1564cba8cf42997714a09fd/users/f3a8402359684460824a3015eaa2d8c2/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:51.655348 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd068325-13b4-4cac-bbaf-255f36f4a8de None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:51.655638 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd068325-13b4-4cac-bbaf-255f36f4a8de None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:51.655902 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd068325-13b4-4cac-bbaf-255f36f4a8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:51.693616 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-bd068325-13b4-4cac-bbaf-255f36f4a8de None None] MFA Rules not processed for user `f3a8402359684460824a3015eaa2d8c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:51.695109 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-bd068325-13b4-4cac-bbaf-255f36f4a8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:51.732636 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:51.832493 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0f932-fbf6-4cd6-82e8-0a2a734546ab admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:51.833942 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1145/2287] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:51.979269 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0f932-fbf6-4cd6-82e8-0a2a734546ab admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:51.994688 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885100b-1c7b-4f9a-bd2d-1574d8102c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:51.997774 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885100b-1c7b-4f9a-bd2d-1574d8102c8e admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:51.998874 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885100b-1c7b-4f9a-bd2d-1574d8102c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:52.004875 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885100b-1c7b-4f9a-bd2d-1574d8102c8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:52.006681 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c885100b-1c7b-4f9a-bd2d-1574d8102c8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:52.010682 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c885100b-1c7b-4f9a-bd2d-1574d8102c8e admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:52.064667 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1143/2288] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:57:51 2022] POST /identity/v3/projects => generated 385 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 17:57:52.071223 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd068325-13b4-4cac-bbaf-255f36f4a8de None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:52.089629 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd068325-13b4-4cac-bbaf-255f36f4a8de None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:52.148945 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a265e7-4aac-437b-a9fb-2de4f3d6a93e None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:52.149282 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a265e7-4aac-437b-a9fb-2de4f3d6a93e None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:52.149466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a265e7-4aac-437b-a9fb-2de4f3d6a93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:52.169625 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313be42b-4d7e-4740-891a-77695b6f426a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:52.170368 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313be42b-4d7e-4740-891a-77695b6f426a admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:52.170556 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313be42b-4d7e-4740-891a-77695b6f426a admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:52.171303 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313be42b-4d7e-4740-891a-77695b6f426a admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:52.171466 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313be42b-4d7e-4740-891a-77695b6f426a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:52.173442 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313be42b-4d7e-4740-891a-77695b6f426a admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:52.204310 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1146/2289] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:57:52 2022] POST /identity/v3/users => generated 299 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:57:52.205544 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313be42b-4d7e-4740-891a-77695b6f426a admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:52.214967 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-a1a265e7-4aac-437b-a9fb-2de4f3d6a93e None None] MFA Rules not processed for user `6384580cf2804b39bb9dbca582adcc4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:52.216944 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313be42b-4d7e-4740-891a-77695b6f426a admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:52.218295 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-a1a265e7-4aac-437b-a9fb-2de4f3d6a93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:52.227861 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb519fb-ad29-4b43-9e7e-3c3d8963b1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:52.228593 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb519fb-ad29-4b43-9e7e-3c3d8963b1dc admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:52.228876 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb519fb-ad29-4b43-9e7e-3c3d8963b1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:52.229261 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb519fb-ad29-4b43-9e7e-3c3d8963b1dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:52.229921 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb519fb-ad29-4b43-9e7e-3c3d8963b1dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:52.232145 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb519fb-ad29-4b43-9e7e-3c3d8963b1dc admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:52.254563 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1147/2290] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 17:57:52.255828 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb519fb-ad29-4b43-9e7e-3c3d8963b1dc admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:52.270776 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb519fb-ad29-4b43-9e7e-3c3d8963b1dc admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:52.279923 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e0472-db20-40ce-8412-69b9761ab2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:52.280612 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e0472-db20-40ce-8412-69b9761ab2e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:52.280890 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e0472-db20-40ce-8412-69b9761ab2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:52.281202 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e0472-db20-40ce-8412-69b9761ab2e2 admin admin] PATH_INFO: `/v3/projects/1dea718df3644392855a55f46570c571/users/6508bdbfb3704ab68b981ee5f0710b4e/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:52.304241 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:52.327773 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e0472-db20-40ce-8412-69b9761ab2e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dea718df3644392855a55f46570c571, user_id=6508bdbfb3704ab68b981ee5f0710b4e, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:52.337428 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e0472-db20-40ce-8412-69b9761ab2e2 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:52.342901 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1144/2291] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:52.345207 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a265e7-4aac-437b-a9fb-2de4f3d6a93e None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:52.347638 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-a1a265e7-4aac-437b-a9fb-2de4f3d6a93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:52.368461 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a265e7-4aac-437b-a9fb-2de4f3d6a93e None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:52.374540 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1148/2292] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:57:52 2022] PUT /identity/v3/projects/1dea718df3644392855a55f46570c571/users/6508bdbfb3704ab68b981ee5f0710b4e/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:52.375665 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e0472-db20-40ce-8412-69b9761ab2e2 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:52.471351 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e0472-db20-40ce-8412-69b9761ab2e2 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:52.476834 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8c80c-8d16-4408-8ecf-0968e179268d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:52.477316 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcdbd42-e316-4c9b-8fa8-674d4434314b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:52.477663 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8c80c-8d16-4408-8ecf-0968e179268d admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:52.477941 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8c80c-8d16-4408-8ecf-0968e179268d admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:52.478037 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcdbd42-e316-4c9b-8fa8-674d4434314b admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:52.478308 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8c80c-8d16-4408-8ecf-0968e179268d admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:52.478421 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcdbd42-e316-4c9b-8fa8-674d4434314b admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:52.478666 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcdbd42-e316-4c9b-8fa8-674d4434314b admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:52.478949 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8c80c-8d16-4408-8ecf-0968e179268d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:52.479410 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcdbd42-e316-4c9b-8fa8-674d4434314b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:52.480867 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8c80c-8d16-4408-8ecf-0968e179268d admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:52.482052 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcdbd42-e316-4c9b-8fa8-674d4434314b admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:52.493562 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1149/2293] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:57:52.499298 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcdbd42-e316-4c9b-8fa8-674d4434314b admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:52.515996 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcdbd42-e316-4c9b-8fa8-674d4434314b admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:52.518053 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1145/2294] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:57:52 2022] POST /identity/v3/projects => generated 385 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 17:57:52.521805 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8c80c-8d16-4408-8ecf-0968e179268d admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:52.530460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:52.657313 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8c80c-8d16-4408-8ecf-0968e179268d admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:52.658383 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c08abf-28ab-4dda-b660-f1445f08fb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:52.659235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c08abf-28ab-4dda-b660-f1445f08fb11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:52.659954 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c08abf-28ab-4dda-b660-f1445f08fb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:52.659954 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c08abf-28ab-4dda-b660-f1445f08fb11 admin admin] PATH_INFO: `/v3/projects/1dea718df3644392855a55f46570c571/users/6508bdbfb3704ab68b981ee5f0710b4e/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:52.662252 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c08abf-28ab-4dda-b660-f1445f08fb11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dea718df3644392855a55f46570c571, user_id=6508bdbfb3704ab68b981ee5f0710b4e, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:52.665329 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c08abf-28ab-4dda-b660-f1445f08fb11 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:52.671190 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640c2a6-477d-4454-99cf-468217b19708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:52.671752 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640c2a6-477d-4454-99cf-468217b19708 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:52.672753 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640c2a6-477d-4454-99cf-468217b19708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:52.673106 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640c2a6-477d-4454-99cf-468217b19708 admin admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:52.673931 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1640c2a6-477d-4454-99cf-468217b19708 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:52.675760 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1640c2a6-477d-4454-99cf-468217b19708 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:52.679744 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1150/2295] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:57:52 2022] PUT /identity/v3/projects/1dea718df3644392855a55f46570c571/users/6508bdbfb3704ab68b981ee5f0710b4e/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:52.692811 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49daf4b-b422-44e5-838b-9971cf08fb48 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:52.693138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49daf4b-b422-44e5-838b-9971cf08fb48 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:52.693414 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49daf4b-b422-44e5-838b-9971cf08fb48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:52.730126 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1146/2296] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:57:52 2022] POST /identity/v3/users => generated 299 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 17:57:52.744189 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640c2a6-477d-4454-99cf-468217b19708 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:52.747607 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-e49daf4b-b422-44e5-838b-9971cf08fb48 None None] MFA Rules not processed for user `6508bdbfb3704ab68b981ee5f0710b4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:52.748961 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-e49daf4b-b422-44e5-838b-9971cf08fb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:52.758615 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640c2a6-477d-4454-99cf-468217b19708 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:52.879179 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7850bb4-a0b1-4125-9161-82f140599623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:52.880699 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7850bb4-a0b1-4125-9161-82f140599623 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:52.880936 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7850bb4-a0b1-4125-9161-82f140599623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:52.881145 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7850bb4-a0b1-4125-9161-82f140599623 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:52.882040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7850bb4-a0b1-4125-9161-82f140599623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:52.882957 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1151/2297] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:52 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:52.900535 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7850bb4-a0b1-4125-9161-82f140599623 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:52.902657 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49daf4b-b422-44e5-838b-9971cf08fb48 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:52.904084 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:52.907167 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-e49daf4b-b422-44e5-838b-9971cf08fb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:52.921240 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1147/2298] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 17:57:52.922590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7850bb4-a0b1-4125-9161-82f140599623 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:52.937277 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7850bb4-a0b1-4125-9161-82f140599623 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:52.943884 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893577c-85c4-4dc7-ad0e-0204026233b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:52.944676 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893577c-85c4-4dc7-ad0e-0204026233b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:52.945043 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893577c-85c4-4dc7-ad0e-0204026233b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:52.945407 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893577c-85c4-4dc7-ad0e-0204026233b1 admin admin] PATH_INFO: `/v3/projects/1d9e2824b94f4edab08089f440657b70/users/5a6bb4b8e4c34a3da9515e12136f1865/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:52.968781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893577c-85c4-4dc7-ad0e-0204026233b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d9e2824b94f4edab08089f440657b70, user_id=5a6bb4b8e4c34a3da9515e12136f1865, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:52.971919 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893577c-85c4-4dc7-ad0e-0204026233b1 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:52.992941 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1148/2299] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:57:52 2022] PUT /identity/v3/projects/1d9e2824b94f4edab08089f440657b70/users/5a6bb4b8e4c34a3da9515e12136f1865/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:52.994513 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893577c-85c4-4dc7-ad0e-0204026233b1 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:53.055164 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49daf4b-b422-44e5-838b-9971cf08fb48 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:53.090432 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893577c-85c4-4dc7-ad0e-0204026233b1 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:53.096114 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd940168-bbfc-4b73-9dfe-a7137c3be525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:53.096738 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd940168-bbfc-4b73-9dfe-a7137c3be525 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:53.097054 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd940168-bbfc-4b73-9dfe-a7137c3be525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:53.097313 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd940168-bbfc-4b73-9dfe-a7137c3be525 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:53.097965 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd940168-bbfc-4b73-9dfe-a7137c3be525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:53.099568 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd940168-bbfc-4b73-9dfe-a7137c3be525 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:53.129430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1149/2300] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:57:53.129430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd940168-bbfc-4b73-9dfe-a7137c3be525 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:53.150025 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd940168-bbfc-4b73-9dfe-a7137c3be525 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:53.155600 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3da80b-6333-400a-bffa-5746540804c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:53.156299 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3da80b-6333-400a-bffa-5746540804c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:53.156593 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3da80b-6333-400a-bffa-5746540804c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:53.160764 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3da80b-6333-400a-bffa-5746540804c7 admin admin] PATH_INFO: `/v3/projects/1d9e2824b94f4edab08089f440657b70/users/5a6bb4b8e4c34a3da9515e12136f1865/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:53.162232 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3da80b-6333-400a-bffa-5746540804c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d9e2824b94f4edab08089f440657b70, user_id=5a6bb4b8e4c34a3da9515e12136f1865, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:53.165198 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3da80b-6333-400a-bffa-5746540804c7 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:53.179908 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1150/2301] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:57:53 2022] PUT /identity/v3/projects/1d9e2824b94f4edab08089f440657b70/users/5a6bb4b8e4c34a3da9515e12136f1865/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:53.199165 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed61577c-80a7-4bf4-a0f6-020042d8befa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:53.201265 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61577c-80a7-4bf4-a0f6-020042d8befa service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:53.202058 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61577c-80a7-4bf4-a0f6-020042d8befa service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:53.202603 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61577c-80a7-4bf4-a0f6-020042d8befa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:53.208211 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:53.286103 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed61577c-80a7-4bf4-a0f6-020042d8befa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:53.292868 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed61577c-80a7-4bf4-a0f6-020042d8befa service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:53.342375 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1152/2302] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:57:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:57:54.653479 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3da80b-6333-400a-bffa-5746540804c7 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:54.655604 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-0c3da80b-6333-400a-bffa-5746540804c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:54.738639 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3da80b-6333-400a-bffa-5746540804c7 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:54.748068 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae931ab7-c13f-4428-9312-75f6af6eeb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:54.748807 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae931ab7-c13f-4428-9312-75f6af6eeb20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:54.749133 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae931ab7-c13f-4428-9312-75f6af6eeb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:54.750318 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae931ab7-c13f-4428-9312-75f6af6eeb20 admin admin] PATH_INFO: `/v3/users/f72b46341efc48b496a3b422c657e380` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:54.752236 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae931ab7-c13f-4428-9312-75f6af6eeb20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f72b46341efc48b496a3b422c657e380)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:54.755909 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae931ab7-c13f-4428-9312-75f6af6eeb20 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:54.836023 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-ae931ab7-c13f-4428-9312-75f6af6eeb20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f72b46341efc48b496a3b422c657e380'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:54.848961 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-ae931ab7-c13f-4428-9312-75f6af6eeb20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f72b46341efc48b496a3b422c657e380'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:54.850637 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-ae931ab7-c13f-4428-9312-75f6af6eeb20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f72b46341efc48b496a3b422c657e380'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:54.851426 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-ae931ab7-c13f-4428-9312-75f6af6eeb20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f72b46341efc48b496a3b422c657e380'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:54.856933 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:54.875871 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-ae931ab7-c13f-4428-9312-75f6af6eeb20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f72b46341efc48b496a3b422c657e380'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:54.921886 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1151/2303] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:57:54 2022] DELETE /identity/v3/users/f72b46341efc48b496a3b422c657e380 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:54.926722 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b05831-3828-499a-89a5-812f996718fa None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:54.927173 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b05831-3828-499a-89a5-812f996718fa None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:54.927343 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b05831-3828-499a-89a5-812f996718fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:54.963667 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-e6b05831-3828-499a-89a5-812f996718fa None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:54.965102 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-e6b05831-3828-499a-89a5-812f996718fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:55.108915 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1153/2304] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:57:55.121194 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae931ab7-c13f-4428-9312-75f6af6eeb20 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:55.125751 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-ae931ab7-c13f-4428-9312-75f6af6eeb20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:55.133040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b05831-3828-499a-89a5-812f996718fa None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:55.145266 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-e6b05831-3828-499a-89a5-812f996718fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:55.212621 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae931ab7-c13f-4428-9312-75f6af6eeb20 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:55.220301 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c75a2-396c-4a1d-bde1-a33b49d23864 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:55.220999 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c75a2-396c-4a1d-bde1-a33b49d23864 service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:55.221328 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c75a2-396c-4a1d-bde1-a33b49d23864 service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:55.221605 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c75a2-396c-4a1d-bde1-a33b49d23864 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:55.233315 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c75a2-396c-4a1d-bde1-a33b49d23864 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:55.235482 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c75a2-396c-4a1d-bde1-a33b49d23864 service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:55.247730 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1152/2305] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:57:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:57:55.335014 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b05831-3828-499a-89a5-812f996718fa None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:55.340044 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a581bf75-12bc-4503-a0dd-ce8004806c2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:55.340680 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581bf75-12bc-4503-a0dd-ce8004806c2f service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:55.341559 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581bf75-12bc-4503-a0dd-ce8004806c2f service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:55.341827 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581bf75-12bc-4503-a0dd-ce8004806c2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:55.343949 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-a581bf75-12bc-4503-a0dd-ce8004806c2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:55.510484 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a581bf75-12bc-4503-a0dd-ce8004806c2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:55.517213 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a581bf75-12bc-4503-a0dd-ce8004806c2f service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:55.534224 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:55.545951 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1154/2306] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:57:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:57:56.094954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c75a2-396c-4a1d-bde1-a33b49d23864 service neutron] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:56.096435 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-f99c75a2-396c-4a1d-bde1-a33b49d23864 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:56.123879 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c75a2-396c-4a1d-bde1-a33b49d23864 service neutron] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:56.151094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65fea6-e038-4dee-93a2-b817a50d05c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:56.152007 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65fea6-e038-4dee-93a2-b817a50d05c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:56.152427 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65fea6-e038-4dee-93a2-b817a50d05c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:56.152796 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65fea6-e038-4dee-93a2-b817a50d05c1 admin admin] PATH_INFO: `/v3/projects/061593798de947d0854672e68f1a4aac` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:56.156833 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef65fea6-e038-4dee-93a2-b817a50d05c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=061593798de947d0854672e68f1a4aac)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:56.159010 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef65fea6-e038-4dee-93a2-b817a50d05c1 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:56.252309 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-ef65fea6-e038-4dee-93a2-b817a50d05c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '061593798de947d0854672e68f1a4aac', 'request_id': 'req-ef65fea6-e038-4dee-93a2-b817a50d05c1'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:56.265426 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-ef65fea6-e038-4dee-93a2-b817a50d05c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '061593798de947d0854672e68f1a4aac', 'request_id': 'req-ef65fea6-e038-4dee-93a2-b817a50d05c1'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:56.284710 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-ef65fea6-e038-4dee-93a2-b817a50d05c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '061593798de947d0854672e68f1a4aac', 'request_id': 'req-ef65fea6-e038-4dee-93a2-b817a50d05c1'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:56.302434 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-ef65fea6-e038-4dee-93a2-b817a50d05c1 admin admin] The token cache is being invalidate because project 061593798de947d0854672e68f1a4aac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:57:56.302946 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-ef65fea6-e038-4dee-93a2-b817a50d05c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:56.304630 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-ef65fea6-e038-4dee-93a2-b817a50d05c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:56.312328 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1153/2307] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:57:56 2022] DELETE /identity/v3/projects/061593798de947d0854672e68f1a4aac => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:56.315835 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4754a8-6afc-4752-a880-57f38da81c32 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:56.316432 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4754a8-6afc-4752-a880-57f38da81c32 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:56.316432 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4754a8-6afc-4752-a880-57f38da81c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:56.352787 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-5e4754a8-6afc-4752-a880-57f38da81c32 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:56.359757 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-5e4754a8-6afc-4752-a880-57f38da81c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:56.537635 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1155/2308] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:56.546255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea5ab7-2ba6-4507-a71c-5889ff9d92af None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:56.546542 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea5ab7-2ba6-4507-a71c-5889ff9d92af None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:56.546824 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea5ab7-2ba6-4507-a71c-5889ff9d92af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:56.610140 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-5cea5ab7-2ba6-4507-a71c-5889ff9d92af None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:56.624395 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-5cea5ab7-2ba6-4507-a71c-5889ff9d92af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:56.645857 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1154/2309] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:56.646951 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4754a8-6afc-4752-a880-57f38da81c32 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:56.661759 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4754a8-6afc-4752-a880-57f38da81c32 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:56.671518 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5491f9a-f13e-4970-ac03-369f8ca1ac0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:56.672802 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5491f9a-f13e-4970-ac03-369f8ca1ac0d admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:56.677233 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5491f9a-f13e-4970-ac03-369f8ca1ac0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:56.687639 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5491f9a-f13e-4970-ac03-369f8ca1ac0d admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:56.689343 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5491f9a-f13e-4970-ac03-369f8ca1ac0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:57:56.690144 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5491f9a-f13e-4970-ac03-369f8ca1ac0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:56.692997 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5491f9a-f13e-4970-ac03-369f8ca1ac0d admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:56.726677 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea5ab7-2ba6-4507-a71c-5889ff9d92af None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:56.726914 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1156/2310] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:57:56.737443 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea5ab7-2ba6-4507-a71c-5889ff9d92af None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:56.743636 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e67a71-3149-462c-81e1-66022cc97604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:56.744483 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e67a71-3149-462c-81e1-66022cc97604 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:56.744862 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e67a71-3149-462c-81e1-66022cc97604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:56.745318 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e67a71-3149-462c-81e1-66022cc97604 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:56.746339 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e67a71-3149-462c-81e1-66022cc97604 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:56.748487 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e67a71-3149-462c-81e1-66022cc97604 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:56.776121 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5491f9a-f13e-4970-ac03-369f8ca1ac0d admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:56.777998 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-d5491f9a-f13e-4970-ac03-369f8ca1ac0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:56.799323 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1155/2311] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:57:56 2022] POST /identity/v3/projects => generated 375 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 17:57:56.803479 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e67a71-3149-462c-81e1-66022cc97604 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:56.888862 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:56.938411 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5491f9a-f13e-4970-ac03-369f8ca1ac0d admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:56.960210 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e67a71-3149-462c-81e1-66022cc97604 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:56.971132 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b902fc-fafd-454c-b979-af86a31cc4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:56.972429 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b902fc-fafd-454c-b979-af86a31cc4a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:56.972820 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b902fc-fafd-454c-b979-af86a31cc4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:56.973241 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b902fc-fafd-454c-b979-af86a31cc4a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:56.977030 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b902fc-fafd-454c-b979-af86a31cc4a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:56.979831 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b902fc-fafd-454c-b979-af86a31cc4a9 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:57.013738 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1156/2312] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:57:56 2022] POST /identity/v3/users => generated 288 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 17:57:57.018257 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b902fc-fafd-454c-b979-af86a31cc4a9 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:57.033116 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8e02e-adf8-483c-9143-0339b355be2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:57.034545 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8e02e-adf8-483c-9143-0339b355be2f service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:57.034833 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8e02e-adf8-483c-9143-0339b355be2f service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:57.035222 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8e02e-adf8-483c-9143-0339b355be2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:57.037232 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b902fc-fafd-454c-b979-af86a31cc4a9 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:57.043036 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-47c8e02e-adf8-483c-9143-0339b355be2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:57.043913 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf17c9-7704-4f19-be8c-cfbae5c263ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:57.044665 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf17c9-7704-4f19-be8c-cfbae5c263ff admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:57.045266 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf17c9-7704-4f19-be8c-cfbae5c263ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:57.045647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf17c9-7704-4f19-be8c-cfbae5c263ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:57.046768 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf17c9-7704-4f19-be8c-cfbae5c263ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:57.048688 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf17c9-7704-4f19-be8c-cfbae5c263ff admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:57.069100 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1157/2313] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:57:57.073457 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf17c9-7704-4f19-be8c-cfbae5c263ff admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:57.097747 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf17c9-7704-4f19-be8c-cfbae5c263ff admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:57.114065 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a872fd-6908-4c3f-b727-9d4201874eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:57.114794 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a872fd-6908-4c3f-b727-9d4201874eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:57.115145 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a872fd-6908-4c3f-b727-9d4201874eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:57.115491 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a872fd-6908-4c3f-b727-9d4201874eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:57.116349 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a872fd-6908-4c3f-b727-9d4201874eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:57.118013 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a872fd-6908-4c3f-b727-9d4201874eb8 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:57.148485 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1158/2314] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:57:57.149461 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a872fd-6908-4c3f-b727-9d4201874eb8 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:57.156612 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-c4a872fd-6908-4c3f-b727-9d4201874eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:57.181879 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a872fd-6908-4c3f-b727-9d4201874eb8 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:57.199263 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab718a4-8267-47ff-9c5d-1f41cdb0ffaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:57.199914 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab718a4-8267-47ff-9c5d-1f41cdb0ffaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:57.201508 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab718a4-8267-47ff-9c5d-1f41cdb0ffaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:57.201508 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab718a4-8267-47ff-9c5d-1f41cdb0ffaf admin admin] PATH_INFO: `/v3/users/40e772ffa6884f2f8c1b30ec707e6d4f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:57.202362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab718a4-8267-47ff-9c5d-1f41cdb0ffaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=40e772ffa6884f2f8c1b30ec707e6d4f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:57.204330 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab718a4-8267-47ff-9c5d-1f41cdb0ffaf admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:57.222735 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:57.230248 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8e02e-adf8-483c-9143-0339b355be2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:57.234599 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8e02e-adf8-483c-9143-0339b355be2f service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:57.284328 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1157/2315] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:57:56 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:57:57.290076 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8e02e-adf8-483c-9143-0339b355be2f service cinder] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:57.306556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-dab718a4-8267-47ff-9c5d-1f41cdb0ffaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40e772ffa6884f2f8c1b30ec707e6d4f'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:57.324178 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-dab718a4-8267-47ff-9c5d-1f41cdb0ffaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40e772ffa6884f2f8c1b30ec707e6d4f'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:57.324961 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-dab718a4-8267-47ff-9c5d-1f41cdb0ffaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40e772ffa6884f2f8c1b30ec707e6d4f'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:57.326627 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-dab718a4-8267-47ff-9c5d-1f41cdb0ffaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40e772ffa6884f2f8c1b30ec707e6d4f'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:57.327584 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8e02e-adf8-483c-9143-0339b355be2f service cinder] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:57.344823 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-dab718a4-8267-47ff-9c5d-1f41cdb0ffaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40e772ffa6884f2f8c1b30ec707e6d4f'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:57.353210 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8037c-0908-4ad0-9fd0-73a1633b6d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:57.356170 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8037c-0908-4ad0-9fd0-73a1633b6d36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:57.356495 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8037c-0908-4ad0-9fd0-73a1633b6d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:57.356780 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8037c-0908-4ad0-9fd0-73a1633b6d36 admin admin] PATH_INFO: `/v3/projects/a8d605c621c04855a4e8eebd5281e388/users/30f57cff2e48404a945d15cc12876fb6/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:57.406497 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1159/2316] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:57:57 2022] DELETE /identity/v3/users/40e772ffa6884f2f8c1b30ec707e6d4f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:57.411266 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc2693-1ca7-4ba8-b6c3-c78a364035e4 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:57.412607 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc2693-1ca7-4ba8-b6c3-c78a364035e4 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:57.413200 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc2693-1ca7-4ba8-b6c3-c78a364035e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:57.430503 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8037c-0908-4ad0-9fd0-73a1633b6d36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8d605c621c04855a4e8eebd5281e388, user_id=30f57cff2e48404a945d15cc12876fb6, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:57.437701 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8037c-0908-4ad0-9fd0-73a1633b6d36 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:57.458075 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-3acc2693-1ca7-4ba8-b6c3-c78a364035e4 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:57.459311 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-3acc2693-1ca7-4ba8-b6c3-c78a364035e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:57.522431 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1158/2317] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:57:57 2022] PUT /identity/v3/projects/a8d605c621c04855a4e8eebd5281e388/users/30f57cff2e48404a945d15cc12876fb6/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:57.524185 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47857e-aca1-4866-aef3-b98c206a5fdb None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:57.524475 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47857e-aca1-4866-aef3-b98c206a5fdb None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:57.524745 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47857e-aca1-4866-aef3-b98c206a5fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:57.615736 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1160/2318] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:57.616054 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-eb47857e-aca1-4866-aef3-b98c206a5fdb None None] MFA Rules not processed for user `30f57cff2e48404a945d15cc12876fb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:57:57.629979 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-eb47857e-aca1-4866-aef3-b98c206a5fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:57.642607 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc2693-1ca7-4ba8-b6c3-c78a364035e4 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:57.644058 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-3acc2693-1ca7-4ba8-b6c3-c78a364035e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:57.670476 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:57.774499 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1159/2319] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:57:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:57:57.778894 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc2693-1ca7-4ba8-b6c3-c78a364035e4 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:57.786623 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47857e-aca1-4866-aef3-b98c206a5fdb None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:57.788478 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-eb47857e-aca1-4866-aef3-b98c206a5fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:57.891362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afdc60-399a-4432-88a8-700766c66678 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:57.891995 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afdc60-399a-4432-88a8-700766c66678 service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:57.892840 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afdc60-399a-4432-88a8-700766c66678 service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:57.892840 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afdc60-399a-4432-88a8-700766c66678 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:58.041949 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47857e-aca1-4866-aef3-b98c206a5fdb None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:58.054963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be6bf1-3f5b-40d1-8b0b-b52f38541efa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:58.055960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be6bf1-3f5b-40d1-8b0b-b52f38541efa service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:58.056272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be6bf1-3f5b-40d1-8b0b-b52f38541efa service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:58.056715 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be6bf1-3f5b-40d1-8b0b-b52f38541efa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:58.070621 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68afdc60-399a-4432-88a8-700766c66678 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:58.072079 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68afdc60-399a-4432-88a8-700766c66678 service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:58.084047 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1161/2320] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:57:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 17:57:58.093745 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be6bf1-3f5b-40d1-8b0b-b52f38541efa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:58.095307 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be6bf1-3f5b-40d1-8b0b-b52f38541efa service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:58.118126 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1160/2321] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:57:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:57:58.812211 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afdc60-399a-4432-88a8-700766c66678 service neutron] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:58.814104 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-68afdc60-399a-4432-88a8-700766c66678 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:58.833876 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afdc60-399a-4432-88a8-700766c66678 service neutron] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:58.846663 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6080c3-adb5-41bc-a55f-075b3c6161c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:58.849459 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6080c3-adb5-41bc-a55f-075b3c6161c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:58.849773 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6080c3-adb5-41bc-a55f-075b3c6161c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:58.850052 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6080c3-adb5-41bc-a55f-075b3c6161c1 admin admin] PATH_INFO: `/v3/projects/a25807b9681341f08214d41ea6881308` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:58.852081 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6080c3-adb5-41bc-a55f-075b3c6161c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a25807b9681341f08214d41ea6881308)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:58.855039 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6080c3-adb5-41bc-a55f-075b3c6161c1 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:58.946375 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-6d6080c3-adb5-41bc-a55f-075b3c6161c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a25807b9681341f08214d41ea6881308', 'request_id': 'req-6d6080c3-adb5-41bc-a55f-075b3c6161c1'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:58.952861 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-6d6080c3-adb5-41bc-a55f-075b3c6161c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a25807b9681341f08214d41ea6881308', 'request_id': 'req-6d6080c3-adb5-41bc-a55f-075b3c6161c1'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:58.963610 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-6d6080c3-adb5-41bc-a55f-075b3c6161c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a25807b9681341f08214d41ea6881308', 'request_id': 'req-6d6080c3-adb5-41bc-a55f-075b3c6161c1'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:58.978930 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:58.986321 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-6d6080c3-adb5-41bc-a55f-075b3c6161c1 admin admin] The token cache is being invalidate because project a25807b9681341f08214d41ea6881308 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:57:58.986617 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-6d6080c3-adb5-41bc-a55f-075b3c6161c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:58.987391 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-6d6080c3-adb5-41bc-a55f-075b3c6161c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:58.992754 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1162/2322] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:57:58 2022] DELETE /identity/v3/projects/a25807b9681341f08214d41ea6881308 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:58.994390 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be6bf1-3f5b-40d1-8b0b-b52f38541efa service cinder] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:59.019503 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be6bf1-3f5b-40d1-8b0b-b52f38541efa service cinder] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:57:59.185936 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e373ad-993f-4766-a00c-66f45e604056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:57:59.186862 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e373ad-993f-4766-a00c-66f45e604056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:57:59.187333 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e373ad-993f-4766-a00c-66f45e604056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:57:59.187821 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e373ad-993f-4766-a00c-66f45e604056 admin admin] PATH_INFO: `/v3/users/50f15f05439d42a0a5bfadac85552d43` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:57:59.189272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e373ad-993f-4766-a00c-66f45e604056 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50f15f05439d42a0a5bfadac85552d43)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:57:59.192443 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e373ad-993f-4766-a00c-66f45e604056 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:57:59.198527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:57:59.323372 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-87e373ad-993f-4766-a00c-66f45e604056 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50f15f05439d42a0a5bfadac85552d43'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:59.324458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-87e373ad-993f-4766-a00c-66f45e604056 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50f15f05439d42a0a5bfadac85552d43'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:59.325262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-87e373ad-993f-4766-a00c-66f45e604056 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50f15f05439d42a0a5bfadac85552d43'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:59.340326 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-87e373ad-993f-4766-a00c-66f45e604056 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50f15f05439d42a0a5bfadac85552d43'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:59.364299 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-87e373ad-993f-4766-a00c-66f45e604056 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50f15f05439d42a0a5bfadac85552d43'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:57:59.437794 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1161/2323] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:57:58 2022] DELETE /identity/v3/users/50f15f05439d42a0a5bfadac85552d43 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:57:59.866040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6080c3-adb5-41bc-a55f-075b3c6161c1 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:57:59.868003 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-6d6080c3-adb5-41bc-a55f-075b3c6161c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:57:59.892064 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6080c3-adb5-41bc-a55f-075b3c6161c1 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:00.002635 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b09bc25-8a69-431d-a4e9-5456ea5e69a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:00.003327 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09bc25-8a69-431d-a4e9-5456ea5e69a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:00.003608 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09bc25-8a69-431d-a4e9-5456ea5e69a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:00.003878 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09bc25-8a69-431d-a4e9-5456ea5e69a6 admin admin] PATH_INFO: `/v3/projects/d1c8e07cf0cd4aa88d1738bdfaf661c8` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:00.005231 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b09bc25-8a69-431d-a4e9-5456ea5e69a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1c8e07cf0cd4aa88d1738bdfaf661c8)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:00.007231 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b09bc25-8a69-431d-a4e9-5456ea5e69a6 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:00.112932 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-4b09bc25-8a69-431d-a4e9-5456ea5e69a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1c8e07cf0cd4aa88d1738bdfaf661c8', 'request_id': 'req-4b09bc25-8a69-431d-a4e9-5456ea5e69a6'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:00.127860 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-4b09bc25-8a69-431d-a4e9-5456ea5e69a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1c8e07cf0cd4aa88d1738bdfaf661c8', 'request_id': 'req-4b09bc25-8a69-431d-a4e9-5456ea5e69a6'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:00.140076 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-4b09bc25-8a69-431d-a4e9-5456ea5e69a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1c8e07cf0cd4aa88d1738bdfaf661c8', 'request_id': 'req-4b09bc25-8a69-431d-a4e9-5456ea5e69a6'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:00.162201 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-4b09bc25-8a69-431d-a4e9-5456ea5e69a6 admin admin] The token cache is being invalidate because project d1c8e07cf0cd4aa88d1738bdfaf661c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:58:00.162646 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-4b09bc25-8a69-431d-a4e9-5456ea5e69a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:00.164987 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-4b09bc25-8a69-431d-a4e9-5456ea5e69a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:00.173596 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1163/2324] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:57:59 2022] DELETE /identity/v3/projects/d1c8e07cf0cd4aa88d1738bdfaf661c8 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:58:00.175778 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3d217-581d-4b16-8c3b-887c0261dce8 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:00.176303 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3d217-581d-4b16-8c3b-887c0261dce8 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:00.176428 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3d217-581d-4b16-8c3b-887c0261dce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:00.244198 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-b4f3d217-581d-4b16-8c3b-887c0261dce8 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:58:00.245532 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-b4f3d217-581d-4b16-8c3b-887c0261dce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:00.426651 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1162/2325] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:58:00.428296 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229147a-9176-4833-8661-30a2c6571450 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:00.428578 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229147a-9176-4833-8661-30a2c6571450 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:00.428845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229147a-9176-4833-8661-30a2c6571450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:00.483297 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-3229147a-9176-4833-8661-30a2c6571450 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:58:00.491523 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-3229147a-9176-4833-8661-30a2c6571450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:00.500728 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1164/2326] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:58:00.509735 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3d217-581d-4b16-8c3b-887c0261dce8 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:00.527298 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3d217-581d-4b16-8c3b-887c0261dce8 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:00.532906 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892d577-3b17-428e-9d98-24e28f4e320e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:00.534394 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892d577-3b17-428e-9d98-24e28f4e320e admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:00.534677 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892d577-3b17-428e-9d98-24e28f4e320e admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:00.534951 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892d577-3b17-428e-9d98-24e28f4e320e admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:00.538308 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0892d577-3b17-428e-9d98-24e28f4e320e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:58:00.538619 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0892d577-3b17-428e-9d98-24e28f4e320e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:00.542729 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0892d577-3b17-428e-9d98-24e28f4e320e admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:00.569604 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1163/2327] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:58:00.574210 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229147a-9176-4833-8661-30a2c6571450 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:00.597627 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229147a-9176-4833-8661-30a2c6571450 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:00.617513 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81b71c-dd58-4ed7-8dfc-c91c54308f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:00.621390 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81b71c-dd58-4ed7-8dfc-c91c54308f31 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:00.621717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81b71c-dd58-4ed7-8dfc-c91c54308f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:00.621993 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81b71c-dd58-4ed7-8dfc-c91c54308f31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:00.622717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd81b71c-dd58-4ed7-8dfc-c91c54308f31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:00.624709 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd81b71c-dd58-4ed7-8dfc-c91c54308f31 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:00.648675 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7957c05-d73c-42d1-96e6-f40500b3228e None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:00.648963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7957c05-d73c-42d1-96e6-f40500b3228e None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:00.649279 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7957c05-d73c-42d1-96e6-f40500b3228e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:00.676561 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1165/2328] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:58:00 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:58:00.678066 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81b71c-dd58-4ed7-8dfc-c91c54308f31 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:00.692270 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-d7957c05-d73c-42d1-96e6-f40500b3228e None None] MFA Rules not processed for user `5a6bb4b8e4c34a3da9515e12136f1865`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:58:00.694333 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-d7957c05-d73c-42d1-96e6-f40500b3228e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:00.781512 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:00.805161 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1164/2329] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:58:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:58:00.805989 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81b71c-dd58-4ed7-8dfc-c91c54308f31 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:00.818863 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e7331-33c6-46b1-b353-3f51a323bb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:00.819801 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e7331-33c6-46b1-b353-3f51a323bb86 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:00.820307 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e7331-33c6-46b1-b353-3f51a323bb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:00.820785 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e7331-33c6-46b1-b353-3f51a323bb86 admin admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:00.822151 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e7331-33c6-46b1-b353-3f51a323bb86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:00.824333 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e7331-33c6-46b1-b353-3f51a323bb86 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:00.827062 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7957c05-d73c-42d1-96e6-f40500b3228e None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:00.829168 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-d7957c05-d73c-42d1-96e6-f40500b3228e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:00.837659 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:00.871183 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1166/2330] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:58:00 2022] POST /identity/v3/users => generated 287 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:58:00.880649 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e7331-33c6-46b1-b353-3f51a323bb86 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:00.904225 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e7331-33c6-46b1-b353-3f51a323bb86 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:00.909594 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f59cb4-93a0-4c6a-8f34-a097d4184158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:00.910340 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f59cb4-93a0-4c6a-8f34-a097d4184158 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:00.910642 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f59cb4-93a0-4c6a-8f34-a097d4184158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:00.910957 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f59cb4-93a0-4c6a-8f34-a097d4184158 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:00.911628 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f59cb4-93a0-4c6a-8f34-a097d4184158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:00.913389 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f59cb4-93a0-4c6a-8f34-a097d4184158 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:00.939570 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1167/2331] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:58:00.944993 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f59cb4-93a0-4c6a-8f34-a097d4184158 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:00.967418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f59cb4-93a0-4c6a-8f34-a097d4184158 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:00.974071 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf87c4-9af8-4d76-8f6a-e6c951694979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:00.974545 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7957c05-d73c-42d1-96e6-f40500b3228e None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:00.975171 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf87c4-9af8-4d76-8f6a-e6c951694979 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:00.976019 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf87c4-9af8-4d76-8f6a-e6c951694979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:00.976716 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf87c4-9af8-4d76-8f6a-e6c951694979 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:00.978104 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf87c4-9af8-4d76-8f6a-e6c951694979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:00.978993 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b913b4-7702-438d-a768-cba357966548 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab3b7ac09599477bb0c6c1d32e2d5dbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:00.979499 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf87c4-9af8-4d76-8f6a-e6c951694979 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:00.979619 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b913b4-7702-438d-a768-cba357966548 service glance] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:00.979893 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b913b4-7702-438d-a768-cba357966548 service glance] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:00.980183 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b913b4-7702-438d-a768-cba357966548 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:00.983257 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-d7b913b4-7702-438d-a768-cba357966548 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:00.993057 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1168/2332] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:58:00.996924 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf87c4-9af8-4d76-8f6a-e6c951694979 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:01.008418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf87c4-9af8-4d76-8f6a-e6c951694979 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:01.014377 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca2373-34aa-4191-adcd-6cc4f9c8116d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:01.015423 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca2373-34aa-4191-adcd-6cc4f9c8116d admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:01.016163 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca2373-34aa-4191-adcd-6cc4f9c8116d admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:01.016563 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca2373-34aa-4191-adcd-6cc4f9c8116d admin admin] PATH_INFO: `/v3/projects/460468cbaac44e1e90aba9c2e197495e/users/bc2209bbd55e45eb8f384cfa28b2547d/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:01.037257 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca2373-34aa-4191-adcd-6cc4f9c8116d admin admin] RBAC: Authorizing `identity:create_grant(project_id=460468cbaac44e1e90aba9c2e197495e, user_id=bc2209bbd55e45eb8f384cfa28b2547d, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:01.040178 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca2373-34aa-4191-adcd-6cc4f9c8116d admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:01.066578 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1169/2333] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:58:00 2022] PUT /identity/v3/projects/460468cbaac44e1e90aba9c2e197495e/users/bc2209bbd55e45eb8f384cfa28b2547d/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:58:01.070641 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095cae1-9b58-42ef-8c07-8d890049ea3e None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:01.070927 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095cae1-9b58-42ef-8c07-8d890049ea3e None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:01.071339 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b913b4-7702-438d-a768-cba357966548 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:01.071453 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095cae1-9b58-42ef-8c07-8d890049ea3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:01.072789 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b913b4-7702-438d-a768-cba357966548 service glance] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:01.084438 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1165/2334] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:58:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 17:58:01.109879 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-4095cae1-9b58-42ef-8c07-8d890049ea3e None None] MFA Rules not processed for user `bc2209bbd55e45eb8f384cfa28b2547d`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:58:01.111058 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-4095cae1-9b58-42ef-8c07-8d890049ea3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:01.195231 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1170/2335] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:58:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:58:01.197522 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b913b4-7702-438d-a768-cba357966548 service glance] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:01.220095 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b913b4-7702-438d-a768-cba357966548 service glance] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:01.296511 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365e379-3a35-4292-8aea-482c8a62c583 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:01.296852 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365e379-3a35-4292-8aea-482c8a62c583 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:01.297174 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365e379-3a35-4292-8aea-482c8a62c583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:01.303312 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20002f75-09f5-4f73-b187-0080e067af9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:01.304053 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20002f75-09f5-4f73-b187-0080e067af9f admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:01.304448 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20002f75-09f5-4f73-b187-0080e067af9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:01.304794 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20002f75-09f5-4f73-b187-0080e067af9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:01.305509 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20002f75-09f5-4f73-b187-0080e067af9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:01.307533 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20002f75-09f5-4f73-b187-0080e067af9f admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:01.317572 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-3365e379-3a35-4292-8aea-482c8a62c583 None None] MFA Rules not processed for user `8475122232ef4d8893f2a9b98768396e`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:58:01.318803 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-3365e379-3a35-4292-8aea-482c8a62c583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:01.345263 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1166/2336] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:58:01 2022] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:58:01.349201 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20002f75-09f5-4f73-b187-0080e067af9f admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:01.442493 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1171/2337] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Sep 26 17:58:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:58:01.453970 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:01.516619 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20002f75-09f5-4f73-b187-0080e067af9f admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:01.523475 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a990c-1ecf-4b02-b166-f4a1bec2df12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:01.524372 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a990c-1ecf-4b02-b166-f4a1bec2df12 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:01.524651 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a990c-1ecf-4b02-b166-f4a1bec2df12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:01.525131 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a990c-1ecf-4b02-b166-f4a1bec2df12 admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:01.525792 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a990c-1ecf-4b02-b166-f4a1bec2df12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:01.527740 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a990c-1ecf-4b02-b166-f4a1bec2df12 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:01.544442 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365e379-3a35-4292-8aea-482c8a62c583 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:01.546513 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-3365e379-3a35-4292-8aea-482c8a62c583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:01.558580 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1167/2338] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:58:01 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 17:58:01.572086 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a990c-1ecf-4b02-b166-f4a1bec2df12 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:01.585722 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a990c-1ecf-4b02-b166-f4a1bec2df12 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:01.597175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947c993-5b81-4da4-973f-353e58baf504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:01.598353 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947c993-5b81-4da4-973f-353e58baf504 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:01.598641 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947c993-5b81-4da4-973f-353e58baf504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:01.599200 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947c993-5b81-4da4-973f-353e58baf504 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:01.599863 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e947c993-5b81-4da4-973f-353e58baf504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:01.601524 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e947c993-5b81-4da4-973f-353e58baf504 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:01.613901 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1168/2339] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:58:01.625639 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947c993-5b81-4da4-973f-353e58baf504 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:01.650017 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947c993-5b81-4da4-973f-353e58baf504 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:01.652700 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:01.657956 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af03dfa-bda5-43aa-a899-8c85d6a4180a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:01.658980 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af03dfa-bda5-43aa-a899-8c85d6a4180a admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:01.659430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af03dfa-bda5-43aa-a899-8c85d6a4180a admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:01.659861 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af03dfa-bda5-43aa-a899-8c85d6a4180a admin admin] PATH_INFO: `/v3/projects/6146f780e6664c8a93344caa6386047e/users/fc549ccf84094453ba1c2dd3bc881a18/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:01.682613 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af03dfa-bda5-43aa-a899-8c85d6a4180a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6146f780e6664c8a93344caa6386047e, user_id=fc549ccf84094453ba1c2dd3bc881a18, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:01.686892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af03dfa-bda5-43aa-a899-8c85d6a4180a admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:01.710712 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1169/2340] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:58:01 2022] PUT /identity/v3/projects/6146f780e6664c8a93344caa6386047e/users/fc549ccf84094453ba1c2dd3bc881a18/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:58:01.714807 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af03dfa-bda5-43aa-a899-8c85d6a4180a admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:01.716016 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365e379-3a35-4292-8aea-482c8a62c583 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:01.801449 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af03dfa-bda5-43aa-a899-8c85d6a4180a admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:01.802987 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a2098-5048-438e-9154-28275212010b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea49cd9839474232a0cbe66ccffbf082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:01.803740 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a2098-5048-438e-9154-28275212010b service swift] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:01.804231 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a2098-5048-438e-9154-28275212010b service swift] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:01.804569 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a2098-5048-438e-9154-28275212010b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:01.807620 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45dbb52-822f-4543-9748-a52bacad3455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:01.808800 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45dbb52-822f-4543-9748-a52bacad3455 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:01.809327 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45dbb52-822f-4543-9748-a52bacad3455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:01.810605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45dbb52-822f-4543-9748-a52bacad3455 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:01.811706 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45dbb52-822f-4543-9748-a52bacad3455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:01.814032 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45dbb52-822f-4543-9748-a52bacad3455 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:01.833553 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1170/2341] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 17:58:01.841093 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45dbb52-822f-4543-9748-a52bacad3455 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:01.854577 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45dbb52-822f-4543-9748-a52bacad3455 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:01.867581 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db7f4d-2abf-4b89-a6b5-2edb178bd7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:01.868138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db7f4d-2abf-4b89-a6b5-2edb178bd7f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:01.868439 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db7f4d-2abf-4b89-a6b5-2edb178bd7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:01.869624 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db7f4d-2abf-4b89-a6b5-2edb178bd7f9 admin admin] PATH_INFO: `/v3/projects/6146f780e6664c8a93344caa6386047e/users/fc549ccf84094453ba1c2dd3bc881a18/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:01.871888 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db7f4d-2abf-4b89-a6b5-2edb178bd7f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6146f780e6664c8a93344caa6386047e, user_id=fc549ccf84094453ba1c2dd3bc881a18, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:01.878535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db7f4d-2abf-4b89-a6b5-2edb178bd7f9 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:01.904449 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1171/2342] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:58:01 2022] PUT /identity/v3/projects/6146f780e6664c8a93344caa6386047e/users/fc549ccf84094453ba1c2dd3bc881a18/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:58:01.914494 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aac143-6438-46db-9ccf-613ef2cc6009 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:01.916041 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aac143-6438-46db-9ccf-613ef2cc6009 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:01.916619 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aac143-6438-46db-9ccf-613ef2cc6009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:01.927780 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a2098-5048-438e-9154-28275212010b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:01.930589 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a2098-5048-438e-9154-28275212010b service swift] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:01.943763 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1172/2343] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Sep 26 17:58:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 26 17:58:02.031366 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-a7aac143-6438-46db-9ccf-613ef2cc6009 None None] MFA Rules not processed for user `fc549ccf84094453ba1c2dd3bc881a18`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:58:02.032740 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-a7aac143-6438-46db-9ccf-613ef2cc6009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:02.225981 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a2098-5048-438e-9154-28275212010b service swift] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:02.228254 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-be5a2098-5048-438e-9154-28275212010b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:02.265639 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a2098-5048-438e-9154-28275212010b service swift] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:02.289757 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:02.335342 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1172/2344] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:58:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:58:02.345755 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aac143-6438-46db-9ccf-613ef2cc6009 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:02.347665 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-a7aac143-6438-46db-9ccf-613ef2cc6009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:02.451334 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be5612-6f2f-485e-8d18-a53e9c6fb03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:02.451985 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be5612-6f2f-485e-8d18-a53e9c6fb03a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:02.452269 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be5612-6f2f-485e-8d18-a53e9c6fb03a admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:02.452541 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be5612-6f2f-485e-8d18-a53e9c6fb03a admin admin] PATH_INFO: `/v3/users/bf06e56994824fda8e42a37f43282600` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:02.453833 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be5612-6f2f-485e-8d18-a53e9c6fb03a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf06e56994824fda8e42a37f43282600)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:02.455979 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be5612-6f2f-485e-8d18-a53e9c6fb03a admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:02.472877 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aac143-6438-46db-9ccf-613ef2cc6009 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:02.482755 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db1919-435e-4d44-8650-188a24bce159 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:02.482876 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db1919-435e-4d44-8650-188a24bce159 service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:02.483333 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db1919-435e-4d44-8650-188a24bce159 service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:02.484544 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db1919-435e-4d44-8650-188a24bce159 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:02.496472 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:02.534892 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-94be5612-6f2f-485e-8d18-a53e9c6fb03a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf06e56994824fda8e42a37f43282600'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:02.550102 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-94be5612-6f2f-485e-8d18-a53e9c6fb03a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf06e56994824fda8e42a37f43282600'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:02.551925 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-94be5612-6f2f-485e-8d18-a53e9c6fb03a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf06e56994824fda8e42a37f43282600'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:02.553039 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-94be5612-6f2f-485e-8d18-a53e9c6fb03a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf06e56994824fda8e42a37f43282600'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:02.564771 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-94be5612-6f2f-485e-8d18-a53e9c6fb03a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf06e56994824fda8e42a37f43282600'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:02.590834 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db1919-435e-4d44-8650-188a24bce159 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:02.593262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db1919-435e-4d44-8650-188a24bce159 service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:02.599663 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1173/2345] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:58:02 2022] DELETE /identity/v3/users/bf06e56994824fda8e42a37f43282600 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:58:02.605051 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1173/2346] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:58:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 17:58:02.605200 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c753e0b-b4ae-4eef-a3ab-f9ff12d66a90 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:02.605431 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c753e0b-b4ae-4eef-a3ab-f9ff12d66a90 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:02.605753 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c753e0b-b4ae-4eef-a3ab-f9ff12d66a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:02.634860 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-9c753e0b-b4ae-4eef-a3ab-f9ff12d66a90 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:58:02.636493 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-9c753e0b-b4ae-4eef-a3ab-f9ff12d66a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:02.717530 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1174/2347] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:58:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:58:02.727927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db1919-435e-4d44-8650-188a24bce159 service cinder] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:02.729370 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-13db1919-435e-4d44-8650-188a24bce159 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:02.797161 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db1919-435e-4d44-8650-188a24bce159 service cinder] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:02.865040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18ea7c-9cdd-4434-940f-9b7a3d0f25f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:02.866274 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18ea7c-9cdd-4434-940f-9b7a3d0f25f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:02.866575 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18ea7c-9cdd-4434-940f-9b7a3d0f25f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:02.867002 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18ea7c-9cdd-4434-940f-9b7a3d0f25f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:02.896780 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18ea7c-9cdd-4434-940f-9b7a3d0f25f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:02.896780 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18ea7c-9cdd-4434-940f-9b7a3d0f25f9 service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:02.933458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1174/2348] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:58:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:58:03.474209 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c753e0b-b4ae-4eef-a3ab-f9ff12d66a90 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:03.476340 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-9c753e0b-b4ae-4eef-a3ab-f9ff12d66a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:03.528582 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c753e0b-b4ae-4eef-a3ab-f9ff12d66a90 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:03.539804 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5179d03-ac73-45c1-842e-9215d6aeb8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:03.541213 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5179d03-ac73-45c1-842e-9215d6aeb8dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:03.541679 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5179d03-ac73-45c1-842e-9215d6aeb8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:03.542149 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5179d03-ac73-45c1-842e-9215d6aeb8dc admin admin] PATH_INFO: `/v3/projects/0c43bc6156044684933b5646d7e4a060` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:03.543502 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5179d03-ac73-45c1-842e-9215d6aeb8dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c43bc6156044684933b5646d7e4a060)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:03.546862 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5179d03-ac73-45c1-842e-9215d6aeb8dc admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:03.632780 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-f5179d03-ac73-45c1-842e-9215d6aeb8dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c43bc6156044684933b5646d7e4a060', 'request_id': 'req-f5179d03-ac73-45c1-842e-9215d6aeb8dc'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:03.639809 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-f5179d03-ac73-45c1-842e-9215d6aeb8dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c43bc6156044684933b5646d7e4a060', 'request_id': 'req-f5179d03-ac73-45c1-842e-9215d6aeb8dc'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:03.652961 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-f5179d03-ac73-45c1-842e-9215d6aeb8dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c43bc6156044684933b5646d7e4a060', 'request_id': 'req-f5179d03-ac73-45c1-842e-9215d6aeb8dc'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:03.690080 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-f5179d03-ac73-45c1-842e-9215d6aeb8dc admin admin] The token cache is being invalidate because project 0c43bc6156044684933b5646d7e4a060 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:58:03.690434 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-f5179d03-ac73-45c1-842e-9215d6aeb8dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:03.691162 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-f5179d03-ac73-45c1-842e-9215d6aeb8dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:03.699792 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1175/2349] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:58:03 2022] DELETE /identity/v3/projects/0c43bc6156044684933b5646d7e4a060 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:58:03.701109 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18ea7c-9cdd-4434-940f-9b7a3d0f25f9 service neutron] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:03.714892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18ea7c-9cdd-4434-940f-9b7a3d0f25f9 service neutron] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:03.721267 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:03.842650 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98279911-18f4-4e28-b6a2-4d0e8c44578d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:03.843380 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98279911-18f4-4e28-b6a2-4d0e8c44578d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:03.843671 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98279911-18f4-4e28-b6a2-4d0e8c44578d admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:03.843948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98279911-18f4-4e28-b6a2-4d0e8c44578d admin admin] PATH_INFO: `/v3/users/f3a8402359684460824a3015eaa2d8c2` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:03.846996 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98279911-18f4-4e28-b6a2-4d0e8c44578d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3a8402359684460824a3015eaa2d8c2)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:03.854986 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98279911-18f4-4e28-b6a2-4d0e8c44578d admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:03.976220 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-98279911-18f4-4e28-b6a2-4d0e8c44578d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3a8402359684460824a3015eaa2d8c2'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:03.977512 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-98279911-18f4-4e28-b6a2-4d0e8c44578d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3a8402359684460824a3015eaa2d8c2'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:03.980068 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-98279911-18f4-4e28-b6a2-4d0e8c44578d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3a8402359684460824a3015eaa2d8c2'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:03.987580 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-98279911-18f4-4e28-b6a2-4d0e8c44578d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3a8402359684460824a3015eaa2d8c2'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:04.005606 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-98279911-18f4-4e28-b6a2-4d0e8c44578d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3a8402359684460824a3015eaa2d8c2'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:04.051980 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1175/2350] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:58:03 2022] DELETE /identity/v3/users/f3a8402359684460824a3015eaa2d8c2 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:58:04.605648 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5179d03-ac73-45c1-842e-9215d6aeb8dc admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:04.608018 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-f5179d03-ac73-45c1-842e-9215d6aeb8dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:04.662248 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5179d03-ac73-45c1-842e-9215d6aeb8dc admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:04.728017 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:04.824525 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c188b-a2a4-4024-b5d8-2bd7740bc61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:04.825206 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c188b-a2a4-4024-b5d8-2bd7740bc61a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:04.826009 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c188b-a2a4-4024-b5d8-2bd7740bc61a admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:04.826283 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c188b-a2a4-4024-b5d8-2bd7740bc61a admin admin] PATH_INFO: `/v3/projects/c997236ea1564cba8cf42997714a09fd` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:04.827462 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c188b-a2a4-4024-b5d8-2bd7740bc61a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c997236ea1564cba8cf42997714a09fd)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:04.829514 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c188b-a2a4-4024-b5d8-2bd7740bc61a admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:04.962962 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-c51c188b-a2a4-4024-b5d8-2bd7740bc61a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c997236ea1564cba8cf42997714a09fd', 'request_id': 'req-c51c188b-a2a4-4024-b5d8-2bd7740bc61a'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:04.981755 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-c51c188b-a2a4-4024-b5d8-2bd7740bc61a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c997236ea1564cba8cf42997714a09fd', 'request_id': 'req-c51c188b-a2a4-4024-b5d8-2bd7740bc61a'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:04.996049 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-c51c188b-a2a4-4024-b5d8-2bd7740bc61a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c997236ea1564cba8cf42997714a09fd', 'request_id': 'req-c51c188b-a2a4-4024-b5d8-2bd7740bc61a'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:05.039990 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-c51c188b-a2a4-4024-b5d8-2bd7740bc61a admin admin] The token cache is being invalidate because project c997236ea1564cba8cf42997714a09fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:58:05.040289 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-c51c188b-a2a4-4024-b5d8-2bd7740bc61a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:05.043094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-c51c188b-a2a4-4024-b5d8-2bd7740bc61a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:05.054231 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1176/2351] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:58:04 2022] DELETE /identity/v3/projects/c997236ea1564cba8cf42997714a09fd => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:58:05.058297 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98279911-18f4-4e28-b6a2-4d0e8c44578d admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:05.059957 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-98279911-18f4-4e28-b6a2-4d0e8c44578d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:05.092927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98279911-18f4-4e28-b6a2-4d0e8c44578d admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:05.342812 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee99f1d-6b6a-4035-8556-57bb1d804994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:05.343606 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee99f1d-6b6a-4035-8556-57bb1d804994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:05.344171 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee99f1d-6b6a-4035-8556-57bb1d804994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:05.344651 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee99f1d-6b6a-4035-8556-57bb1d804994 admin admin] PATH_INFO: `/v3/users/6508bdbfb3704ab68b981ee5f0710b4e` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:05.359177 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee99f1d-6b6a-4035-8556-57bb1d804994 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6508bdbfb3704ab68b981ee5f0710b4e)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:05.381609 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee99f1d-6b6a-4035-8556-57bb1d804994 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:05.503908 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:05.561153 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-3ee99f1d-6b6a-4035-8556-57bb1d804994 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6508bdbfb3704ab68b981ee5f0710b4e'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:05.564009 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-3ee99f1d-6b6a-4035-8556-57bb1d804994 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6508bdbfb3704ab68b981ee5f0710b4e'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:05.566284 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-3ee99f1d-6b6a-4035-8556-57bb1d804994 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6508bdbfb3704ab68b981ee5f0710b4e'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:05.595244 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-3ee99f1d-6b6a-4035-8556-57bb1d804994 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6508bdbfb3704ab68b981ee5f0710b4e'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:05.630513 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-3ee99f1d-6b6a-4035-8556-57bb1d804994 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6508bdbfb3704ab68b981ee5f0710b4e'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:05.699475 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1176/2352] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:58:05 2022] DELETE /identity/v3/users/6508bdbfb3704ab68b981ee5f0710b4e => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:58:06.705511 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c188b-a2a4-4024-b5d8-2bd7740bc61a admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:06.706932 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-c51c188b-a2a4-4024-b5d8-2bd7740bc61a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:06.747990 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c188b-a2a4-4024-b5d8-2bd7740bc61a admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:06.867334 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0fee06-1cc4-4c16-aeda-a75f67f5c3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:06.868398 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fee06-1cc4-4c16-aeda-a75f67f5c3c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:06.868841 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fee06-1cc4-4c16-aeda-a75f67f5c3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:06.869302 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fee06-1cc4-4c16-aeda-a75f67f5c3c3 admin admin] PATH_INFO: `/v3/projects/1dea718df3644392855a55f46570c571` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:06.870607 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0fee06-1cc4-4c16-aeda-a75f67f5c3c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dea718df3644392855a55f46570c571)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:06.872855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0fee06-1cc4-4c16-aeda-a75f67f5c3c3 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:06.959603 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-8c0fee06-1cc4-4c16-aeda-a75f67f5c3c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dea718df3644392855a55f46570c571', 'request_id': 'req-8c0fee06-1cc4-4c16-aeda-a75f67f5c3c3'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:06.983138 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-8c0fee06-1cc4-4c16-aeda-a75f67f5c3c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dea718df3644392855a55f46570c571', 'request_id': 'req-8c0fee06-1cc4-4c16-aeda-a75f67f5c3c3'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:06.990789 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:07.006974 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-8c0fee06-1cc4-4c16-aeda-a75f67f5c3c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dea718df3644392855a55f46570c571', 'request_id': 'req-8c0fee06-1cc4-4c16-aeda-a75f67f5c3c3'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:07.008401 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee99f1d-6b6a-4035-8556-57bb1d804994 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:07.010049 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-3ee99f1d-6b6a-4035-8556-57bb1d804994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:07.027630 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-8c0fee06-1cc4-4c16-aeda-a75f67f5c3c3 admin admin] The token cache is being invalidate because project 1dea718df3644392855a55f46570c571 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:58:07.027935 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-8c0fee06-1cc4-4c16-aeda-a75f67f5c3c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:07.035996 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-8c0fee06-1cc4-4c16-aeda-a75f67f5c3c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:07.036313 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee99f1d-6b6a-4035-8556-57bb1d804994 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:07.038507 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1177/2353] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:58:06 2022] DELETE /identity/v3/projects/1dea718df3644392855a55f46570c571 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:58:07.043605 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6f4e2-7988-4edc-b92f-0700236c754f None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:07.043898 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6f4e2-7988-4edc-b92f-0700236c754f None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:07.044177 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6f4e2-7988-4edc-b92f-0700236c754f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:07.068897 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-44e6f4e2-7988-4edc-b92f-0700236c754f None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:58:07.070191 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-44e6f4e2-7988-4edc-b92f-0700236c754f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:07.177814 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b389e6-86a9-4a27-971b-a98c3657e4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:07.180327 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b389e6-86a9-4a27-971b-a98c3657e4e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:07.180656 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b389e6-86a9-4a27-971b-a98c3657e4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:07.180941 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b389e6-86a9-4a27-971b-a98c3657e4e6 admin admin] PATH_INFO: `/v3/users/bc2209bbd55e45eb8f384cfa28b2547d` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:07.182995 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b389e6-86a9-4a27-971b-a98c3657e4e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc2209bbd55e45eb8f384cfa28b2547d)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:07.185001 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b389e6-86a9-4a27-971b-a98c3657e4e6 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:07.206216 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1178/2354] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:58:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:58:07.213423 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dcce8-1308-4548-bf46-a27e3eb906ac None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:07.214395 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dcce8-1308-4548-bf46-a27e3eb906ac None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:07.214907 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dcce8-1308-4548-bf46-a27e3eb906ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:07.278276 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-ba9dcce8-1308-4548-bf46-a27e3eb906ac None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:58:07.280199 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-ba9dcce8-1308-4548-bf46-a27e3eb906ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:07.297840 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-27b389e6-86a9-4a27-971b-a98c3657e4e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc2209bbd55e45eb8f384cfa28b2547d'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:07.299097 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-27b389e6-86a9-4a27-971b-a98c3657e4e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc2209bbd55e45eb8f384cfa28b2547d'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:07.301247 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-27b389e6-86a9-4a27-971b-a98c3657e4e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc2209bbd55e45eb8f384cfa28b2547d'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:07.307938 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1179/2355] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:58:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:58:07.308814 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9dcce8-1308-4548-bf46-a27e3eb906ac None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:07.328706 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-27b389e6-86a9-4a27-971b-a98c3657e4e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc2209bbd55e45eb8f384cfa28b2547d'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:07.337669 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9dcce8-1308-4548-bf46-a27e3eb906ac None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:07.344681 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-27b389e6-86a9-4a27-971b-a98c3657e4e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc2209bbd55e45eb8f384cfa28b2547d'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:07.353186 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14bceda-4b82-41c1-8228-406c90c3518a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:07.354347 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bceda-4b82-41c1-8228-406c90c3518a admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:07.354856 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bceda-4b82-41c1-8228-406c90c3518a admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:07.355417 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bceda-4b82-41c1-8228-406c90c3518a admin admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:07.356385 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14bceda-4b82-41c1-8228-406c90c3518a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:58:07.357051 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14bceda-4b82-41c1-8228-406c90c3518a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:07.359322 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14bceda-4b82-41c1-8228-406c90c3518a admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:07.395841 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1177/2356] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:58:07 2022] DELETE /identity/v3/users/bc2209bbd55e45eb8f384cfa28b2547d => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:58:07.400141 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14834073-1738-4df3-ac25-867326b5cbcd None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:07.400499 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14834073-1738-4df3-ac25-867326b5cbcd None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:07.400832 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14834073-1738-4df3-ac25-867326b5cbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:07.401031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1180/2357] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:58:07.405839 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14bceda-4b82-41c1-8228-406c90c3518a admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:07.407555 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-f14bceda-4b82-41c1-8228-406c90c3518a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:07.425362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14bceda-4b82-41c1-8228-406c90c3518a admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:07.453043 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-14834073-1738-4df3-ac25-867326b5cbcd None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:58:07.455657 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-14834073-1738-4df3-ac25-867326b5cbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:07.518691 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:07.585716 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1178/2358] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:58:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:58:07.608614 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16cfeb3-da13-43a0-88a8-b77dfad3faa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:07.609427 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16cfeb3-da13-43a0-88a8-b77dfad3faa9 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:07.609711 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16cfeb3-da13-43a0-88a8-b77dfad3faa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:07.609988 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16cfeb3-da13-43a0-88a8-b77dfad3faa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:07.610102 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14834073-1738-4df3-ac25-867326b5cbcd None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:07.610633 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16cfeb3-da13-43a0-88a8-b77dfad3faa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:07.612685 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-14834073-1738-4df3-ac25-867326b5cbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:07.613283 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16cfeb3-da13-43a0-88a8-b77dfad3faa9 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:07.710164 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1181/2359] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:58:07 2022] POST /identity/v3/projects => generated 371 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 17:58:07.718539 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16cfeb3-da13-43a0-88a8-b77dfad3faa9 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:07.731050 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14834073-1738-4df3-ac25-867326b5cbcd None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:07.816950 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:07.868407 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62685c5e-f933-4d9a-97f5-771a06193ab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:07.869443 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62685c5e-f933-4d9a-97f5-771a06193ab9 service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:07.869928 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62685c5e-f933-4d9a-97f5-771a06193ab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:07.870387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62685c5e-f933-4d9a-97f5-771a06193ab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:07.882146 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16cfeb3-da13-43a0-88a8-b77dfad3faa9 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:07.901710 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62685c5e-f933-4d9a-97f5-771a06193ab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:07.902913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62685c5e-f933-4d9a-97f5-771a06193ab9 service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:07.914068 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1179/2360] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:58:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:58:07.930551 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc54ef-a48a-4850-8542-b83d9b176658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:07.931189 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc54ef-a48a-4850-8542-b83d9b176658 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:07.931468 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc54ef-a48a-4850-8542-b83d9b176658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:07.931741 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc54ef-a48a-4850-8542-b83d9b176658 admin admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:07.932379 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc54ef-a48a-4850-8542-b83d9b176658 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:07.938369 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc54ef-a48a-4850-8542-b83d9b176658 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:08.003206 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1182/2361] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:58:07 2022] POST /identity/v3/users => generated 286 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:58:08.007476 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62685c5e-f933-4d9a-97f5-771a06193ab9 service neutron] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:08.022433 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62685c5e-f933-4d9a-97f5-771a06193ab9 service neutron] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:08.031524 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd007f-93d4-4725-8f2b-ae52b253eee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:08.032151 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd007f-93d4-4725-8f2b-ae52b253eee5 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:08.032426 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd007f-93d4-4725-8f2b-ae52b253eee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:08.032694 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd007f-93d4-4725-8f2b-ae52b253eee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:08.033448 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd007f-93d4-4725-8f2b-ae52b253eee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:08.042322 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd007f-93d4-4725-8f2b-ae52b253eee5 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:08.054356 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1180/2362] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:58:08.058652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc54ef-a48a-4850-8542-b83d9b176658 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:08.078260 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc54ef-a48a-4850-8542-b83d9b176658 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:08.099207 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df90be6-9c6d-4c0d-b3b7-a9376f9485a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:08.101705 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df90be6-9c6d-4c0d-b3b7-a9376f9485a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:08.104329 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df90be6-9c6d-4c0d-b3b7-a9376f9485a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:08.105748 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df90be6-9c6d-4c0d-b3b7-a9376f9485a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:08.109390 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df90be6-9c6d-4c0d-b3b7-a9376f9485a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:08.113623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df90be6-9c6d-4c0d-b3b7-a9376f9485a9 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:08.156725 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1183/2363] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 17:58:08.157882 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd007f-93d4-4725-8f2b-ae52b253eee5 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:08.190251 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd007f-93d4-4725-8f2b-ae52b253eee5 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:08.197512 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585cfc7-c755-4f9d-a786-c718a3fb44ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:08.198689 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585cfc7-c755-4f9d-a786-c718a3fb44ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:08.198973 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585cfc7-c755-4f9d-a786-c718a3fb44ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:08.199249 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585cfc7-c755-4f9d-a786-c718a3fb44ea admin admin] PATH_INFO: `/v3/projects/2cd367f6def140438e181a2b0cf6a1cd/users/9d3e0a3393ed472abe3b4c621ecc41d4/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:08.236002 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585cfc7-c755-4f9d-a786-c718a3fb44ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cd367f6def140438e181a2b0cf6a1cd, user_id=9d3e0a3393ed472abe3b4c621ecc41d4, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:08.239596 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585cfc7-c755-4f9d-a786-c718a3fb44ea admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:08.273037 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1181/2364] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:58:08 2022] PUT /identity/v3/projects/2cd367f6def140438e181a2b0cf6a1cd/users/9d3e0a3393ed472abe3b4c621ecc41d4/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 17:58:08.274412 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77295fec-8742-4954-81c2-4cbd6b45b80c None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:08.274746 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77295fec-8742-4954-81c2-4cbd6b45b80c None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:08.275008 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77295fec-8742-4954-81c2-4cbd6b45b80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:08.295808 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-77295fec-8742-4954-81c2-4cbd6b45b80c None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:58:08.297331 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-77295fec-8742-4954-81c2-4cbd6b45b80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:08.374352 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1184/2365] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:58:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:58:08.387667 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585cfc7-c755-4f9d-a786-c718a3fb44ea admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:08.441113 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77295fec-8742-4954-81c2-4cbd6b45b80c None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:08.446042 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-77295fec-8742-4954-81c2-4cbd6b45b80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:08.466292 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77295fec-8742-4954-81c2-4cbd6b45b80c None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:08.485405 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831bdb6-e6a9-4137-9829-de25f163db62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:08.486073 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831bdb6-e6a9-4137-9829-de25f163db62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:08.486356 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831bdb6-e6a9-4137-9829-de25f163db62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:08.486633 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831bdb6-e6a9-4137-9829-de25f163db62 admin admin] PATH_INFO: `/v3/projects/460468cbaac44e1e90aba9c2e197495e` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:08.491498 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831bdb6-e6a9-4137-9829-de25f163db62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=460468cbaac44e1e90aba9c2e197495e)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:08.493294 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831bdb6-e6a9-4137-9829-de25f163db62 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:08.554083 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585cfc7-c755-4f9d-a786-c718a3fb44ea admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:08.562612 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:08.582649 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-0831bdb6-e6a9-4137-9829-de25f163db62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '460468cbaac44e1e90aba9c2e197495e', 'request_id': 'req-0831bdb6-e6a9-4137-9829-de25f163db62'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:08.594449 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-0831bdb6-e6a9-4137-9829-de25f163db62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '460468cbaac44e1e90aba9c2e197495e', 'request_id': 'req-0831bdb6-e6a9-4137-9829-de25f163db62'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:08.611564 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-0831bdb6-e6a9-4137-9829-de25f163db62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '460468cbaac44e1e90aba9c2e197495e', 'request_id': 'req-0831bdb6-e6a9-4137-9829-de25f163db62'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:08.643012 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-0831bdb6-e6a9-4137-9829-de25f163db62 admin admin] The token cache is being invalidate because project 460468cbaac44e1e90aba9c2e197495e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:58:08.644540 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-0831bdb6-e6a9-4137-9829-de25f163db62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:08.645463 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-0831bdb6-e6a9-4137-9829-de25f163db62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:08.647189 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1185/2366] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:58:08 2022] DELETE /identity/v3/projects/460468cbaac44e1e90aba9c2e197495e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:58:08.651082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831bdb6-e6a9-4137-9829-de25f163db62 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:08.652981 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-0831bdb6-e6a9-4137-9829-de25f163db62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:08.674808 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9b968-1f4f-48f3-a60a-9aacb7175f48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:08.675480 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9b968-1f4f-48f3-a60a-9aacb7175f48 service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:08.675764 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9b968-1f4f-48f3-a60a-9aacb7175f48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:08.676034 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9b968-1f4f-48f3-a60a-9aacb7175f48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:08.677946 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-69d9b968-1f4f-48f3-a60a-9aacb7175f48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:08.730165 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:08.737932 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831bdb6-e6a9-4137-9829-de25f163db62 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:08.744228 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991d0ae-4a27-4032-a8f0-3235f7683246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:08.744988 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991d0ae-4a27-4032-a8f0-3235f7683246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:08.745381 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991d0ae-4a27-4032-a8f0-3235f7683246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:08.745732 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991d0ae-4a27-4032-a8f0-3235f7683246 admin admin] PATH_INFO: `/v3/users/fc549ccf84094453ba1c2dd3bc881a18` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:08.747143 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991d0ae-4a27-4032-a8f0-3235f7683246 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc549ccf84094453ba1c2dd3bc881a18)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:08.750024 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991d0ae-4a27-4032-a8f0-3235f7683246 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:08.785595 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d9b968-1f4f-48f3-a60a-9aacb7175f48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:08.788294 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d9b968-1f4f-48f3-a60a-9aacb7175f48 service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:08.804549 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1182/2367] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:58:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:58:08.811251 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-d991d0ae-4a27-4032-a8f0-3235f7683246 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc549ccf84094453ba1c2dd3bc881a18'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:08.821673 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-d991d0ae-4a27-4032-a8f0-3235f7683246 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc549ccf84094453ba1c2dd3bc881a18'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:08.822900 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-d991d0ae-4a27-4032-a8f0-3235f7683246 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc549ccf84094453ba1c2dd3bc881a18'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:08.823700 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-d991d0ae-4a27-4032-a8f0-3235f7683246 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc549ccf84094453ba1c2dd3bc881a18'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:08.842260 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-d991d0ae-4a27-4032-a8f0-3235f7683246 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc549ccf84094453ba1c2dd3bc881a18'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:08.874051 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1186/2368] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:58:08 2022] DELETE /identity/v3/users/fc549ccf84094453ba1c2dd3bc881a18 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:58:09.451349 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9b968-1f4f-48f3-a60a-9aacb7175f48 service neutron] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:09.461761 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9b968-1f4f-48f3-a60a-9aacb7175f48 service neutron] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:09.540837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469bb97-5c72-4894-9d18-3229738e1b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:09.541365 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469bb97-5c72-4894-9d18-3229738e1b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:09.541643 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469bb97-5c72-4894-9d18-3229738e1b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:09.541906 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469bb97-5c72-4894-9d18-3229738e1b5a admin admin] PATH_INFO: `/v3/projects/6146f780e6664c8a93344caa6386047e` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:09.543075 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1469bb97-5c72-4894-9d18-3229738e1b5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6146f780e6664c8a93344caa6386047e)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:09.546447 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1469bb97-5c72-4894-9d18-3229738e1b5a admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:09.627325 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-1469bb97-5c72-4894-9d18-3229738e1b5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6146f780e6664c8a93344caa6386047e', 'request_id': 'req-1469bb97-5c72-4894-9d18-3229738e1b5a'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:09.636007 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-1469bb97-5c72-4894-9d18-3229738e1b5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6146f780e6664c8a93344caa6386047e', 'request_id': 'req-1469bb97-5c72-4894-9d18-3229738e1b5a'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:09.638280 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:09.649699 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-1469bb97-5c72-4894-9d18-3229738e1b5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6146f780e6664c8a93344caa6386047e', 'request_id': 'req-1469bb97-5c72-4894-9d18-3229738e1b5a'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:09.667576 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-1469bb97-5c72-4894-9d18-3229738e1b5a admin admin] The token cache is being invalidate because project 6146f780e6664c8a93344caa6386047e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:58:09.668296 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-1469bb97-5c72-4894-9d18-3229738e1b5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:09.670324 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-1469bb97-5c72-4894-9d18-3229738e1b5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:09.673922 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1183/2369] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:58:09 2022] DELETE /identity/v3/projects/6146f780e6664c8a93344caa6386047e => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:58:09.681149 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bfdb7-219e-47e9-a071-0821f964f8b3 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:09.681716 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bfdb7-219e-47e9-a071-0821f964f8b3 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:09.682238 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bfdb7-219e-47e9-a071-0821f964f8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:09.711479 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-978bfdb7-219e-47e9-a071-0821f964f8b3 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:58:09.720539 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-978bfdb7-219e-47e9-a071-0821f964f8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:09.827604 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1187/2370] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:58:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:58:09.836047 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208573cf-c101-4c05-95f0-690e30eb2429 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:09.836364 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208573cf-c101-4c05-95f0-690e30eb2429 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:09.836643 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208573cf-c101-4c05-95f0-690e30eb2429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:09.859029 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-208573cf-c101-4c05-95f0-690e30eb2429 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:58:09.860482 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-208573cf-c101-4c05-95f0-690e30eb2429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:09.873278 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1184/2371] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:58:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:58:09.878151 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bfdb7-219e-47e9-a071-0821f964f8b3 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:09.888717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bfdb7-219e-47e9-a071-0821f964f8b3 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:09.895057 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d7934-1b4a-496f-b5e0-5671ea1c49b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:09.895679 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d7934-1b4a-496f-b5e0-5671ea1c49b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:09.895958 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d7934-1b4a-496f-b5e0-5671ea1c49b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:09.896232 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d7934-1b4a-496f-b5e0-5671ea1c49b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:09.896899 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d7934-1b4a-496f-b5e0-5671ea1c49b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:58:09.897224 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d7934-1b4a-496f-b5e0-5671ea1c49b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:09.899005 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d7934-1b4a-496f-b5e0-5671ea1c49b0 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:09.915600 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1188/2372] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:58:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:58:09.916823 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208573cf-c101-4c05-95f0-690e30eb2429 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:09.927738 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208573cf-c101-4c05-95f0-690e30eb2429 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:09.933663 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5572fa-8e51-4a6d-bcbf-e451f104be43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:09.934292 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5572fa-8e51-4a6d-bcbf-e451f104be43 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:09.934573 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5572fa-8e51-4a6d-bcbf-e451f104be43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:09.934846 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5572fa-8e51-4a6d-bcbf-e451f104be43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:09.936181 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5572fa-8e51-4a6d-bcbf-e451f104be43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:09.938412 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5572fa-8e51-4a6d-bcbf-e451f104be43 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:10.005666 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1185/2373] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:58:09 2022] POST /identity/v3/projects => generated 365 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:58:10.009840 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d7934-1b4a-496f-b5e0-5671ea1c49b0 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:10.024119 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d7934-1b4a-496f-b5e0-5671ea1c49b0 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:10.093787 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716b788-814b-4f3c-be0a-f624d758e8f8 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:10.094131 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716b788-814b-4f3c-be0a-f624d758e8f8 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:10.094340 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716b788-814b-4f3c-be0a-f624d758e8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:10.144271 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-0716b788-814b-4f3c-be0a-f624d758e8f8 None None] MFA Rules not processed for user `9d3e0a3393ed472abe3b4c621ecc41d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:58:10.145699 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-0716b788-814b-4f3c-be0a-f624d758e8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:10.201165 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09874d6-0382-424c-923f-6d9f32140359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:10.208957 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09874d6-0382-424c-923f-6d9f32140359 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:10.209413 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09874d6-0382-424c-923f-6d9f32140359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:10.209808 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09874d6-0382-424c-923f-6d9f32140359 admin admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:10.214605 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09874d6-0382-424c-923f-6d9f32140359 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:10.221186 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09874d6-0382-424c-923f-6d9f32140359 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:10.252197 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:10.272280 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1186/2374] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:58:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:58:10.283740 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716b788-814b-4f3c-be0a-f624d758e8f8 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:10.287791 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1189/2375] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:58:10 2022] POST /identity/v3/users => generated 283 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:58:10.288750 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-0716b788-814b-4f3c-be0a-f624d758e8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:10.289124 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09874d6-0382-424c-923f-6d9f32140359 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:10.303950 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09874d6-0382-424c-923f-6d9f32140359 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:10.317085 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b9954-1f17-4d14-8acb-f56b7e793c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:10.319249 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b9954-1f17-4d14-8acb-f56b7e793c01 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:10.319548 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b9954-1f17-4d14-8acb-f56b7e793c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:10.320316 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b9954-1f17-4d14-8acb-f56b7e793c01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:10.322576 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b9954-1f17-4d14-8acb-f56b7e793c01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:10.324268 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b9954-1f17-4d14-8acb-f56b7e793c01 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:10.345776 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1190/2376] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:58:10.352116 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b9954-1f17-4d14-8acb-f56b7e793c01 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:10.381036 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b9954-1f17-4d14-8acb-f56b7e793c01 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:10.399197 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b3b95-91a7-47e6-8cb3-3e4bcbe24a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:10.399834 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b3b95-91a7-47e6-8cb3-3e4bcbe24a40 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:10.400116 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b3b95-91a7-47e6-8cb3-3e4bcbe24a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:10.400659 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b3b95-91a7-47e6-8cb3-3e4bcbe24a40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:10.402285 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b3b95-91a7-47e6-8cb3-3e4bcbe24a40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:10.405297 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b3b95-91a7-47e6-8cb3-3e4bcbe24a40 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:10.422023 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716b788-814b-4f3c-be0a-f624d758e8f8 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:10.429614 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee2b31-815c-40c1-b81f-ce488342783c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:10.430311 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee2b31-815c-40c1-b81f-ce488342783c service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:10.430772 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee2b31-815c-40c1-b81f-ce488342783c service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:10.431653 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee2b31-815c-40c1-b81f-ce488342783c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:10.443291 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1191/2377] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:58:10.446744 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b3b95-91a7-47e6-8cb3-3e4bcbe24a40 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:10.448024 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee2b31-815c-40c1-b81f-ce488342783c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:10.449634 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee2b31-815c-40c1-b81f-ce488342783c service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:10.471493 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b3b95-91a7-47e6-8cb3-3e4bcbe24a40 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:10.477463 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79fb16-f3d7-4ec9-8df5-476ead34dd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:10.478301 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79fb16-f3d7-4ec9-8df5-476ead34dd60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:10.478661 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79fb16-f3d7-4ec9-8df5-476ead34dd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:10.479003 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79fb16-f3d7-4ec9-8df5-476ead34dd60 admin admin] PATH_INFO: `/v3/projects/98483419e13c4e06b8911ebcea45d8a8/users/15e3f199841249228cb2a8dc9fa4b79c/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:10.481706 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1187/2378] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:58:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:58:10.505294 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79fb16-f3d7-4ec9-8df5-476ead34dd60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98483419e13c4e06b8911ebcea45d8a8, user_id=15e3f199841249228cb2a8dc9fa4b79c, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:10.508246 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79fb16-f3d7-4ec9-8df5-476ead34dd60 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:10.526208 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1192/2379] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:58:10 2022] PUT /identity/v3/projects/98483419e13c4e06b8911ebcea45d8a8/users/15e3f199841249228cb2a8dc9fa4b79c/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:58:10.540986 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc2858-cb8d-4fd6-937f-a4c277daa60d None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:10.541344 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc2858-cb8d-4fd6-937f-a4c277daa60d None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:10.541571 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc2858-cb8d-4fd6-937f-a4c277daa60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:10.579231 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-f2dc2858-cb8d-4fd6-937f-a4c277daa60d None None] MFA Rules not processed for user `15e3f199841249228cb2a8dc9fa4b79c`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:58:10.580462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-f2dc2858-cb8d-4fd6-937f-a4c277daa60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:10.644394 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:10.693041 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1188/2380] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:58:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:58:10.719632 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79fb16-f3d7-4ec9-8df5-476ead34dd60 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:10.721644 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-1a79fb16-f3d7-4ec9-8df5-476ead34dd60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:10.816032 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79fb16-f3d7-4ec9-8df5-476ead34dd60 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:10.820712 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa6ddce-94ad-4ffe-8525-1a585cf02041 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:10.821917 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6ddce-94ad-4ffe-8525-1a585cf02041 service cinder] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:10.822387 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6ddce-94ad-4ffe-8525-1a585cf02041 service cinder] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:10.822918 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6ddce-94ad-4ffe-8525-1a585cf02041 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:10.835988 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa6ddce-94ad-4ffe-8525-1a585cf02041 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:10.838440 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa6ddce-94ad-4ffe-8525-1a585cf02041 service cinder] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:10.857711 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1193/2381] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:58:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:58:12.177088 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c9c59-fc42-46c6-ad80-1ee61abd4ef4 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:12.177703 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c9c59-fc42-46c6-ad80-1ee61abd4ef4 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:12.184769 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c9c59-fc42-46c6-ad80-1ee61abd4ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:12.209569 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-dd9c9c59-fc42-46c6-ad80-1ee61abd4ef4 None None] MFA Rules not processed for user `9d3e0a3393ed472abe3b4c621ecc41d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:58:12.210842 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-dd9c9c59-fc42-46c6-ad80-1ee61abd4ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:12.220220 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa6ddce-94ad-4ffe-8525-1a585cf02041 service cinder] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:12.222183 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-caa6ddce-94ad-4ffe-8525-1a585cf02041 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:12.298138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1189/2382] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:58:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:58:12.318214 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa6ddce-94ad-4ffe-8525-1a585cf02041 service cinder] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:12.323684 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74c0f6-1753-4a86-9ec6-32dbfde79d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:12.324660 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74c0f6-1753-4a86-9ec6-32dbfde79d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:12.325030 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74c0f6-1753-4a86-9ec6-32dbfde79d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:12.325485 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74c0f6-1753-4a86-9ec6-32dbfde79d68 admin admin] PATH_INFO: `/v3/users/30f57cff2e48404a945d15cc12876fb6` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:12.327281 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc74c0f6-1753-4a86-9ec6-32dbfde79d68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30f57cff2e48404a945d15cc12876fb6)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:12.329496 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc74c0f6-1753-4a86-9ec6-32dbfde79d68 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:12.412015 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-dc74c0f6-1753-4a86-9ec6-32dbfde79d68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30f57cff2e48404a945d15cc12876fb6'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:12.416205 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:12.423371 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-dc74c0f6-1753-4a86-9ec6-32dbfde79d68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30f57cff2e48404a945d15cc12876fb6'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:12.425449 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-dc74c0f6-1753-4a86-9ec6-32dbfde79d68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30f57cff2e48404a945d15cc12876fb6'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:12.426765 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-dc74c0f6-1753-4a86-9ec6-32dbfde79d68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30f57cff2e48404a945d15cc12876fb6'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:12.437625 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-dc74c0f6-1753-4a86-9ec6-32dbfde79d68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30f57cff2e48404a945d15cc12876fb6'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:12.464866 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1194/2383] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:58:12 2022] DELETE /identity/v3/users/30f57cff2e48404a945d15cc12876fb6 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:58:12.469185 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8a8d1-224c-43f5-910b-68032c197b76 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:12.469473 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8a8d1-224c-43f5-910b-68032c197b76 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:12.469750 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8a8d1-224c-43f5-910b-68032c197b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:12.506079 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-f3c8a8d1-224c-43f5-910b-68032c197b76 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:58:12.510078 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-f3c8a8d1-224c-43f5-910b-68032c197b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:12.627921 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1190/2384] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:58:12.637809 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74c0f6-1753-4a86-9ec6-32dbfde79d68 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:12.639361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-dc74c0f6-1753-4a86-9ec6-32dbfde79d68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:12.743235 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74c0f6-1753-4a86-9ec6-32dbfde79d68 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:12.749632 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb13b47-5370-42b1-bd76-a16fcc43e47d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:12.750445 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb13b47-5370-42b1-bd76-a16fcc43e47d service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:12.750731 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb13b47-5370-42b1-bd76-a16fcc43e47d service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:12.751001 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb13b47-5370-42b1-bd76-a16fcc43e47d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:12.795357 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb13b47-5370-42b1-bd76-a16fcc43e47d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:12.798150 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb13b47-5370-42b1-bd76-a16fcc43e47d service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:12.835384 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1195/2385] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:58:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:58:13.574205 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8a8d1-224c-43f5-910b-68032c197b76 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:13.577086 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-f3c8a8d1-224c-43f5-910b-68032c197b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:13.611063 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8a8d1-224c-43f5-910b-68032c197b76 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:13.619441 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c84762-9a91-469f-a3d5-1cc90ab2a4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:13.620551 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c84762-9a91-469f-a3d5-1cc90ab2a4d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:13.621049 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c84762-9a91-469f-a3d5-1cc90ab2a4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:13.621484 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c84762-9a91-469f-a3d5-1cc90ab2a4d0 admin admin] PATH_INFO: `/v3/projects/a8d605c621c04855a4e8eebd5281e388` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:13.623084 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c84762-9a91-469f-a3d5-1cc90ab2a4d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8d605c621c04855a4e8eebd5281e388)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:13.625200 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c84762-9a91-469f-a3d5-1cc90ab2a4d0 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:13.754994 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-70c84762-9a91-469f-a3d5-1cc90ab2a4d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8d605c621c04855a4e8eebd5281e388', 'request_id': 'req-70c84762-9a91-469f-a3d5-1cc90ab2a4d0'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:13.795718 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-70c84762-9a91-469f-a3d5-1cc90ab2a4d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8d605c621c04855a4e8eebd5281e388', 'request_id': 'req-70c84762-9a91-469f-a3d5-1cc90ab2a4d0'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:13.814817 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-70c84762-9a91-469f-a3d5-1cc90ab2a4d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8d605c621c04855a4e8eebd5281e388', 'request_id': 'req-70c84762-9a91-469f-a3d5-1cc90ab2a4d0'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:13.846831 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-70c84762-9a91-469f-a3d5-1cc90ab2a4d0 admin admin] The token cache is being invalidate because project a8d605c621c04855a4e8eebd5281e388 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:58:13.847131 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-70c84762-9a91-469f-a3d5-1cc90ab2a4d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:13.847875 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-70c84762-9a91-469f-a3d5-1cc90ab2a4d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:13.869055 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1191/2386] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:58:13 2022] DELETE /identity/v3/projects/a8d605c621c04855a4e8eebd5281e388 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:58:14.849442 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f92b74-e15f-400a-9c3a-bdaea942b31e None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:14.850023 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f92b74-e15f-400a-9c3a-bdaea942b31e None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:14.850023 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f92b74-e15f-400a-9c3a-bdaea942b31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:14.873895 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-97f92b74-e15f-400a-9c3a-bdaea942b31e None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:58:14.876178 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-97f92b74-e15f-400a-9c3a-bdaea942b31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:14.961673 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1196/2387] 10.222.0.97 () {58 vars in 1016 bytes} [Mon Sep 26 17:58:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:58:14.977550 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c84762-9a91-469f-a3d5-1cc90ab2a4d0 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:14.979317 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-70c84762-9a91-469f-a3d5-1cc90ab2a4d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:14.994110 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:15.075507 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad200662-b2ee-4611-a73f-521c45d2b0bf None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:15.076664 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad200662-b2ee-4611-a73f-521c45d2b0bf None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:15.077181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad200662-b2ee-4611-a73f-521c45d2b0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:15.107361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-ad200662-b2ee-4611-a73f-521c45d2b0bf None None] MFA Rules not processed for user `a3e5d3a7379042d4a04a23effdeba6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:58:15.108736 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-ad200662-b2ee-4611-a73f-521c45d2b0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:15.151980 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c84762-9a91-469f-a3d5-1cc90ab2a4d0 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:15.171656 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1e476-4a23-40b9-83f6-8df67bfd3c0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:15.173618 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1e476-4a23-40b9-83f6-8df67bfd3c0d service nova] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:15.174168 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1e476-4a23-40b9-83f6-8df67bfd3c0d service nova] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:15.174695 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1e476-4a23-40b9-83f6-8df67bfd3c0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:15.192818 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1197/2388] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:58:15 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:58:15.201420 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1e476-4a23-40b9-83f6-8df67bfd3c0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:15.203357 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1e476-4a23-40b9-83f6-8df67bfd3c0d service nova] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:15.220634 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1192/2389] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:58:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:58:17.416268 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e9f60-9018-4408-85c2-caef42c5c2f5 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:17.416858 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e9f60-9018-4408-85c2-caef42c5c2f5 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:17.416963 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e9f60-9018-4408-85c2-caef42c5c2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:17.438568 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-cd2e9f60-9018-4408-85c2-caef42c5c2f5 None None] MFA Rules not processed for user `6384580cf2804b39bb9dbca582adcc4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:58:17.440692 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-cd2e9f60-9018-4408-85c2-caef42c5c2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:17.450387 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:17.499857 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1198/2390] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:58:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:58:18.992165 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87508b28-ad16-4101-aa78-ce06d7e8a525 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:18.992721 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87508b28-ad16-4101-aa78-ce06d7e8a525 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:18.992721 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87508b28-ad16-4101-aa78-ce06d7e8a525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:19.014551 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-87508b28-ad16-4101-aa78-ce06d7e8a525 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:58:19.016021 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-87508b28-ad16-4101-aa78-ce06d7e8a525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:19.024975 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1193/2391] 10.222.0.97 () {58 vars in 1016 bytes} [Mon Sep 26 17:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:58:19.066105 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e9f60-9018-4408-85c2-caef42c5c2f5 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:19.069609 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-cd2e9f60-9018-4408-85c2-caef42c5c2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:19.088452 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e9f60-9018-4408-85c2-caef42c5c2f5 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:19.094232 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ada230-1d7b-44d7-8f59-f621625c3cdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:19.094843 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ada230-1d7b-44d7-8f59-f621625c3cdd service nova] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:19.095138 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ada230-1d7b-44d7-8f59-f621625c3cdd service nova] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:19.095425 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ada230-1d7b-44d7-8f59-f621625c3cdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:19.104827 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ada230-1d7b-44d7-8f59-f621625c3cdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:19.106534 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ada230-1d7b-44d7-8f59-f621625c3cdd service nova] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:19.117407 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1199/2392] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:58:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:58:26.322600 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e973f-44dc-4bc9-9977-24eb26dba754 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:26.323068 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e973f-44dc-4bc9-9977-24eb26dba754 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:26.323177 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e973f-44dc-4bc9-9977-24eb26dba754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:26.347172 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-f00e973f-44dc-4bc9-9977-24eb26dba754 None None] MFA Rules not processed for user `8475122232ef4d8893f2a9b98768396e`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:58:26.349235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-f00e973f-44dc-4bc9-9977-24eb26dba754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:26.450614 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1194/2393] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Sep 26 17:58:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:58:26.472885 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ada230-1d7b-44d7-8f59-f621625c3cdd service nova] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:26.474645 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-d5ada230-1d7b-44d7-8f59-f621625c3cdd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:26.579586 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ada230-1d7b-44d7-8f59-f621625c3cdd service nova] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:26.589281 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48311c-8e9e-4681-bb25-d5b98d65c81d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea49cd9839474232a0cbe66ccffbf082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:26.590413 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48311c-8e9e-4681-bb25-d5b98d65c81d service swift] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:26.590843 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48311c-8e9e-4681-bb25-d5b98d65c81d service swift] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:26.591284 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48311c-8e9e-4681-bb25-d5b98d65c81d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:26.606003 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48311c-8e9e-4681-bb25-d5b98d65c81d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:26.611569 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48311c-8e9e-4681-bb25-d5b98d65c81d service swift] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:26.641718 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1200/2394] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Sep 26 17:58:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 26 17:58:27.676913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8b484-d95f-4924-b9bd-90de142aad39 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:27.677575 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8b484-d95f-4924-b9bd-90de142aad39 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:27.677575 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8b484-d95f-4924-b9bd-90de142aad39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:27.699533 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-76f8b484-d95f-4924-b9bd-90de142aad39 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:58:27.700735 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-76f8b484-d95f-4924-b9bd-90de142aad39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:27.710604 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1195/2395] 10.222.0.97 () {58 vars in 1016 bytes} [Mon Sep 26 17:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:58:27.730294 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48311c-8e9e-4681-bb25-d5b98d65c81d service swift] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:27.744658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48311c-8e9e-4681-bb25-d5b98d65c81d service swift] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:27.754813 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5749e-7b16-40da-8be5-97a361015e47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:27.755439 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5749e-7b16-40da-8be5-97a361015e47 service nova] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:27.755764 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5749e-7b16-40da-8be5-97a361015e47 service nova] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:27.756043 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5749e-7b16-40da-8be5-97a361015e47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:27.765576 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5749e-7b16-40da-8be5-97a361015e47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:27.767021 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5749e-7b16-40da-8be5-97a361015e47 service nova] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:27.777035 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1201/2396] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:58:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:58:37.692601 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=61 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:37.772675 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=62 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:54.386992 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f8b484-d95f-4924-b9bd-90de142aad39 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:54.388577 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-76f8b484-d95f-4924-b9bd-90de142aad39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:54.401401 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f8b484-d95f-4924-b9bd-90de142aad39 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:54.406102 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff46e63-545b-48ed-a2a8-51c04c922ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:54.406898 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff46e63-545b-48ed-a2a8-51c04c922ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:54.407276 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff46e63-545b-48ed-a2a8-51c04c922ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:54.407649 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff46e63-545b-48ed-a2a8-51c04c922ea9 admin admin] PATH_INFO: `/v3/users/15e3f199841249228cb2a8dc9fa4b79c` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:54.410141 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff46e63-545b-48ed-a2a8-51c04c922ea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15e3f199841249228cb2a8dc9fa4b79c)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:54.412274 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff46e63-545b-48ed-a2a8-51c04c922ea9 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:54.461495 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-dff46e63-545b-48ed-a2a8-51c04c922ea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15e3f199841249228cb2a8dc9fa4b79c'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:54.462239 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-dff46e63-545b-48ed-a2a8-51c04c922ea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15e3f199841249228cb2a8dc9fa4b79c'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:54.462886 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-dff46e63-545b-48ed-a2a8-51c04c922ea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15e3f199841249228cb2a8dc9fa4b79c'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:54.470321 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-dff46e63-545b-48ed-a2a8-51c04c922ea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15e3f199841249228cb2a8dc9fa4b79c'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:54.482703 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-dff46e63-545b-48ed-a2a8-51c04c922ea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15e3f199841249228cb2a8dc9fa4b79c'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:54.503241 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1196/2397] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:58:54 2022] DELETE /identity/v3/users/15e3f199841249228cb2a8dc9fa4b79c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:58:54.508182 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bb5be-5317-4401-9c4b-4626febced1d None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:54.508705 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bb5be-5317-4401-9c4b-4626febced1d None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:54.508804 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bb5be-5317-4401-9c4b-4626febced1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:54.528178 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-299bb5be-5317-4401-9c4b-4626febced1d None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:58:54.529408 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-299bb5be-5317-4401-9c4b-4626febced1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:54.594654 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1202/2398] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:58:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:58:54.605191 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff46e63-545b-48ed-a2a8-51c04c922ea9 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:54.606744 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-dff46e63-545b-48ed-a2a8-51c04c922ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:54.666586 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff46e63-545b-48ed-a2a8-51c04c922ea9 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:54.670235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d526e-6292-4ae5-ae34-c944ec0ee200 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:54.670861 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d526e-6292-4ae5-ae34-c944ec0ee200 service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:54.671141 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d526e-6292-4ae5-ae34-c944ec0ee200 service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:54.671412 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d526e-6292-4ae5-ae34-c944ec0ee200 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:54.681421 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d526e-6292-4ae5-ae34-c944ec0ee200 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:54.682865 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d526e-6292-4ae5-ae34-c944ec0ee200 service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:54.692905 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1197/2399] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:58:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:58:54.951681 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299bb5be-5317-4401-9c4b-4626febced1d None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:54.953223 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-299bb5be-5317-4401-9c4b-4626febced1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:54.967124 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299bb5be-5317-4401-9c4b-4626febced1d None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:54.971974 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d8981-cfd8-4d50-8416-d61e67611d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:54.972753 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d8981-cfd8-4d50-8416-d61e67611d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:54.973274 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d8981-cfd8-4d50-8416-d61e67611d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:54.973659 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d8981-cfd8-4d50-8416-d61e67611d4b admin admin] PATH_INFO: `/v3/projects/98483419e13c4e06b8911ebcea45d8a8` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:54.975262 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d8981-cfd8-4d50-8416-d61e67611d4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=98483419e13c4e06b8911ebcea45d8a8)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:54.977603 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d8981-cfd8-4d50-8416-d61e67611d4b admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:55.028927 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-e33d8981-cfd8-4d50-8416-d61e67611d4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98483419e13c4e06b8911ebcea45d8a8', 'request_id': 'req-e33d8981-cfd8-4d50-8416-d61e67611d4b'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:55.034788 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-e33d8981-cfd8-4d50-8416-d61e67611d4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98483419e13c4e06b8911ebcea45d8a8', 'request_id': 'req-e33d8981-cfd8-4d50-8416-d61e67611d4b'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:55.042895 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-e33d8981-cfd8-4d50-8416-d61e67611d4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98483419e13c4e06b8911ebcea45d8a8', 'request_id': 'req-e33d8981-cfd8-4d50-8416-d61e67611d4b'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:55.054429 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-e33d8981-cfd8-4d50-8416-d61e67611d4b admin admin] The token cache is being invalidate because project 98483419e13c4e06b8911ebcea45d8a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:58:55.054713 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-e33d8981-cfd8-4d50-8416-d61e67611d4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:55.055376 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-e33d8981-cfd8-4d50-8416-d61e67611d4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:55.056868 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1203/2400] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:58:54 2022] DELETE /identity/v3/projects/98483419e13c4e06b8911ebcea45d8a8 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:58:55.061873 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b26480-56e8-4d0f-b8bc-dbacf49bcaf4 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:55.062269 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b26480-56e8-4d0f-b8bc-dbacf49bcaf4 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:55.062543 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b26480-56e8-4d0f-b8bc-dbacf49bcaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:55.083987 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-87b26480-56e8-4d0f-b8bc-dbacf49bcaf4 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:58:55.085393 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-87b26480-56e8-4d0f-b8bc-dbacf49bcaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:55.145578 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1198/2401] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:58:55.153425 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267fde9-37c6-4973-a800-c9b52628e9cc None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:55.153711 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267fde9-37c6-4973-a800-c9b52628e9cc None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:55.153986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267fde9-37c6-4973-a800-c9b52628e9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:55.173692 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-e267fde9-37c6-4973-a800-c9b52628e9cc None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:58:55.174925 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-e267fde9-37c6-4973-a800-c9b52628e9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:55.188627 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1204/2402] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:58:55.193533 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b26480-56e8-4d0f-b8bc-dbacf49bcaf4 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:55.203563 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b26480-56e8-4d0f-b8bc-dbacf49bcaf4 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:55.209413 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7f09c-4093-48fa-b603-478fb1db9a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:55.210011 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7f09c-4093-48fa-b603-478fb1db9a61 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:55.210287 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7f09c-4093-48fa-b603-478fb1db9a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:55.210557 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7f09c-4093-48fa-b603-478fb1db9a61 admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:55.211206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7f09c-4093-48fa-b603-478fb1db9a61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 17:58:55.211511 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7f09c-4093-48fa-b603-478fb1db9a61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:55.213135 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7f09c-4093-48fa-b603-478fb1db9a61 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:55.225239 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1199/2403] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 17:58:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 17:58:55.229601 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267fde9-37c6-4973-a800-c9b52628e9cc None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:55.239423 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267fde9-37c6-4973-a800-c9b52628e9cc None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:55.244542 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd32a7d-d7d3-469f-a6c4-4a48aa78d43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:55.245177 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd32a7d-d7d3-469f-a6c4-4a48aa78d43e admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:55.245460 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd32a7d-d7d3-469f-a6c4-4a48aa78d43e admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:55.245753 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd32a7d-d7d3-469f-a6c4-4a48aa78d43e admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:55.246413 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd32a7d-d7d3-469f-a6c4-4a48aa78d43e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:55.248422 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd32a7d-d7d3-469f-a6c4-4a48aa78d43e admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:55.275859 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1205/2404] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 17:58:55 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:58:55.280129 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7f09c-4093-48fa-b603-478fb1db9a61 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:55.285471 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:55.292926 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7f09c-4093-48fa-b603-478fb1db9a61 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:55.366048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f247f-cb03-4b96-aef6-8f98606a4bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:55.366480 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f247f-cb03-4b96-aef6-8f98606a4bad admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:55.366823 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f247f-cb03-4b96-aef6-8f98606a4bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:55.367185 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f247f-cb03-4b96-aef6-8f98606a4bad admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:55.368146 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f247f-cb03-4b96-aef6-8f98606a4bad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:55.370431 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f247f-cb03-4b96-aef6-8f98606a4bad admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:55.397771 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1200/2405] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 17:58:55 2022] POST /identity/v3/users => generated 286 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 17:58:55.401860 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd32a7d-d7d3-469f-a6c4-4a48aa78d43e admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:55.413713 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd32a7d-d7d3-469f-a6c4-4a48aa78d43e admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:55.418466 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc7588-6c97-4ce9-99ba-e7776480305b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:55.419085 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc7588-6c97-4ce9-99ba-e7776480305b admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:55.419516 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc7588-6c97-4ce9-99ba-e7776480305b admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:55.419798 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc7588-6c97-4ce9-99ba-e7776480305b admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:55.420450 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc7588-6c97-4ce9-99ba-e7776480305b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:55.422097 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc7588-6c97-4ce9-99ba-e7776480305b admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:55.433867 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1206/2406] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 17:58:55.437626 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f247f-cb03-4b96-aef6-8f98606a4bad admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:55.452457 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f247f-cb03-4b96-aef6-8f98606a4bad admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:55.459496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d1fe4-b53c-421f-ad79-29a96c1fddcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:55.460331 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d1fe4-b53c-421f-ad79-29a96c1fddcb admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:55.460617 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d1fe4-b53c-421f-ad79-29a96c1fddcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:55.460893 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d1fe4-b53c-421f-ad79-29a96c1fddcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:55.461628 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d1fe4-b53c-421f-ad79-29a96c1fddcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:55.463534 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d1fe4-b53c-421f-ad79-29a96c1fddcb admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:55.495625 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1201/2407] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 17:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 17:58:55.498811 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc7588-6c97-4ce9-99ba-e7776480305b admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:55.517720 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc7588-6c97-4ce9-99ba-e7776480305b admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:55.546321 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d312f53-3627-47f0-b83a-919347eac589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:55.547891 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d312f53-3627-47f0-b83a-919347eac589 admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:55.548190 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d312f53-3627-47f0-b83a-919347eac589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:55.548467 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d312f53-3627-47f0-b83a-919347eac589 admin admin] PATH_INFO: `/v3/projects/284400726d964438b427bd3affc4bb09/users/e38f61610c77421c824a0cdcd1dd93ce/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:55.583157 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d312f53-3627-47f0-b83a-919347eac589 admin admin] RBAC: Authorizing `identity:create_grant(project_id=284400726d964438b427bd3affc4bb09, user_id=e38f61610c77421c824a0cdcd1dd93ce, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:55.585889 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d312f53-3627-47f0-b83a-919347eac589 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:55.601873 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1207/2408] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 17:58:55 2022] PUT /identity/v3/projects/284400726d964438b427bd3affc4bb09/users/e38f61610c77421c824a0cdcd1dd93ce/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:58:55.671800 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7470b-0e0b-4cc4-a0a4-1ee3d8f0ef9e None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:55.672081 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7470b-0e0b-4cc4-a0a4-1ee3d8f0ef9e None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:55.672349 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7470b-0e0b-4cc4-a0a4-1ee3d8f0ef9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:55.701179 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-73f7470b-0e0b-4cc4-a0a4-1ee3d8f0ef9e None None] MFA Rules not processed for user `e38f61610c77421c824a0cdcd1dd93ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:58:55.702397 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-73f7470b-0e0b-4cc4-a0a4-1ee3d8f0ef9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:55.768590 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1202/2409] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:58:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:58:55.779900 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d312f53-3627-47f0-b83a-919347eac589 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:55.781624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-5d312f53-3627-47f0-b83a-919347eac589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:55.804400 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:55.842115 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d312f53-3627-47f0-b83a-919347eac589 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:55.849328 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ddd46f-fda2-410f-ae56-9a4ce53d5eed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:55.849996 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddd46f-fda2-410f-ae56-9a4ce53d5eed service cinder] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:55.850278 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddd46f-fda2-410f-ae56-9a4ce53d5eed service cinder] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:55.850783 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddd46f-fda2-410f-ae56-9a4ce53d5eed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:55.859852 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ddd46f-fda2-410f-ae56-9a4ce53d5eed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:55.862039 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ddd46f-fda2-410f-ae56-9a4ce53d5eed service cinder] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:55.872155 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1208/2410] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:58:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:58:55.898199 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7470b-0e0b-4cc4-a0a4-1ee3d8f0ef9e None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:55.977272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7470b-0e0b-4cc4-a0a4-1ee3d8f0ef9e None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:55.983403 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c2328-4324-445f-82b3-dbee1be276fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:55.984331 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c2328-4324-445f-82b3-dbee1be276fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:55.984812 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c2328-4324-445f-82b3-dbee1be276fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:55.985230 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c2328-4324-445f-82b3-dbee1be276fa admin admin] PATH_INFO: `/v3/users/e38f61610c77421c824a0cdcd1dd93ce` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:55.986637 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c2328-4324-445f-82b3-dbee1be276fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=e38f61610c77421c824a0cdcd1dd93ce)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:55.989590 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c2328-4324-445f-82b3-dbee1be276fa admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:56.006012 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:56.071634 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-748c2328-4324-445f-82b3-dbee1be276fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e38f61610c77421c824a0cdcd1dd93ce'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:56.072252 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-748c2328-4324-445f-82b3-dbee1be276fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e38f61610c77421c824a0cdcd1dd93ce'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:56.072948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-748c2328-4324-445f-82b3-dbee1be276fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e38f61610c77421c824a0cdcd1dd93ce'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:56.081652 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-748c2328-4324-445f-82b3-dbee1be276fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e38f61610c77421c824a0cdcd1dd93ce'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:56.102048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-748c2328-4324-445f-82b3-dbee1be276fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e38f61610c77421c824a0cdcd1dd93ce'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:56.129164 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1203/2411] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:58:55 2022] DELETE /identity/v3/users/e38f61610c77421c824a0cdcd1dd93ce => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:58:56.131885 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5270e7-ca6e-454b-a610-bb507de443cc None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:56.132171 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5270e7-ca6e-454b-a610-bb507de443cc None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:56.132448 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5270e7-ca6e-454b-a610-bb507de443cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:56.168346 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-ba5270e7-ca6e-454b-a610-bb507de443cc None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:58:56.169623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-ba5270e7-ca6e-454b-a610-bb507de443cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:56.258802 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1209/2412] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:58:56.300717 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c2328-4324-445f-82b3-dbee1be276fa admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:56.301988 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-748c2328-4324-445f-82b3-dbee1be276fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:56.373682 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c2328-4324-445f-82b3-dbee1be276fa admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:56.381972 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c43bee-a3fe-4c16-a3fd-730c47a3d9c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:56.382602 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c43bee-a3fe-4c16-a3fd-730c47a3d9c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:56.382877 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c43bee-a3fe-4c16-a3fd-730c47a3d9c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:56.383144 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c43bee-a3fe-4c16-a3fd-730c47a3d9c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:56.398115 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c43bee-a3fe-4c16-a3fd-730c47a3d9c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:56.399573 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c43bee-a3fe-4c16-a3fd-730c47a3d9c9 service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:56.409967 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1204/2413] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:58:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:58:56.976397 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5270e7-ca6e-454b-a610-bb507de443cc None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:56.977859 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-ba5270e7-ca6e-454b-a610-bb507de443cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:56.990545 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5270e7-ca6e-454b-a610-bb507de443cc None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:56.995180 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c41ad-1c87-415c-be21-00ec84bb225e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:56.995811 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c41ad-1c87-415c-be21-00ec84bb225e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:56.996083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c41ad-1c87-415c-be21-00ec84bb225e admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:56.996355 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c41ad-1c87-415c-be21-00ec84bb225e admin admin] PATH_INFO: `/v3/projects/284400726d964438b427bd3affc4bb09` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:56.997694 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c41ad-1c87-415c-be21-00ec84bb225e admin admin] RBAC: Authorizing `identity:delete_project(project_id=284400726d964438b427bd3affc4bb09)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:56.999721 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c41ad-1c87-415c-be21-00ec84bb225e admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:57.046916 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-907c41ad-1c87-415c-be21-00ec84bb225e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '284400726d964438b427bd3affc4bb09', 'request_id': 'req-907c41ad-1c87-415c-be21-00ec84bb225e'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:57.052887 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-907c41ad-1c87-415c-be21-00ec84bb225e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '284400726d964438b427bd3affc4bb09', 'request_id': 'req-907c41ad-1c87-415c-be21-00ec84bb225e'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:57.059711 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-907c41ad-1c87-415c-be21-00ec84bb225e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '284400726d964438b427bd3affc4bb09', 'request_id': 'req-907c41ad-1c87-415c-be21-00ec84bb225e'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:57.072026 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-907c41ad-1c87-415c-be21-00ec84bb225e admin admin] The token cache is being invalidate because project 284400726d964438b427bd3affc4bb09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 17:58:57.072435 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-907c41ad-1c87-415c-be21-00ec84bb225e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:57.073239 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-907c41ad-1c87-415c-be21-00ec84bb225e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:58:57.074915 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1210/2414] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:58:56 2022] DELETE /identity/v3/projects/284400726d964438b427bd3affc4bb09 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:58:59.627566 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be799e1-8360-49d9-9fc1-c9da47a8702e None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:59.628520 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be799e1-8360-49d9-9fc1-c9da47a8702e None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:59.628705 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be799e1-8360-49d9-9fc1-c9da47a8702e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:59.649280 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-0be799e1-8360-49d9-9fc1-c9da47a8702e None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:58:59.650778 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-0be799e1-8360-49d9-9fc1-c9da47a8702e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:59.709259 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1205/2415] 10.222.0.97 () {58 vars in 1016 bytes} [Mon Sep 26 17:58:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:58:59.724397 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c41ad-1c87-415c-be21-00ec84bb225e admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:58:59.725893 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-907c41ad-1c87-415c-be21-00ec84bb225e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:58:59.777392 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:58:59.804360 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c41ad-1c87-415c-be21-00ec84bb225e admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:58:59.809931 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210475b6-7b93-44c7-a95a-c18660c53490 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:58:59.810553 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210475b6-7b93-44c7-a95a-c18660c53490 service nova] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:58:59.810823 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210475b6-7b93-44c7-a95a-c18660c53490 service nova] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:58:59.811095 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210475b6-7b93-44c7-a95a-c18660c53490 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:58:59.820272 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210475b6-7b93-44c7-a95a-c18660c53490 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:58:59.821922 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210475b6-7b93-44c7-a95a-c18660c53490 service nova] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:58:59.832568 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1211/2416] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:58:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:59:04.754954 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0eb63-2f80-4d4e-b089-2eb25aad89c0 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:59:04.755482 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0eb63-2f80-4d4e-b089-2eb25aad89c0 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:59:04.755482 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0eb63-2f80-4d4e-b089-2eb25aad89c0 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:59:04.756875 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1206/2417] 10.222.0.62 () {54 vars in 961 bytes} [Mon Sep 26 17:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 17:59:04.762300 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20670078-2df9-4311-8b13-1eac74d72d7f None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:59:04.762766 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20670078-2df9-4311-8b13-1eac74d72d7f None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:59:04.762954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20670078-2df9-4311-8b13-1eac74d72d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:59:04.784023 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-20670078-2df9-4311-8b13-1eac74d72d7f None None] MFA Rules not processed for user `f5043d835c08458c9f3911a4741bdaa8`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:59:04.785781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-20670078-2df9-4311-8b13-1eac74d72d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:59:04.866606 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1212/2418] 10.222.0.62 () {58 vars in 1058 bytes} [Mon Sep 26 17:59:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:59:04.874339 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0eb63-2f80-4d4e-b089-2eb25aad89c0 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:59:04.887792 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0eb63-2f80-4d4e-b089-2eb25aad89c0 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:59:04.892701 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471621cb-c199-4d47-8052-6a715e0de7e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5043d835c08458c9f3911a4741bdaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:59:04.893324 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471621cb-c199-4d47-8052-6a715e0de7e3 service placement] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:59:04.893637 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471621cb-c199-4d47-8052-6a715e0de7e3 service placement] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:59:04.893902 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471621cb-c199-4d47-8052-6a715e0de7e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:59:04.895642 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-471621cb-c199-4d47-8052-6a715e0de7e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:59:04.906892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471621cb-c199-4d47-8052-6a715e0de7e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:59:04.908490 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471621cb-c199-4d47-8052-6a715e0de7e3 service placement] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:59:04.918745 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1207/2419] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:59:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:59:07.935241 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af96933-ddb0-4a91-a681-86a0cc1985a1 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:59:07.935835 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af96933-ddb0-4a91-a681-86a0cc1985a1 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:59:07.935835 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af96933-ddb0-4a91-a681-86a0cc1985a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:59:07.957127 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-6af96933-ddb0-4a91-a681-86a0cc1985a1 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:59:07.958336 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-6af96933-ddb0-4a91-a681-86a0cc1985a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:59:07.966403 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1213/2420] 10.222.0.97 () {58 vars in 1016 bytes} [Mon Sep 26 17:59:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:59:07.982127 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471621cb-c199-4d47-8052-6a715e0de7e3 service placement] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:59:07.994568 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471621cb-c199-4d47-8052-6a715e0de7e3 service placement] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:59:08.000053 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b417d-07a3-422b-a14c-66d01803d5b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:59:08.000681 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b417d-07a3-422b-a14c-66d01803d5b4 service nova] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:59:08.000962 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b417d-07a3-422b-a14c-66d01803d5b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:59:08.001279 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b417d-07a3-422b-a14c-66d01803d5b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:59:08.010524 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b417d-07a3-422b-a14c-66d01803d5b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:59:08.012186 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b417d-07a3-422b-a14c-66d01803d5b4 service nova] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:59:08.022013 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1208/2421] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:59:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 17:59:09.279722 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615670c-9452-453e-8193-ac6197e9854c None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:59:09.280236 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615670c-9452-453e-8193-ac6197e9854c None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:59:09.280457 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615670c-9452-453e-8193-ac6197e9854c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:59:09.299874 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-f615670c-9452-453e-8193-ac6197e9854c None None] MFA Rules not processed for user `9d3e0a3393ed472abe3b4c621ecc41d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:59:09.301130 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-f615670c-9452-453e-8193-ac6197e9854c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:59:09.358632 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1214/2422] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:59:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:59:13.177873 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4ee1f-fc50-4c8d-ab91-204ad2c7cfc0 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:59:13.178396 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4ee1f-fc50-4c8d-ab91-204ad2c7cfc0 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:59:13.178396 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4ee1f-fc50-4c8d-ab91-204ad2c7cfc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:59:13.193586 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:59:13.199030 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-00b4ee1f-fc50-4c8d-ab91-204ad2c7cfc0 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:59:13.201781 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-00b4ee1f-fc50-4c8d-ab91-204ad2c7cfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:59:13.215630 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1209/2423] 10.222.0.97 () {58 vars in 1016 bytes} [Mon Sep 26 17:59:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:59:13.306389 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615670c-9452-453e-8193-ac6197e9854c None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:59:13.308496 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-f615670c-9452-453e-8193-ac6197e9854c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:59:13.325049 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615670c-9452-453e-8193-ac6197e9854c None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:59:13.330884 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc8ca5-78e1-44cc-9223-175d832f733d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:59:13.332162 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc8ca5-78e1-44cc-9223-175d832f733d service nova] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:59:13.332501 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc8ca5-78e1-44cc-9223-175d832f733d service nova] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:59:13.332851 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc8ca5-78e1-44cc-9223-175d832f733d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:59:13.341919 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc8ca5-78e1-44cc-9223-175d832f733d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:59:13.343496 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc8ca5-78e1-44cc-9223-175d832f733d service nova] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:59:13.353576 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1215/2424] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:59:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:59:18.948553 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4ee1f-fc50-4c8d-ab91-204ad2c7cfc0 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:59:18.949966 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-00b4ee1f-fc50-4c8d-ab91-204ad2c7cfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:59:19.007406 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4ee1f-fc50-4c8d-ab91-204ad2c7cfc0 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:59:19.011177 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e972c9e-7c5a-4f6e-a429-09d8a8737dd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:59:19.011781 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e972c9e-7c5a-4f6e-a429-09d8a8737dd8 service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:59:19.012062 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e972c9e-7c5a-4f6e-a429-09d8a8737dd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:59:19.012336 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e972c9e-7c5a-4f6e-a429-09d8a8737dd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:59:19.014110 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-0e972c9e-7c5a-4f6e-a429-09d8a8737dd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:59:19.080384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e972c9e-7c5a-4f6e-a429-09d8a8737dd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:59:19.081897 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e972c9e-7c5a-4f6e-a429-09d8a8737dd8 service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:59:19.091767 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1210/2425] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 17:59:18 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 17:59:23.349309 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=76 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:59:29.087292 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=50 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:59:40.577671 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3eaa4-48b9-467e-b302-e16a9446c010 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:59:40.578240 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3eaa4-48b9-467e-b302-e16a9446c010 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:59:40.578240 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3eaa4-48b9-467e-b302-e16a9446c010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:59:40.601127 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-71f3eaa4-48b9-467e-b302-e16a9446c010 None None] MFA Rules not processed for user `8475122232ef4d8893f2a9b98768396e`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:59:40.602786 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-71f3eaa4-48b9-467e-b302-e16a9446c010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:59:40.659943 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1216/2426] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Sep 26 17:59:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 17:59:40.701718 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e972c9e-7c5a-4f6e-a429-09d8a8737dd8 service neutron] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:59:40.703102 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-0e972c9e-7c5a-4f6e-a429-09d8a8737dd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:59:40.776056 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e972c9e-7c5a-4f6e-a429-09d8a8737dd8 service neutron] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:59:40.781180 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09053b-c910-4fa4-88e6-4a8735cede1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea49cd9839474232a0cbe66ccffbf082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:59:40.781792 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09053b-c910-4fa4-88e6-4a8735cede1b service swift] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:59:40.782073 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09053b-c910-4fa4-88e6-4a8735cede1b service swift] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:59:40.782346 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09053b-c910-4fa4-88e6-4a8735cede1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:59:40.790770 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09053b-c910-4fa4-88e6-4a8735cede1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:59:40.792358 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09053b-c910-4fa4-88e6-4a8735cede1b service swift] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:59:40.801400 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1211/2427] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Sep 26 17:59:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 17:59:42.951640 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63aa1c-8d35-4479-8c37-3c5496e09dce None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:59:42.952604 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63aa1c-8d35-4479-8c37-3c5496e09dce None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:59:42.953077 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63aa1c-8d35-4479-8c37-3c5496e09dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:59:42.975765 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-8d63aa1c-8d35-4479-8c37-3c5496e09dce None None] MFA Rules not processed for user `7c2171475db2491fb587658613feb080`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:59:42.977409 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-8d63aa1c-8d35-4479-8c37-3c5496e09dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:59:43.069051 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1217/2428] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 17:59:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:59:50.797779 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=32 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:59:53.058847 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=50 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 17:59:57.271222 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33aa9a-947b-4d83-8044-9c0a7e6a30a2 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:59:57.272256 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33aa9a-947b-4d83-8044-9c0a7e6a30a2 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:59:57.272256 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33aa9a-947b-4d83-8044-9c0a7e6a30a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:59:57.292710 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-9f33aa9a-947b-4d83-8044-9c0a7e6a30a2 None None] MFA Rules not processed for user `8475122232ef4d8893f2a9b98768396e`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 17:59:57.293862 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-9f33aa9a-947b-4d83-8044-9c0a7e6a30a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:59:57.301279 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1212/2429] 10.222.0.62 () {58 vars in 967 bytes} [Mon Sep 26 17:59:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 17:59:57.314362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63aa1c-8d35-4479-8c37-3c5496e09dce None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:59:57.326441 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63aa1c-8d35-4479-8c37-3c5496e09dce None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:59:57.332685 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ad31c-ef48-4934-bd99-d93044a1f5c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea49cd9839474232a0cbe66ccffbf082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:59:57.333507 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ad31c-ef48-4934-bd99-d93044a1f5c8 service swift] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:59:57.333859 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ad31c-ef48-4934-bd99-d93044a1f5c8 service swift] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:59:57.334768 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ad31c-ef48-4934-bd99-d93044a1f5c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:59:57.345095 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ad31c-ef48-4934-bd99-d93044a1f5c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:59:57.346858 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ad31c-ef48-4934-bd99-d93044a1f5c8 service swift] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:59:57.355928 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1218/2430] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Sep 26 17:59:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 17:59:59.590159 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33aa9a-947b-4d83-8044-9c0a7e6a30a2 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:59:59.591893 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-9f33aa9a-947b-4d83-8044-9c0a7e6a30a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 17:59:59.607765 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33aa9a-947b-4d83-8044-9c0a7e6a30a2 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:59:59.612269 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb426b4-3af9-46ba-a0a1-33dcef095917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:59:59.612896 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb426b4-3af9-46ba-a0a1-33dcef095917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:59:59.613220 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb426b4-3af9-46ba-a0a1-33dcef095917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:59:59.613495 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb426b4-3af9-46ba-a0a1-33dcef095917 admin admin] PATH_INFO: `/v3/users/9d3e0a3393ed472abe3b4c621ecc41d4` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:59:59.614635 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb426b4-3af9-46ba-a0a1-33dcef095917 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d3e0a3393ed472abe3b4c621ecc41d4)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:59:59.616654 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb426b4-3af9-46ba-a0a1-33dcef095917 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 17:59:59.663937 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-1eb426b4-3af9-46ba-a0a1-33dcef095917 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d3e0a3393ed472abe3b4c621ecc41d4'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:59:59.664569 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-1eb426b4-3af9-46ba-a0a1-33dcef095917 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d3e0a3393ed472abe3b4c621ecc41d4'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:59:59.665214 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-1eb426b4-3af9-46ba-a0a1-33dcef095917 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d3e0a3393ed472abe3b4c621ecc41d4'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:59:59.671966 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-1eb426b4-3af9-46ba-a0a1-33dcef095917 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d3e0a3393ed472abe3b4c621ecc41d4'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:59:59.679185 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-1eb426b4-3af9-46ba-a0a1-33dcef095917 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d3e0a3393ed472abe3b4c621ecc41d4'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 17:59:59.696251 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1213/2431] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 17:59:59 2022] DELETE /identity/v3/users/9d3e0a3393ed472abe3b4c621ecc41d4 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 17:59:59.877695 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ad31c-ef48-4934-bd99-d93044a1f5c8 service swift] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 17:59:59.891854 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ad31c-ef48-4934-bd99-d93044a1f5c8 service swift] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 17:59:59.962639 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2ef8d-ceed-4bea-ae2d-5c5419f0ffd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 17:59:59.963278 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2ef8d-ceed-4bea-ae2d-5c5419f0ffd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 17:59:59.963559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2ef8d-ceed-4bea-ae2d-5c5419f0ffd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 17:59:59.963829 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2ef8d-ceed-4bea-ae2d-5c5419f0ffd8 admin admin] PATH_INFO: `/v3/projects/2cd367f6def140438e181a2b0cf6a1cd` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 17:59:59.964947 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e2ef8d-ceed-4bea-ae2d-5c5419f0ffd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cd367f6def140438e181a2b0cf6a1cd)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 17:59:59.967143 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e2ef8d-ceed-4bea-ae2d-5c5419f0ffd8 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:00:00.015751 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-57e2ef8d-ceed-4bea-ae2d-5c5419f0ffd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cd367f6def140438e181a2b0cf6a1cd', 'request_id': 'req-57e2ef8d-ceed-4bea-ae2d-5c5419f0ffd8'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:00:00.022239 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-57e2ef8d-ceed-4bea-ae2d-5c5419f0ffd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cd367f6def140438e181a2b0cf6a1cd', 'request_id': 'req-57e2ef8d-ceed-4bea-ae2d-5c5419f0ffd8'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:00:00.032795 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-57e2ef8d-ceed-4bea-ae2d-5c5419f0ffd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cd367f6def140438e181a2b0cf6a1cd', 'request_id': 'req-57e2ef8d-ceed-4bea-ae2d-5c5419f0ffd8'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:00:00.051162 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-57e2ef8d-ceed-4bea-ae2d-5c5419f0ffd8 admin admin] The token cache is being invalidate because project 2cd367f6def140438e181a2b0cf6a1cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:00:00.051460 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-57e2ef8d-ceed-4bea-ae2d-5c5419f0ffd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:00:00.052141 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-57e2ef8d-ceed-4bea-ae2d-5c5419f0ffd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:00:00.053907 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1219/2432] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 17:59:59 2022] DELETE /identity/v3/projects/2cd367f6def140438e181a2b0cf6a1cd => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:00:01.864791 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01659a12-fb19-4ada-a792-05ada0b3852e None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:00:01.865976 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01659a12-fb19-4ada-a792-05ada0b3852e None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:00:01.865976 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01659a12-fb19-4ada-a792-05ada0b3852e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:00:01.887759 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-01659a12-fb19-4ada-a792-05ada0b3852e None None] MFA Rules not processed for user `8475122232ef4d8893f2a9b98768396e`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:00:01.889152 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-01659a12-fb19-4ada-a792-05ada0b3852e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:00:01.956305 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1214/2433] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Sep 26 18:00:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 18:00:01.968973 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2ef8d-ceed-4bea-ae2d-5c5419f0ffd8 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:00:01.973484 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-57e2ef8d-ceed-4bea-ae2d-5c5419f0ffd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:00:02.052542 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2ef8d-ceed-4bea-ae2d-5c5419f0ffd8 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:00:02.058428 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c5fec-cfa8-422b-bbac-ae7ba9842489 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea49cd9839474232a0cbe66ccffbf082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:00:02.059042 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c5fec-cfa8-422b-bbac-ae7ba9842489 service swift] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:00:02.059321 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c5fec-cfa8-422b-bbac-ae7ba9842489 service swift] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:00:02.059592 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c5fec-cfa8-422b-bbac-ae7ba9842489 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:00:02.067706 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c5fec-cfa8-422b-bbac-ae7ba9842489 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:00:02.069331 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c5fec-cfa8-422b-bbac-ae7ba9842489 service swift] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:00:02.078151 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1220/2434] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Sep 26 18:00:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 18:00:04.180763 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0567e4b-28b6-403c-b293-53a678dcb6a2 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:00:04.181309 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0567e4b-28b6-403c-b293-53a678dcb6a2 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:00:04.181774 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0567e4b-28b6-403c-b293-53a678dcb6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:00:04.204458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-c0567e4b-28b6-403c-b293-53a678dcb6a2 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:00:04.205998 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-c0567e4b-28b6-403c-b293-53a678dcb6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:00:04.277769 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1215/2435] 10.222.0.97 () {58 vars in 1016 bytes} [Mon Sep 26 18:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:00:04.294142 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c5fec-cfa8-422b-bbac-ae7ba9842489 service swift] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:00:04.295663 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-a12c5fec-cfa8-422b-bbac-ae7ba9842489 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:00:04.308627 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:00:04.381690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c5fec-cfa8-422b-bbac-ae7ba9842489 service swift] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:00:04.393792 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a95547-286b-429f-98e4-c7633d5195b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:00:04.394698 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a95547-286b-429f-98e4-c7633d5195b0 service nova] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:00:04.395144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a95547-286b-429f-98e4-c7633d5195b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:00:04.395638 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a95547-286b-429f-98e4-c7633d5195b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:00:04.406855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a95547-286b-429f-98e4-c7633d5195b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:00:04.408442 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a95547-286b-429f-98e4-c7633d5195b0 service nova] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:00:04.421078 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1221/2436] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:00:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:00:09.624379 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55025624-586c-46d4-8ebc-95ff6a990bf7 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:00:09.624925 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55025624-586c-46d4-8ebc-95ff6a990bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:00:09.624925 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55025624-586c-46d4-8ebc-95ff6a990bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:00:09.648315 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-55025624-586c-46d4-8ebc-95ff6a990bf7 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:00:09.649653 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-55025624-586c-46d4-8ebc-95ff6a990bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:00:09.658926 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1216/2437] 10.222.0.97 () {58 vars in 1016 bytes} [Mon Sep 26 18:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:00:09.685525 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a95547-286b-429f-98e4-c7633d5195b0 service nova] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:00:09.699767 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a95547-286b-429f-98e4-c7633d5195b0 service nova] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:00:09.709057 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5aebfb-509b-4dd0-8fcb-7d54a7073c26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:00:09.709057 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5aebfb-509b-4dd0-8fcb-7d54a7073c26 service nova] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:00:09.709057 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5aebfb-509b-4dd0-8fcb-7d54a7073c26 service nova] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:00:09.709057 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5aebfb-509b-4dd0-8fcb-7d54a7073c26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:00:09.722952 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5aebfb-509b-4dd0-8fcb-7d54a7073c26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:00:09.724612 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5aebfb-509b-4dd0-8fcb-7d54a7073c26 service nova] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:00:09.734425 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1222/2438] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:00:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 18:00:14.729280 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c02209-b5c6-4329-b27a-42fd0fd2f99b None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:00:14.729999 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c02209-b5c6-4329-b27a-42fd0fd2f99b None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:00:14.730195 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c02209-b5c6-4329-b27a-42fd0fd2f99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:00:14.739903 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:00:14.752133 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-12c02209-b5c6-4329-b27a-42fd0fd2f99b None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:00:14.754007 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-12c02209-b5c6-4329-b27a-42fd0fd2f99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:00:14.762321 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1217/2439] 10.222.0.97 () {58 vars in 1016 bytes} [Mon Sep 26 18:00:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:00:14.779707 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5aebfb-509b-4dd0-8fcb-7d54a7073c26 service nova] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:00:14.781225 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-7e5aebfb-509b-4dd0-8fcb-7d54a7073c26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:00:14.797975 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5aebfb-509b-4dd0-8fcb-7d54a7073c26 service nova] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:00:14.804474 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66b245-b82d-4b17-a912-d4bb1cec4303 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:00:14.805306 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66b245-b82d-4b17-a912-d4bb1cec4303 service nova] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:00:14.805668 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66b245-b82d-4b17-a912-d4bb1cec4303 service nova] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:00:14.806044 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66b245-b82d-4b17-a912-d4bb1cec4303 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:00:14.816718 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f66b245-b82d-4b17-a912-d4bb1cec4303 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:00:14.818904 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f66b245-b82d-4b17-a912-d4bb1cec4303 service nova] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:00:14.828470 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1223/2440] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:00:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:00:20.935649 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140095c-6e9f-45dd-9c55-694b844145c5 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:00:20.936209 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140095c-6e9f-45dd-9c55-694b844145c5 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:00:20.936328 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140095c-6e9f-45dd-9c55-694b844145c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:00:20.957441 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-b140095c-6e9f-45dd-9c55-694b844145c5 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:00:20.958943 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-b140095c-6e9f-45dd-9c55-694b844145c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:00:20.967967 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1218/2441] 10.222.0.97 () {58 vars in 1016 bytes} [Mon Sep 26 18:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:00:20.988114 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44c260-fd48-4d27-993a-7bb1a1c758f5 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:00:20.988114 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44c260-fd48-4d27-993a-7bb1a1c758f5 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:00:20.988779 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44c260-fd48-4d27-993a-7bb1a1c758f5 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:00:20.989957 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1224/2442] 10.222.0.62 () {54 vars in 921 bytes} [Mon Sep 26 18:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 18:00:20.998092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140095c-6e9f-45dd-9c55-694b844145c5 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:00:20.998744 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727afeb-1bbb-491c-acc5-904abb99f9ff None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:00:20.999071 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727afeb-1bbb-491c-acc5-904abb99f9ff None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:00:20.999368 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727afeb-1bbb-491c-acc5-904abb99f9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:00:21.011386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140095c-6e9f-45dd-9c55-694b844145c5 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:00:21.021308 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aade4b-7103-468b-b4a6-c95f68a64090 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:00:21.022147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aade4b-7103-468b-b4a6-c95f68a64090 service nova] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:00:21.022433 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aade4b-7103-468b-b4a6-c95f68a64090 service nova] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:00:21.022927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aade4b-7103-468b-b4a6-c95f68a64090 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:00:21.029034 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-b727afeb-1bbb-491c-acc5-904abb99f9ff None None] MFA Rules not processed for user `1792e79b9c9a47e1923f19bfd2cd495b`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:00:21.030452 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-b727afeb-1bbb-491c-acc5-904abb99f9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:00:21.032706 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aade4b-7103-468b-b4a6-c95f68a64090 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:00:21.034504 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aade4b-7103-468b-b4a6-c95f68a64090 service nova] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:00:21.041714 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1225/2443] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Sep 26 18:00:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 18:00:21.045240 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1219/2444] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:00:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:00:21.058086 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727afeb-1bbb-491c-acc5-904abb99f9ff None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:00:21.059720 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-b727afeb-1bbb-491c-acc5-904abb99f9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:00:21.120150 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727afeb-1bbb-491c-acc5-904abb99f9ff None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:00:21.128864 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923c7f6-9592-4a2a-b627-ef1ce9f49a32 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab3b7ac09599477bb0c6c1d32e2d5dbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:00:21.129586 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923c7f6-9592-4a2a-b627-ef1ce9f49a32 service glance] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:00:21.129874 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923c7f6-9592-4a2a-b627-ef1ce9f49a32 service glance] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:00:21.130182 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923c7f6-9592-4a2a-b627-ef1ce9f49a32 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:00:21.142445 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923c7f6-9592-4a2a-b627-ef1ce9f49a32 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:00:21.145098 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923c7f6-9592-4a2a-b627-ef1ce9f49a32 service glance] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:00:21.157527 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1226/2445] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:00:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:00:21.229720 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08a674-39b3-498e-928a-bafd331401e4 None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:00:21.230001 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08a674-39b3-498e-928a-bafd331401e4 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:00:21.230273 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08a674-39b3-498e-928a-bafd331401e4 None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:00:21.231613 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1220/2446] 10.222.0.62 () {54 vars in 921 bytes} [Mon Sep 26 18:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 18:00:21.236261 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9ffd6-fa28-4db4-920c-da82104c457e None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:00:21.236545 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9ffd6-fa28-4db4-920c-da82104c457e None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:00:21.236818 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9ffd6-fa28-4db4-920c-da82104c457e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:00:21.257556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-d5a9ffd6-fa28-4db4-920c-da82104c457e None None] MFA Rules not processed for user `a0ed50f4edcf468192a053b1e0fd6910`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:00:21.258787 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-d5a9ffd6-fa28-4db4-920c-da82104c457e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:00:21.310001 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1227/2447] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Sep 26 18:00:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:00:21.322054 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08a674-39b3-498e-928a-bafd331401e4 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:00:21.323711 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-7d08a674-39b3-498e-928a-bafd331401e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:00:21.336966 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08a674-39b3-498e-928a-bafd331401e4 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:00:21.340403 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0247f-cf68-45bb-8f67-37526347e1e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:00:21.340982 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0247f-cf68-45bb-8f67-37526347e1e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:00:21.341282 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0247f-cf68-45bb-8f67-37526347e1e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:00:21.341553 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0247f-cf68-45bb-8f67-37526347e1e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:00:21.351744 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d0247f-cf68-45bb-8f67-37526347e1e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:00:21.353371 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d0247f-cf68-45bb-8f67-37526347e1e0 service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:00:21.361796 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1221/2448] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:00:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:00:21.445900 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7f6cb-0780-4ba0-b6bd-4bb2e0c2d4df None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:00:21.446194 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7f6cb-0780-4ba0-b6bd-4bb2e0c2d4df None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:00:21.446500 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7f6cb-0780-4ba0-b6bd-4bb2e0c2d4df None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:00:21.447855 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1228/2449] 10.222.0.62 () {54 vars in 921 bytes} [Mon Sep 26 18:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 18:00:21.452678 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e54443-6010-46aa-9e36-1c5c825fb53e None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:00:21.452960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e54443-6010-46aa-9e36-1c5c825fb53e None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:00:21.453257 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e54443-6010-46aa-9e36-1c5c825fb53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:00:21.472635 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-71e54443-6010-46aa-9e36-1c5c825fb53e None None] MFA Rules not processed for user `1792e79b9c9a47e1923f19bfd2cd495b`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:00:21.473849 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-71e54443-6010-46aa-9e36-1c5c825fb53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:00:21.483283 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1222/2450] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Sep 26 18:00:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:00:21.494383 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7f6cb-0780-4ba0-b6bd-4bb2e0c2d4df None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:00:21.496087 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-ffe7f6cb-0780-4ba0-b6bd-4bb2e0c2d4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:00:21.509572 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7f6cb-0780-4ba0-b6bd-4bb2e0c2d4df None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:00:21.513180 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa81c29-e614-4044-87d1-84ead9b532e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:00:21.513767 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa81c29-e614-4044-87d1-84ead9b532e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:00:21.514050 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa81c29-e614-4044-87d1-84ead9b532e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:00:21.514326 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa81c29-e614-4044-87d1-84ead9b532e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:00:21.524358 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa81c29-e614-4044-87d1-84ead9b532e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:00:21.525814 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa81c29-e614-4044-87d1-84ead9b532e1 service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:00:21.530499 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:00:21.538479 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1229/2451] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:00:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:00:25.849496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f643fa1-b9ac-4336-a46e-d78cf3213d5a None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:00:25.849968 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f643fa1-b9ac-4336-a46e-d78cf3213d5a None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:00:25.850166 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f643fa1-b9ac-4336-a46e-d78cf3213d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:00:25.870419 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-9f643fa1-b9ac-4336-a46e-d78cf3213d5a None None] MFA Rules not processed for user `8475122232ef4d8893f2a9b98768396e`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:00:25.871543 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-9f643fa1-b9ac-4336-a46e-d78cf3213d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:00:25.878767 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1223/2452] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Sep 26 18:00:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:00:25.890768 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa81c29-e614-4044-87d1-84ead9b532e1 service neutron] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:00:25.901903 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa81c29-e614-4044-87d1-84ead9b532e1 service neutron] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:00:25.906923 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c25e1f-cc0c-4d56-99ef-bc780e8e4fe3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea49cd9839474232a0cbe66ccffbf082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:00:25.907910 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c25e1f-cc0c-4d56-99ef-bc780e8e4fe3 service swift] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:00:25.907910 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c25e1f-cc0c-4d56-99ef-bc780e8e4fe3 service swift] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:00:25.908077 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c25e1f-cc0c-4d56-99ef-bc780e8e4fe3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:00:25.916762 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c25e1f-cc0c-4d56-99ef-bc780e8e4fe3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:00:25.918410 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c25e1f-cc0c-4d56-99ef-bc780e8e4fe3 service swift] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:00:25.926410 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1230/2453] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Sep 26 18:00:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 18:00:26.188901 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e22a58-0c3d-4e2b-975a-014d0fc32649 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:00:26.189397 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e22a58-0c3d-4e2b-975a-014d0fc32649 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:00:26.189766 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e22a58-0c3d-4e2b-975a-014d0fc32649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:00:26.210771 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-33e22a58-0c3d-4e2b-975a-014d0fc32649 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:00:26.211966 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-33e22a58-0c3d-4e2b-975a-014d0fc32649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:00:26.220602 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1224/2454] 10.222.0.97 () {58 vars in 1016 bytes} [Mon Sep 26 18:00:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:00:26.238527 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c25e1f-cc0c-4d56-99ef-bc780e8e4fe3 service swift] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:00:26.251545 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c25e1f-cc0c-4d56-99ef-bc780e8e4fe3 service swift] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:00:26.258916 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd18bf2-4651-4779-82f1-8680e93fad63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:00:26.259539 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd18bf2-4651-4779-82f1-8680e93fad63 service nova] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:00:26.259821 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd18bf2-4651-4779-82f1-8680e93fad63 service nova] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:00:26.260211 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd18bf2-4651-4779-82f1-8680e93fad63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:00:26.269929 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd18bf2-4651-4779-82f1-8680e93fad63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:00:26.271529 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd18bf2-4651-4779-82f1-8680e93fad63 service nova] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:00:26.281947 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1231/2455] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:00:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:00:36.204847 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=25 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:00:36.277571 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=13 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:00:47.043291 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e22a58-0c3d-4e2b-975a-014d0fc32649 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:00:47.052856 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e22a58-0c3d-4e2b-975a-014d0fc32649 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:00:47.056387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69838e5a-c4f5-4c13-b477-8dc4d18a1a3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:00:47.056974 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69838e5a-c4f5-4c13-b477-8dc4d18a1a3c service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:00:47.057286 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69838e5a-c4f5-4c13-b477-8dc4d18a1a3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:00:47.057551 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69838e5a-c4f5-4c13-b477-8dc4d18a1a3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:00:47.059263 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-69838e5a-c4f5-4c13-b477-8dc4d18a1a3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:00:47.072649 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69838e5a-c4f5-4c13-b477-8dc4d18a1a3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:00:47.074091 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69838e5a-c4f5-4c13-b477-8dc4d18a1a3c service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:00:47.086534 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1225/2456] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:00:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:00:50.631977 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd18bf2-4651-4779-82f1-8680e93fad63 service nova] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:00:50.641317 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd18bf2-4651-4779-82f1-8680e93fad63 service nova] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:00:50.644840 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce268add-3e2d-4436-b012-a4f64175c8dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:00:50.645454 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce268add-3e2d-4436-b012-a4f64175c8dc service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:00:50.645733 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce268add-3e2d-4436-b012-a4f64175c8dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:00:50.646003 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce268add-3e2d-4436-b012-a4f64175c8dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:00:50.647711 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-ce268add-3e2d-4436-b012-a4f64175c8dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:00:50.661809 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce268add-3e2d-4436-b012-a4f64175c8dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:00:50.663240 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce268add-3e2d-4436-b012-a4f64175c8dc service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:00:50.674581 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1232/2457] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:00:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:00:56.767940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913cfee-85de-461d-93fd-4060018cc8c3 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:00:56.768444 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913cfee-85de-461d-93fd-4060018cc8c3 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:00:56.768538 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913cfee-85de-461d-93fd-4060018cc8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:00:56.787235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-e913cfee-85de-461d-93fd-4060018cc8c3 None None] MFA Rules not processed for user `8475122232ef4d8893f2a9b98768396e`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:00:56.788425 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-e913cfee-85de-461d-93fd-4060018cc8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:00:56.795715 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1226/2458] 10.222.0.62 () {58 vars in 967 bytes} [Mon Sep 26 18:00:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:00:56.817705 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce268add-3e2d-4436-b012-a4f64175c8dc service neutron] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:00:56.829456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce268add-3e2d-4436-b012-a4f64175c8dc service neutron] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:00:56.835410 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda59db2-421d-464e-8d3a-4fe69a947aa7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea49cd9839474232a0cbe66ccffbf082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:00:56.835998 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda59db2-421d-464e-8d3a-4fe69a947aa7 service swift] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:00:56.836297 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda59db2-421d-464e-8d3a-4fe69a947aa7 service swift] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:00:56.836551 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda59db2-421d-464e-8d3a-4fe69a947aa7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:00:56.844762 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda59db2-421d-464e-8d3a-4fe69a947aa7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:00:56.846367 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda59db2-421d-464e-8d3a-4fe69a947aa7 service swift] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:00:56.854321 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1233/2459] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Sep 26 18:00:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 18:01:04.749842 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913cfee-85de-461d-93fd-4060018cc8c3 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:01:04.762543 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913cfee-85de-461d-93fd-4060018cc8c3 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:01:04.768453 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c48ee6-a0a2-496b-aef3-afff26d555c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:01:04.768699 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c48ee6-a0a2-496b-aef3-afff26d555c0 service nova] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:01:04.768978 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c48ee6-a0a2-496b-aef3-afff26d555c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:01:04.769279 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c48ee6-a0a2-496b-aef3-afff26d555c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:01:04.771008 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-31c48ee6-a0a2-496b-aef3-afff26d555c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:01:04.828115 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c48ee6-a0a2-496b-aef3-afff26d555c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:01:04.829768 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c48ee6-a0a2-496b-aef3-afff26d555c0 service nova] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:01:04.838669 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1227/2460] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:01:04 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:01:06.851481 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=12 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:01:14.834466 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=37 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:01:20.477768 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda59db2-421d-464e-8d3a-4fe69a947aa7 service swift] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:01:20.487578 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda59db2-421d-464e-8d3a-4fe69a947aa7 service swift] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:01:20.491264 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3df397-d74d-4586-a33c-d5c85c6ef940 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:01:20.491867 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3df397-d74d-4586-a33c-d5c85c6ef940 service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:01:20.492149 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3df397-d74d-4586-a33c-d5c85c6ef940 service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:01:20.492421 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3df397-d74d-4586-a33c-d5c85c6ef940 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:01:20.494232 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-db3df397-d74d-4586-a33c-d5c85c6ef940 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:01:20.505004 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3df397-d74d-4586-a33c-d5c85c6ef940 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:01:20.506573 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3df397-d74d-4586-a33c-d5c85c6ef940 service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:01:20.515007 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1234/2461] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:01:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:01:27.776876 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c48ee6-a0a2-496b-aef3-afff26d555c0 service nova] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:01:27.778569 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-31c48ee6-a0a2-496b-aef3-afff26d555c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:01:27.793999 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c48ee6-a0a2-496b-aef3-afff26d555c0 service nova] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:01:27.799314 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7097129-5f05-4567-9549-35ca162cdcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:01:27.799957 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7097129-5f05-4567-9549-35ca162cdcf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:01:27.800330 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7097129-5f05-4567-9549-35ca162cdcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:01:27.800495 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7097129-5f05-4567-9549-35ca162cdcf5 admin admin] PATH_INFO: `/v3/users/7c2171475db2491fb587658613feb080` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:01:27.801644 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7097129-5f05-4567-9549-35ca162cdcf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c2171475db2491fb587658613feb080)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:01:27.803590 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7097129-5f05-4567-9549-35ca162cdcf5 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:01:27.851967 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-c7097129-5f05-4567-9549-35ca162cdcf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c2171475db2491fb587658613feb080'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:01:27.852749 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-c7097129-5f05-4567-9549-35ca162cdcf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c2171475db2491fb587658613feb080'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:01:27.853459 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-c7097129-5f05-4567-9549-35ca162cdcf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c2171475db2491fb587658613feb080'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:01:27.861725 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-c7097129-5f05-4567-9549-35ca162cdcf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c2171475db2491fb587658613feb080'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:01:27.868921 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-c7097129-5f05-4567-9549-35ca162cdcf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c2171475db2491fb587658613feb080'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:01:27.887187 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1228/2462] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 18:01:27 2022] DELETE /identity/v3/users/7c2171475db2491fb587658613feb080 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:01:28.066534 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3df397-d74d-4586-a33c-d5c85c6ef940 service neutron] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:01:28.083562 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3df397-d74d-4586-a33c-d5c85c6ef940 service neutron] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:01:28.141372 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360468f6-d7b5-41ec-92a7-d594df4a5d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:01:28.142012 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360468f6-d7b5-41ec-92a7-d594df4a5d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:01:28.142404 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360468f6-d7b5-41ec-92a7-d594df4a5d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:01:28.142684 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360468f6-d7b5-41ec-92a7-d594df4a5d99 admin admin] PATH_INFO: `/v3/projects/6f93c727446e439483aa24b71e2f7ac7` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:01:28.144007 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360468f6-d7b5-41ec-92a7-d594df4a5d99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f93c727446e439483aa24b71e2f7ac7)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:01:28.146011 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360468f6-d7b5-41ec-92a7-d594df4a5d99 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:01:28.190529 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-360468f6-d7b5-41ec-92a7-d594df4a5d99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f93c727446e439483aa24b71e2f7ac7', 'request_id': 'req-360468f6-d7b5-41ec-92a7-d594df4a5d99'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:01:28.195968 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-360468f6-d7b5-41ec-92a7-d594df4a5d99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f93c727446e439483aa24b71e2f7ac7', 'request_id': 'req-360468f6-d7b5-41ec-92a7-d594df4a5d99'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:01:28.203619 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-360468f6-d7b5-41ec-92a7-d594df4a5d99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f93c727446e439483aa24b71e2f7ac7', 'request_id': 'req-360468f6-d7b5-41ec-92a7-d594df4a5d99'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:01:28.214839 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-360468f6-d7b5-41ec-92a7-d594df4a5d99 admin admin] The token cache is being invalidate because project 6f93c727446e439483aa24b71e2f7ac7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:01:28.215125 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-360468f6-d7b5-41ec-92a7-d594df4a5d99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:01:28.215756 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-360468f6-d7b5-41ec-92a7-d594df4a5d99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:01:28.217273 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1235/2463] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:01:28 2022] DELETE /identity/v3/projects/6f93c727446e439483aa24b71e2f7ac7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:01:28.222656 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd67ab3-fbab-42e0-bbdf-c238a93c2eb9 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:01:28.223026 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd67ab3-fbab-42e0-bbdf-c238a93c2eb9 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:01:28.223386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd67ab3-fbab-42e0-bbdf-c238a93c2eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:01:28.243205 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-2fd67ab3-fbab-42e0-bbdf-c238a93c2eb9 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:01:28.244451 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-2fd67ab3-fbab-42e0-bbdf-c238a93c2eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:01:28.304448 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1229/2464] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:01:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:01:28.314127 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b520fe-7538-48a7-8b83-d879c57bafab None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:01:28.314367 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b520fe-7538-48a7-8b83-d879c57bafab None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:01:28.314635 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b520fe-7538-48a7-8b83-d879c57bafab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:01:28.334678 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-d0b520fe-7538-48a7-8b83-d879c57bafab None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:01:28.335871 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-d0b520fe-7538-48a7-8b83-d879c57bafab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:01:28.344050 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1236/2465] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:01:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:01:28.348349 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd67ab3-fbab-42e0-bbdf-c238a93c2eb9 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:01:28.358253 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd67ab3-fbab-42e0-bbdf-c238a93c2eb9 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:01:28.363089 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f6cc0-fc72-4787-9835-48d55141be0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:01:28.363679 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f6cc0-fc72-4787-9835-48d55141be0e admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:01:28.363985 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f6cc0-fc72-4787-9835-48d55141be0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:01:28.364254 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f6cc0-fc72-4787-9835-48d55141be0e admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:01:28.364902 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f6cc0-fc72-4787-9835-48d55141be0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 18:01:28.365233 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f6cc0-fc72-4787-9835-48d55141be0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:01:28.366817 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f6cc0-fc72-4787-9835-48d55141be0e admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:01:28.378873 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1230/2466] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 18:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 18:01:28.383433 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b520fe-7538-48a7-8b83-d879c57bafab None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:01:28.393424 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b520fe-7538-48a7-8b83-d879c57bafab None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:01:28.398202 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e15a7-dadf-4637-a153-68ec7b42a2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:01:28.398805 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e15a7-dadf-4637-a153-68ec7b42a2af admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:01:28.399084 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e15a7-dadf-4637-a153-68ec7b42a2af admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:01:28.399356 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e15a7-dadf-4637-a153-68ec7b42a2af admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:01:28.400014 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e15a7-dadf-4637-a153-68ec7b42a2af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:01:28.402015 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e15a7-dadf-4637-a153-68ec7b42a2af admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:01:28.429937 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1237/2467] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 18:01:28 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:01:28.433990 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f6cc0-fc72-4787-9835-48d55141be0e admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:01:28.444751 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f6cc0-fc72-4787-9835-48d55141be0e admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:01:28.504429 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce32cfe-1b8e-4be5-b799-f6448059ad97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:01:28.505053 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce32cfe-1b8e-4be5-b799-f6448059ad97 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:01:28.505335 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce32cfe-1b8e-4be5-b799-f6448059ad97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:01:28.505603 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce32cfe-1b8e-4be5-b799-f6448059ad97 admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:01:28.506233 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce32cfe-1b8e-4be5-b799-f6448059ad97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:01:28.508138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce32cfe-1b8e-4be5-b799-f6448059ad97 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:01:28.515988 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:01:28.529952 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1231/2468] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 18:01:28 2022] POST /identity/v3/users => generated 285 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:01:28.534136 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e15a7-dadf-4637-a153-68ec7b42a2af admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:01:28.544472 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e15a7-dadf-4637-a153-68ec7b42a2af admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:01:28.549900 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432aab7c-50df-43c9-a2e5-41a9f760a7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:01:28.550489 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432aab7c-50df-43c9-a2e5-41a9f760a7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:01:28.550765 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432aab7c-50df-43c9-a2e5-41a9f760a7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:01:28.551032 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432aab7c-50df-43c9-a2e5-41a9f760a7b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:01:28.551670 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432aab7c-50df-43c9-a2e5-41a9f760a7b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:01:28.553289 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432aab7c-50df-43c9-a2e5-41a9f760a7b1 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:01:28.563601 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1238/2469] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:01:28.567395 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce32cfe-1b8e-4be5-b799-f6448059ad97 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:01:28.577280 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce32cfe-1b8e-4be5-b799-f6448059ad97 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:01:28.581822 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c5ae9-50c4-4158-8f1a-a0b909d4ce44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:01:28.582404 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c5ae9-50c4-4158-8f1a-a0b909d4ce44 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:01:28.582677 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c5ae9-50c4-4158-8f1a-a0b909d4ce44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:01:28.582941 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c5ae9-50c4-4158-8f1a-a0b909d4ce44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:01:28.583712 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c5ae9-50c4-4158-8f1a-a0b909d4ce44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:01:28.585341 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c5ae9-50c4-4158-8f1a-a0b909d4ce44 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:01:28.596065 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1232/2470] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:01:28.600112 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432aab7c-50df-43c9-a2e5-41a9f760a7b1 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:01:28.610787 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432aab7c-50df-43c9-a2e5-41a9f760a7b1 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:01:28.617502 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84597616-1f30-424a-9d68-679a5f57ab26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:01:28.618147 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84597616-1f30-424a-9d68-679a5f57ab26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:01:28.618427 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84597616-1f30-424a-9d68-679a5f57ab26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:01:28.618702 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84597616-1f30-424a-9d68-679a5f57ab26 admin admin] PATH_INFO: `/v3/projects/c048cea6a5524d0b8f5821ebe22fce2b/users/12475a22706b4ef3bdeae16267703057/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:01:28.633769 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84597616-1f30-424a-9d68-679a5f57ab26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c048cea6a5524d0b8f5821ebe22fce2b, user_id=12475a22706b4ef3bdeae16267703057, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:01:28.636440 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84597616-1f30-424a-9d68-679a5f57ab26 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:01:28.649419 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1239/2471] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:01:28 2022] PUT /identity/v3/projects/c048cea6a5524d0b8f5821ebe22fce2b/users/12475a22706b4ef3bdeae16267703057/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:01:28.654421 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95401a6-40e6-401c-8eb6-c3a691642213 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:01:28.654714 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95401a6-40e6-401c-8eb6-c3a691642213 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:01:28.654988 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95401a6-40e6-401c-8eb6-c3a691642213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:01:28.674164 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-a95401a6-40e6-401c-8eb6-c3a691642213 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:01:28.675379 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-a95401a6-40e6-401c-8eb6-c3a691642213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:01:28.736644 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1233/2472] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:01:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:01:28.746255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84597616-1f30-424a-9d68-679a5f57ab26 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:01:28.747981 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-84597616-1f30-424a-9d68-679a5f57ab26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:01:28.762785 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:01:28.811593 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84597616-1f30-424a-9d68-679a5f57ab26 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:01:28.820015 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d8afb-d892-40c5-b9fd-d43dec8420cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:01:28.820550 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d8afb-d892-40c5-b9fd-d43dec8420cb service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:01:28.820830 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d8afb-d892-40c5-b9fd-d43dec8420cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:01:28.821788 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d8afb-d892-40c5-b9fd-d43dec8420cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:01:28.831441 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3d8afb-d892-40c5-b9fd-d43dec8420cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:01:28.832881 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3d8afb-d892-40c5-b9fd-d43dec8420cb service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:01:28.842727 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1240/2473] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:01:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:01:30.499207 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e246a-f777-4bfd-8574-d453e492f9f5 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:01:30.499721 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e246a-f777-4bfd-8574-d453e492f9f5 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:01:30.499721 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e246a-f777-4bfd-8574-d453e492f9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:01:30.520801 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-3f8e246a-f777-4bfd-8574-d453e492f9f5 None None] MFA Rules not processed for user `a3e5d3a7379042d4a04a23effdeba6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:01:30.522079 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-3f8e246a-f777-4bfd-8574-d453e492f9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:01:30.625576 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1234/2474] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:01:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:01:33.262897 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d40109-0380-42c0-8a3f-90c99c20f3a3 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:01:33.263476 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d40109-0380-42c0-8a3f-90c99c20f3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:01:33.263476 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d40109-0380-42c0-8a3f-90c99c20f3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:01:33.298111 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-e5d40109-0380-42c0-8a3f-90c99c20f3a3 None None] MFA Rules not processed for user `12475a22706b4ef3bdeae16267703057`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:01:33.299324 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-e5d40109-0380-42c0-8a3f-90c99c20f3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:01:33.369933 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1241/2475] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:01:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:01:33.371508 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e246a-f777-4bfd-8574-d453e492f9f5 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:01:33.382567 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e246a-f777-4bfd-8574-d453e492f9f5 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:01:33.387472 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede0a6e-b3ae-43ae-bdb4-98ce25e28fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:01:33.393034 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede0a6e-b3ae-43ae-bdb4-98ce25e28fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:01:33.393034 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede0a6e-b3ae-43ae-bdb4-98ce25e28fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:01:33.393034 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede0a6e-b3ae-43ae-bdb4-98ce25e28fa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:01:33.393034 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede0a6e-b3ae-43ae-bdb4-98ce25e28fa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:01:33.393034 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede0a6e-b3ae-43ae-bdb4-98ce25e28fa1 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:01:33.430749 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1235/2476] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 18:01:33 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:01:33.434928 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d40109-0380-42c0-8a3f-90c99c20f3a3 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:01:33.447517 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d40109-0380-42c0-8a3f-90c99c20f3a3 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:01:33.519522 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb2b54-140d-4882-a21a-fb1aaa8d406b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:01:33.520138 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb2b54-140d-4882-a21a-fb1aaa8d406b admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:01:33.520431 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb2b54-140d-4882-a21a-fb1aaa8d406b admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:01:33.520690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb2b54-140d-4882-a21a-fb1aaa8d406b admin admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:01:33.521354 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb2b54-140d-4882-a21a-fb1aaa8d406b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:01:33.523318 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb2b54-140d-4882-a21a-fb1aaa8d406b admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:01:33.552423 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1242/2477] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 18:01:33 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:01:33.557456 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede0a6e-b3ae-43ae-bdb4-98ce25e28fa1 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:01:33.571906 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede0a6e-b3ae-43ae-bdb4-98ce25e28fa1 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:01:33.582336 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4335cb-ec6b-4e91-a398-c5fc27c4fcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:01:33.582972 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4335cb-ec6b-4e91-a398-c5fc27c4fcb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:01:33.583245 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4335cb-ec6b-4e91-a398-c5fc27c4fcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:01:33.584046 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4335cb-ec6b-4e91-a398-c5fc27c4fcb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:01:33.584167 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4335cb-ec6b-4e91-a398-c5fc27c4fcb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:01:33.585931 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4335cb-ec6b-4e91-a398-c5fc27c4fcb8 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:01:33.606623 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1236/2478] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:01:33.613302 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb2b54-140d-4882-a21a-fb1aaa8d406b admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:01:33.628572 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb2b54-140d-4882-a21a-fb1aaa8d406b admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:01:33.634833 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db3e48-aec5-4808-94f2-e99ef4d08589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:01:33.635517 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db3e48-aec5-4808-94f2-e99ef4d08589 admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:01:33.635789 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db3e48-aec5-4808-94f2-e99ef4d08589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:01:33.636056 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db3e48-aec5-4808-94f2-e99ef4d08589 admin admin] PATH_INFO: `/v3/projects/a2a3ae1130874754bdad9c1458aa3abb/users/907718a21b584704b4e0817125102faf/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:01:33.652872 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db3e48-aec5-4808-94f2-e99ef4d08589 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2a3ae1130874754bdad9c1458aa3abb, user_id=907718a21b584704b4e0817125102faf, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:01:33.655588 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db3e48-aec5-4808-94f2-e99ef4d08589 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:01:33.669648 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1243/2479] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:01:33 2022] PUT /identity/v3/projects/a2a3ae1130874754bdad9c1458aa3abb/users/907718a21b584704b4e0817125102faf/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:01:33.674159 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4335cb-ec6b-4e91-a398-c5fc27c4fcb8 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:01:33.685129 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4335cb-ec6b-4e91-a398-c5fc27c4fcb8 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:01:33.735813 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:01:33.747032 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa828e-6eb1-4623-ad2a-563d89b25694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:01:33.747837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa828e-6eb1-4623-ad2a-563d89b25694 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:01:33.748116 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa828e-6eb1-4623-ad2a-563d89b25694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:01:33.748436 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa828e-6eb1-4623-ad2a-563d89b25694 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:01:33.749139 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa828e-6eb1-4623-ad2a-563d89b25694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:01:33.751307 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa828e-6eb1-4623-ad2a-563d89b25694 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:01:33.762344 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1237/2480] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:01:33.766933 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db3e48-aec5-4808-94f2-e99ef4d08589 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:01:33.777732 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db3e48-aec5-4808-94f2-e99ef4d08589 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:01:33.782694 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8db09f-a6db-43b1-8a05-98e6bda0e893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:01:33.783485 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8db09f-a6db-43b1-8a05-98e6bda0e893 admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:01:33.784069 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8db09f-a6db-43b1-8a05-98e6bda0e893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:01:33.786396 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8db09f-a6db-43b1-8a05-98e6bda0e893 admin admin] PATH_INFO: `/v3/projects/a2a3ae1130874754bdad9c1458aa3abb/users/907718a21b584704b4e0817125102faf/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:01:33.787891 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8db09f-a6db-43b1-8a05-98e6bda0e893 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2a3ae1130874754bdad9c1458aa3abb, user_id=907718a21b584704b4e0817125102faf, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:01:33.790660 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8db09f-a6db-43b1-8a05-98e6bda0e893 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:01:33.797701 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:01:33.808195 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1244/2481] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:01:33 2022] PUT /identity/v3/projects/a2a3ae1130874754bdad9c1458aa3abb/users/907718a21b584704b4e0817125102faf/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:01:35.604714 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa828e-6eb1-4623-ad2a-563d89b25694 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:01:35.606438 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-83fa828e-6eb1-4623-ad2a-563d89b25694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:01:35.717994 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa828e-6eb1-4623-ad2a-563d89b25694 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:01:35.817771 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fd1f8-cf77-49df-9e6f-e89a1da6e427 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:01:35.817984 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fd1f8-cf77-49df-9e6f-e89a1da6e427 service nova] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:01:35.818600 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fd1f8-cf77-49df-9e6f-e89a1da6e427 service nova] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:01:35.818939 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fd1f8-cf77-49df-9e6f-e89a1da6e427 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:01:35.821693 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-8d5fd1f8-cf77-49df-9e6f-e89a1da6e427 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:01:35.923376 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5fd1f8-cf77-49df-9e6f-e89a1da6e427 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:01:35.925971 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5fd1f8-cf77-49df-9e6f-e89a1da6e427 service nova] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:01:35.940564 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1238/2482] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:01:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:01:38.503471 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8db09f-a6db-43b1-8a05-98e6bda0e893 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:01:38.528650 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8db09f-a6db-43b1-8a05-98e6bda0e893 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:01:38.545557 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a64c0a-13f6-4eca-9e2a-201513af75f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:01:38.548590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a64c0a-13f6-4eca-9e2a-201513af75f6 service nova] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:01:38.549128 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a64c0a-13f6-4eca-9e2a-201513af75f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:01:38.549660 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a64c0a-13f6-4eca-9e2a-201513af75f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:01:38.552725 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-88a64c0a-13f6-4eca-9e2a-201513af75f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:01:38.573555 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a64c0a-13f6-4eca-9e2a-201513af75f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:01:38.577836 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a64c0a-13f6-4eca-9e2a-201513af75f6 service nova] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:01:38.618912 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1245/2483] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:01:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:01:40.363866 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2dee8-0ec2-48cb-9427-6f86721f0fdb None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:01:40.364375 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2dee8-0ec2-48cb-9427-6f86721f0fdb None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:01:40.364477 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2dee8-0ec2-48cb-9427-6f86721f0fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:01:40.394013 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-73d2dee8-0ec2-48cb-9427-6f86721f0fdb None None] MFA Rules not processed for user `907718a21b584704b4e0817125102faf`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:01:40.395225 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-73d2dee8-0ec2-48cb-9427-6f86721f0fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:01:40.404615 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:01:40.477087 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1239/2484] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:01:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:01:40.491506 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a64c0a-13f6-4eca-9e2a-201513af75f6 service nova] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:01:40.493029 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-88a64c0a-13f6-4eca-9e2a-201513af75f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:01:40.507550 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a64c0a-13f6-4eca-9e2a-201513af75f6 service nova] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:01:40.513125 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb5350-ea5a-4e8b-8d15-2d8577b4248e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:01:40.513728 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb5350-ea5a-4e8b-8d15-2d8577b4248e service nova] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:01:40.514009 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb5350-ea5a-4e8b-8d15-2d8577b4248e service nova] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:01:40.514281 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb5350-ea5a-4e8b-8d15-2d8577b4248e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:01:40.581300 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb5350-ea5a-4e8b-8d15-2d8577b4248e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:01:40.582920 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb5350-ea5a-4e8b-8d15-2d8577b4248e service nova] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:01:40.592281 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1246/2485] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:01:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:01:41.765357 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc030b41-356f-44b0-834e-346189f46880 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:01:41.765852 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc030b41-356f-44b0-834e-346189f46880 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:01:41.765956 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc030b41-356f-44b0-834e-346189f46880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:01:41.787764 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-fc030b41-356f-44b0-834e-346189f46880 None None] MFA Rules not processed for user `12475a22706b4ef3bdeae16267703057`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:01:41.789340 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-fc030b41-356f-44b0-834e-346189f46880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:01:41.798566 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1240/2486] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:01:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:01:50.587998 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=35 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:01:51.781095 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=27 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:02:07.919074 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb5350-ea5a-4e8b-8d15-2d8577b4248e service nova] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:02:07.972833 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb5350-ea5a-4e8b-8d15-2d8577b4248e service nova] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:02:07.976437 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda3144-f40b-40a1-8ddb-4a1df36a202c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:02:07.977061 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda3144-f40b-40a1-8ddb-4a1df36a202c service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:02:07.977339 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda3144-f40b-40a1-8ddb-4a1df36a202c service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:02:07.977604 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda3144-f40b-40a1-8ddb-4a1df36a202c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:02:07.979296 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-8eda3144-f40b-40a1-8ddb-4a1df36a202c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:02:07.989200 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda3144-f40b-40a1-8ddb-4a1df36a202c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:02:07.990638 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda3144-f40b-40a1-8ddb-4a1df36a202c service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:02:07.998312 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1247/2487] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:02:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:02:08.449031 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc030b41-356f-44b0-834e-346189f46880 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:02:08.450430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-fc030b41-356f-44b0-834e-346189f46880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:02:08.522724 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc030b41-356f-44b0-834e-346189f46880 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:02:08.527630 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c74c7-0199-476b-b29a-737cdf74e1eb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5043d835c08458c9f3911a4741bdaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:02:08.528223 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c74c7-0199-476b-b29a-737cdf74e1eb service placement] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:02:08.528498 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c74c7-0199-476b-b29a-737cdf74e1eb service placement] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:02:08.528765 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c74c7-0199-476b-b29a-737cdf74e1eb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:02:08.531003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-780c74c7-0199-476b-b29a-737cdf74e1eb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:02:08.542267 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780c74c7-0199-476b-b29a-737cdf74e1eb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:02:08.543822 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780c74c7-0199-476b-b29a-737cdf74e1eb service placement] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:02:08.554021 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1241/2488] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:02:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:02:17.994843 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=26 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:02:18.550040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=32 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:02:20.371006 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda3144-f40b-40a1-8ddb-4a1df36a202c service neutron] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:02:20.389186 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda3144-f40b-40a1-8ddb-4a1df36a202c service neutron] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:02:20.395717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a6f68-0583-4577-8da7-3e3f8402c340 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:02:20.396323 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a6f68-0583-4577-8da7-3e3f8402c340 service nova] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:02:20.396599 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a6f68-0583-4577-8da7-3e3f8402c340 service nova] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:02:20.396891 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a6f68-0583-4577-8da7-3e3f8402c340 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:02:20.398651 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-ae4a6f68-0583-4577-8da7-3e3f8402c340 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:02:20.411752 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a6f68-0583-4577-8da7-3e3f8402c340 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:02:20.413460 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a6f68-0583-4577-8da7-3e3f8402c340 service nova] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:02:20.424480 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1248/2489] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:02:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:02:23.805122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c74c7-0199-476b-b29a-737cdf74e1eb service placement] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:02:23.818407 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c74c7-0199-476b-b29a-737cdf74e1eb service placement] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:02:23.822036 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320367a9-f469-4523-bf2b-da30c2186d02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:02:23.822629 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320367a9-f469-4523-bf2b-da30c2186d02 service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:02:23.822908 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320367a9-f469-4523-bf2b-da30c2186d02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:02:23.823177 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320367a9-f469-4523-bf2b-da30c2186d02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:02:23.832962 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320367a9-f469-4523-bf2b-da30c2186d02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:02:23.834446 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320367a9-f469-4523-bf2b-da30c2186d02 service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:02:23.845933 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1242/2490] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:02:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:02:28.252196 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a6f68-0583-4577-8da7-3e3f8402c340 service nova] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:02:28.263221 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a6f68-0583-4577-8da7-3e3f8402c340 service nova] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:02:28.269155 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc8ee38-ed4c-46af-a8ae-4b53a856d68d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:02:28.269773 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc8ee38-ed4c-46af-a8ae-4b53a856d68d service nova] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:02:28.270054 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc8ee38-ed4c-46af-a8ae-4b53a856d68d service nova] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:02:28.270324 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc8ee38-ed4c-46af-a8ae-4b53a856d68d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:02:28.272049 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-5dc8ee38-ed4c-46af-a8ae-4b53a856d68d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:02:28.330233 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc8ee38-ed4c-46af-a8ae-4b53a856d68d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:02:28.331874 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc8ee38-ed4c-46af-a8ae-4b53a856d68d service nova] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:02:28.340950 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1249/2491] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:02:28 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:02:33.840046 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=6 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:02:36.602949 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd0632-e795-4e4e-9b18-92b65c2089b4 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:02:36.603552 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd0632-e795-4e4e-9b18-92b65c2089b4 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:02:36.603552 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd0632-e795-4e4e-9b18-92b65c2089b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:02:36.622550 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-30bd0632-e795-4e4e-9b18-92b65c2089b4 None None] MFA Rules not processed for user `2b3ef3111ca1492abd44a59756c99e22`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:02:36.624395 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-30bd0632-e795-4e4e-9b18-92b65c2089b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:02:36.631202 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1243/2492] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:02:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:02:38.336648 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=34 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:02:46.617713 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=3 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:10.764668 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc8ee38-ed4c-46af-a8ae-4b53a856d68d service nova] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:03:10.775883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc8ee38-ed4c-46af-a8ae-4b53a856d68d service nova] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:03:10.781425 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07efd005-cf43-41b1-863e-f12ecd3217d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:03:10.782003 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efd005-cf43-41b1-863e-f12ecd3217d2 service nova] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:03:10.782285 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efd005-cf43-41b1-863e-f12ecd3217d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:03:10.782566 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efd005-cf43-41b1-863e-f12ecd3217d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:03:10.784282 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-07efd005-cf43-41b1-863e-f12ecd3217d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:03:10.842099 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07efd005-cf43-41b1-863e-f12ecd3217d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:03:10.843946 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07efd005-cf43-41b1-863e-f12ecd3217d2 service nova] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:03:10.852985 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1250/2493] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:03:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:03:12.684290 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd0632-e795-4e4e-9b18-92b65c2089b4 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:03:12.700830 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd0632-e795-4e4e-9b18-92b65c2089b4 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:03:12.709094 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571bdaf-086f-47b6-9234-41521245b4d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:03:12.710050 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571bdaf-086f-47b6-9234-41521245b4d8 service nova] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:03:12.710494 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571bdaf-086f-47b6-9234-41521245b4d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:03:12.711046 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571bdaf-086f-47b6-9234-41521245b4d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:03:12.713040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-1571bdaf-086f-47b6-9234-41521245b4d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:03:12.727458 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571bdaf-086f-47b6-9234-41521245b4d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:03:12.729415 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571bdaf-086f-47b6-9234-41521245b4d8 service nova] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:03:12.741361 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1244/2494] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:03:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:03:19.548946 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07efd005-cf43-41b1-863e-f12ecd3217d2 service nova] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:03:19.550816 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-07efd005-cf43-41b1-863e-f12ecd3217d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:03:19.563264 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07efd005-cf43-41b1-863e-f12ecd3217d2 service nova] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:03:19.566960 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efabb7-5f30-45b4-956e-1230a458468c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:03:19.567631 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efabb7-5f30-45b4-956e-1230a458468c service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:03:19.567907 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efabb7-5f30-45b4-956e-1230a458468c service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:03:19.568180 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efabb7-5f30-45b4-956e-1230a458468c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:03:19.570004 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-a3efabb7-5f30-45b4-956e-1230a458468c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:03:19.635730 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3efabb7-5f30-45b4-956e-1230a458468c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:03:19.637199 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3efabb7-5f30-45b4-956e-1230a458468c service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:03:19.647580 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1251/2495] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:03:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:03:20.546691 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcfe3e-040e-4a90-9780-1b0f376bde6a None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:03:20.547182 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcfe3e-040e-4a90-9780-1b0f376bde6a None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:03:20.547366 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcfe3e-040e-4a90-9780-1b0f376bde6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:03:20.567927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-efdcfe3e-040e-4a90-9780-1b0f376bde6a None None] MFA Rules not processed for user `8475122232ef4d8893f2a9b98768396e`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:03:20.569248 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-efdcfe3e-040e-4a90-9780-1b0f376bde6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:03:20.634718 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1245/2496] 10.222.0.62 () {58 vars in 967 bytes} [Mon Sep 26 18:03:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:03:20.693474 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efabb7-5f30-45b4-956e-1230a458468c service neutron] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:03:20.695042 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-a3efabb7-5f30-45b4-956e-1230a458468c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:03:20.776299 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efabb7-5f30-45b4-956e-1230a458468c service neutron] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:03:20.781847 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe53953-3516-4a64-ae60-bff2f165ac85 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea49cd9839474232a0cbe66ccffbf082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:03:20.782485 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe53953-3516-4a64-ae60-bff2f165ac85 service swift] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:03:20.782765 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe53953-3516-4a64-ae60-bff2f165ac85 service swift] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:03:20.783037 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe53953-3516-4a64-ae60-bff2f165ac85 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:03:20.791592 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe53953-3516-4a64-ae60-bff2f165ac85 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:03:20.793207 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe53953-3516-4a64-ae60-bff2f165ac85 service swift] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:03:20.802295 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1252/2497] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Sep 26 18:03:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 18:03:21.147743 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcfe3e-040e-4a90-9780-1b0f376bde6a None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:03:21.159165 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcfe3e-040e-4a90-9780-1b0f376bde6a None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:03:21.162761 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39676a-12c6-4bdf-b57e-9cd268881009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:03:21.163378 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39676a-12c6-4bdf-b57e-9cd268881009 service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:03:21.163662 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39676a-12c6-4bdf-b57e-9cd268881009 service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:03:21.163941 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39676a-12c6-4bdf-b57e-9cd268881009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:03:21.165918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-3d39676a-12c6-4bdf-b57e-9cd268881009 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:03:21.179844 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39676a-12c6-4bdf-b57e-9cd268881009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:03:21.181395 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39676a-12c6-4bdf-b57e-9cd268881009 service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:03:21.192748 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1246/2498] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:03:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:03:23.052994 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe53953-3516-4a64-ae60-bff2f165ac85 service swift] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:03:23.077777 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe53953-3516-4a64-ae60-bff2f165ac85 service swift] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:03:23.089570 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81ff48-7e3e-441c-bf3a-5da7176e1ffa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5043d835c08458c9f3911a4741bdaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:03:23.091112 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81ff48-7e3e-441c-bf3a-5da7176e1ffa service placement] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:03:23.091604 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81ff48-7e3e-441c-bf3a-5da7176e1ffa service placement] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:03:23.092113 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81ff48-7e3e-441c-bf3a-5da7176e1ffa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:03:23.094731 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-0d81ff48-7e3e-441c-bf3a-5da7176e1ffa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:03:23.112582 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81ff48-7e3e-441c-bf3a-5da7176e1ffa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:03:23.114849 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81ff48-7e3e-441c-bf3a-5da7176e1ffa service placement] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:03:23.138053 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1253/2499] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:03:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:03:23.148061 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39676a-12c6-4bdf-b57e-9cd268881009 service neutron] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:03:23.150370 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-3d39676a-12c6-4bdf-b57e-9cd268881009 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:03:23.176855 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39676a-12c6-4bdf-b57e-9cd268881009 service neutron] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:03:23.190752 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4eef35-2ea7-4592-a808-d310d9dd04e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:03:23.191656 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4eef35-2ea7-4592-a808-d310d9dd04e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:03:23.192149 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4eef35-2ea7-4592-a808-d310d9dd04e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:03:23.192737 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4eef35-2ea7-4592-a808-d310d9dd04e0 admin admin] PATH_INFO: `/v3/users/a3e5d3a7379042d4a04a23effdeba6b7` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:03:23.194321 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4eef35-2ea7-4592-a808-d310d9dd04e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3e5d3a7379042d4a04a23effdeba6b7)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:03:23.201489 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4eef35-2ea7-4592-a808-d310d9dd04e0 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:03:23.266115 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-1e4eef35-2ea7-4592-a808-d310d9dd04e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3e5d3a7379042d4a04a23effdeba6b7'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:03:23.267283 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-1e4eef35-2ea7-4592-a808-d310d9dd04e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3e5d3a7379042d4a04a23effdeba6b7'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:03:23.268246 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-1e4eef35-2ea7-4592-a808-d310d9dd04e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3e5d3a7379042d4a04a23effdeba6b7'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:03:23.276675 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-1e4eef35-2ea7-4592-a808-d310d9dd04e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3e5d3a7379042d4a04a23effdeba6b7'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:03:23.290789 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-1e4eef35-2ea7-4592-a808-d310d9dd04e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3e5d3a7379042d4a04a23effdeba6b7'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:03:23.325398 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1247/2500] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 18:03:23 2022] DELETE /identity/v3/users/a3e5d3a7379042d4a04a23effdeba6b7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:03:23.714203 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81ff48-7e3e-441c-bf3a-5da7176e1ffa service placement] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:03:23.729267 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81ff48-7e3e-441c-bf3a-5da7176e1ffa service placement] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:03:23.734432 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:23.792111 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3034d5d-4ea5-4212-8d12-d74041a62e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:03:23.792741 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3034d5d-4ea5-4212-8d12-d74041a62e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:03:23.793028 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3034d5d-4ea5-4212-8d12-d74041a62e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:03:23.793325 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3034d5d-4ea5-4212-8d12-d74041a62e61 admin admin] PATH_INFO: `/v3/projects/982d5b06acd045db881a30eeade94dd3` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:03:23.794511 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3034d5d-4ea5-4212-8d12-d74041a62e61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=982d5b06acd045db881a30eeade94dd3)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:03:23.796540 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3034d5d-4ea5-4212-8d12-d74041a62e61 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:03:23.848811 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-a3034d5d-4ea5-4212-8d12-d74041a62e61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '982d5b06acd045db881a30eeade94dd3', 'request_id': 'req-a3034d5d-4ea5-4212-8d12-d74041a62e61'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:03:23.855158 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-a3034d5d-4ea5-4212-8d12-d74041a62e61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '982d5b06acd045db881a30eeade94dd3', 'request_id': 'req-a3034d5d-4ea5-4212-8d12-d74041a62e61'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:03:23.863340 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-a3034d5d-4ea5-4212-8d12-d74041a62e61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '982d5b06acd045db881a30eeade94dd3', 'request_id': 'req-a3034d5d-4ea5-4212-8d12-d74041a62e61'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:03:23.878844 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-a3034d5d-4ea5-4212-8d12-d74041a62e61 admin admin] The token cache is being invalidate because project 982d5b06acd045db881a30eeade94dd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:03:23.879147 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-a3034d5d-4ea5-4212-8d12-d74041a62e61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:03:23.879944 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-a3034d5d-4ea5-4212-8d12-d74041a62e61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:03:23.882564 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1254/2501] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:03:23 2022] DELETE /identity/v3/projects/982d5b06acd045db881a30eeade94dd3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:03:23.886559 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b4a48-c8c4-4e95-8ead-d28addd46bf8 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:03:23.887091 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b4a48-c8c4-4e95-8ead-d28addd46bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:03:23.887560 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b4a48-c8c4-4e95-8ead-d28addd46bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:03:23.911520 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-1c9b4a48-c8c4-4e95-8ead-d28addd46bf8 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:03:23.912884 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-1c9b4a48-c8c4-4e95-8ead-d28addd46bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:03:23.977540 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:24.005155 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1248/2502] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:03:24.012726 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbc0c0-bd49-41fb-8dfb-01f5dec9942c None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:03:24.013300 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbc0c0-bd49-41fb-8dfb-01f5dec9942c None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:03:24.013679 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbc0c0-bd49-41fb-8dfb-01f5dec9942c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:03:24.040002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-60dbc0c0-bd49-41fb-8dfb-01f5dec9942c None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:03:24.041583 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-60dbc0c0-bd49-41fb-8dfb-01f5dec9942c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:03:24.064700 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1255/2503] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:03:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:03:24.068512 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b4a48-c8c4-4e95-8ead-d28addd46bf8 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:03:24.084409 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b4a48-c8c4-4e95-8ead-d28addd46bf8 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:03:24.090758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0e9a2-b612-49ef-be05-6bdb2fd1dcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:03:24.093149 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0e9a2-b612-49ef-be05-6bdb2fd1dcf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:03:24.093919 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0e9a2-b612-49ef-be05-6bdb2fd1dcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:03:24.094226 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0e9a2-b612-49ef-be05-6bdb2fd1dcf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:03:24.095154 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c0e9a2-b612-49ef-be05-6bdb2fd1dcf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 18:03:24.095469 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c0e9a2-b612-49ef-be05-6bdb2fd1dcf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:03:24.097315 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c0e9a2-b612-49ef-be05-6bdb2fd1dcf9 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:03:24.114549 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1249/2504] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 18:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 18:03:24.118807 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbc0c0-bd49-41fb-8dfb-01f5dec9942c None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:03:24.143443 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbc0c0-bd49-41fb-8dfb-01f5dec9942c None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:03:24.154197 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e99fb0-dae5-4e48-9ef2-2fbaed71f373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:03:24.161500 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e99fb0-dae5-4e48-9ef2-2fbaed71f373 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:03:24.161721 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e99fb0-dae5-4e48-9ef2-2fbaed71f373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:03:24.162012 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e99fb0-dae5-4e48-9ef2-2fbaed71f373 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:03:24.162935 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e99fb0-dae5-4e48-9ef2-2fbaed71f373 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:03:24.165134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e99fb0-dae5-4e48-9ef2-2fbaed71f373 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:03:24.213207 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1256/2505] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 18:03:24 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:03:24.216800 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0e9a2-b612-49ef-be05-6bdb2fd1dcf9 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:03:24.232109 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0e9a2-b612-49ef-be05-6bdb2fd1dcf9 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:03:24.322329 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a66b1-8959-4f01-9f78-9a1528d20e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:03:24.323389 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a66b1-8959-4f01-9f78-9a1528d20e67 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:03:24.324261 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a66b1-8959-4f01-9f78-9a1528d20e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:03:24.324394 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a66b1-8959-4f01-9f78-9a1528d20e67 admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:03:24.325780 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a66b1-8959-4f01-9f78-9a1528d20e67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:03:24.327844 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a66b1-8959-4f01-9f78-9a1528d20e67 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:03:24.357199 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1250/2506] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 18:03:24 2022] POST /identity/v3/users => generated 292 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:03:24.361331 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e99fb0-dae5-4e48-9ef2-2fbaed71f373 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:03:24.375585 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e99fb0-dae5-4e48-9ef2-2fbaed71f373 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:03:24.380010 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bae9f5-baee-48b3-b37a-e15058556bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:03:24.380712 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bae9f5-baee-48b3-b37a-e15058556bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:03:24.381140 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bae9f5-baee-48b3-b37a-e15058556bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:03:24.381481 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bae9f5-baee-48b3-b37a-e15058556bb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:03:24.382201 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bae9f5-baee-48b3-b37a-e15058556bb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:03:24.383964 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bae9f5-baee-48b3-b37a-e15058556bb1 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:03:24.405369 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1257/2507] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 18:03:24.406684 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a66b1-8959-4f01-9f78-9a1528d20e67 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:03:24.416987 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a66b1-8959-4f01-9f78-9a1528d20e67 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:03:24.421836 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38144be0-7392-4a60-890e-c57636d44fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:03:24.422441 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38144be0-7392-4a60-890e-c57636d44fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:03:24.422721 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38144be0-7392-4a60-890e-c57636d44fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:03:24.422995 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38144be0-7392-4a60-890e-c57636d44fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:03:24.423672 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38144be0-7392-4a60-890e-c57636d44fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:03:24.425343 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38144be0-7392-4a60-890e-c57636d44fd9 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:03:24.438521 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1251/2508] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:03:24.442386 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bae9f5-baee-48b3-b37a-e15058556bb1 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:03:24.453305 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bae9f5-baee-48b3-b37a-e15058556bb1 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:03:24.458506 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b4367-afdd-4bac-994c-37df95b3ed1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:03:24.459279 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b4367-afdd-4bac-994c-37df95b3ed1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:03:24.459664 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b4367-afdd-4bac-994c-37df95b3ed1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:03:24.460043 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b4367-afdd-4bac-994c-37df95b3ed1a admin admin] PATH_INFO: `/v3/projects/19d70949231d4af397ba40dc4484e202/users/1d22386e24cb4c079bfe8a2e9a153034/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:03:24.477289 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b4367-afdd-4bac-994c-37df95b3ed1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=19d70949231d4af397ba40dc4484e202, user_id=1d22386e24cb4c079bfe8a2e9a153034, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:03:24.481949 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b4367-afdd-4bac-994c-37df95b3ed1a admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:03:24.508488 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1258/2509] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:03:24 2022] PUT /identity/v3/projects/19d70949231d4af397ba40dc4484e202/users/1d22386e24cb4c079bfe8a2e9a153034/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:03:24.514191 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f042b-c912-469d-8f91-4c8ec28fbcfd None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:03:24.514397 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f042b-c912-469d-8f91-4c8ec28fbcfd None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:03:24.514779 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f042b-c912-469d-8f91-4c8ec28fbcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:03:24.535325 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-4a0f042b-c912-469d-8f91-4c8ec28fbcfd None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:03:24.536548 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-4a0f042b-c912-469d-8f91-4c8ec28fbcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:03:24.600824 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1252/2510] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:03:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:03:24.618927 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b4367-afdd-4bac-994c-37df95b3ed1a admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:03:24.620987 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-3f1b4367-afdd-4bac-994c-37df95b3ed1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:03:24.679261 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:24.699417 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b4367-afdd-4bac-994c-37df95b3ed1a admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:03:24.703815 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d460f89-b35e-4240-a854-2238a0efa2b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:03:24.704434 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d460f89-b35e-4240-a854-2238a0efa2b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:03:24.704717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d460f89-b35e-4240-a854-2238a0efa2b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:03:24.704991 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d460f89-b35e-4240-a854-2238a0efa2b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:03:24.715027 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d460f89-b35e-4240-a854-2238a0efa2b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:03:24.716566 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d460f89-b35e-4240-a854-2238a0efa2b5 service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:03:24.727301 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1259/2511] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:03:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:03:28.611088 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f042b-c912-469d-8f91-4c8ec28fbcfd None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:03:28.613109 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-4a0f042b-c912-469d-8f91-4c8ec28fbcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:03:28.713749 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:28.714404 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d460f89-b35e-4240-a854-2238a0efa2b5 service neutron] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:03:28.719365 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-2d460f89-b35e-4240-a854-2238a0efa2b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:03:28.736450 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d460f89-b35e-4240-a854-2238a0efa2b5 service neutron] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:03:28.744693 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a7c79f-6fc8-4627-ab8a-519829183f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:03:28.746015 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7c79f-6fc8-4627-ab8a-519829183f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:03:28.754259 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7c79f-6fc8-4627-ab8a-519829183f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:03:28.755331 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7c79f-6fc8-4627-ab8a-519829183f03 admin admin] PATH_INFO: `/v3/users/6384580cf2804b39bb9dbca582adcc4d` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:03:28.756960 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a7c79f-6fc8-4627-ab8a-519829183f03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6384580cf2804b39bb9dbca582adcc4d)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:03:28.761431 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a7c79f-6fc8-4627-ab8a-519829183f03 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:03:28.778739 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f042b-c912-469d-8f91-4c8ec28fbcfd None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:03:28.787641 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183fd63-f56c-4387-9757-59a3a3a185e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5043d835c08458c9f3911a4741bdaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:03:28.788547 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183fd63-f56c-4387-9757-59a3a3a185e0 service placement] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:03:28.788833 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183fd63-f56c-4387-9757-59a3a3a185e0 service placement] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:03:28.789229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183fd63-f56c-4387-9757-59a3a3a185e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:03:28.792315 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-1183fd63-f56c-4387-9757-59a3a3a185e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:03:28.825568 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1183fd63-f56c-4387-9757-59a3a3a185e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:03:28.827688 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1183fd63-f56c-4387-9757-59a3a3a185e0 service placement] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:03:28.844845 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1253/2512] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:03:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:03:28.858027 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-42a7c79f-6fc8-4627-ab8a-519829183f03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6384580cf2804b39bb9dbca582adcc4d'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:03:28.878073 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-42a7c79f-6fc8-4627-ab8a-519829183f03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6384580cf2804b39bb9dbca582adcc4d'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:03:28.878982 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-42a7c79f-6fc8-4627-ab8a-519829183f03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6384580cf2804b39bb9dbca582adcc4d'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:03:28.880101 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-42a7c79f-6fc8-4627-ab8a-519829183f03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6384580cf2804b39bb9dbca582adcc4d'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:03:28.903488 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-42a7c79f-6fc8-4627-ab8a-519829183f03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6384580cf2804b39bb9dbca582adcc4d'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:03:28.948225 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1260/2513] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 18:03:28 2022] DELETE /identity/v3/users/6384580cf2804b39bb9dbca582adcc4d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 18:03:29.200316 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183fd63-f56c-4387-9757-59a3a3a185e0 service placement] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:03:29.220272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183fd63-f56c-4387-9757-59a3a3a185e0 service placement] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:03:29.291794 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42757d27-382c-4a6c-b629-e33ce233bade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:03:29.292785 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42757d27-382c-4a6c-b629-e33ce233bade admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:03:29.293260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42757d27-382c-4a6c-b629-e33ce233bade admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:03:29.294310 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42757d27-382c-4a6c-b629-e33ce233bade admin admin] PATH_INFO: `/v3/projects/626632c9969f44af80a374084afbafe2` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:03:29.295556 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42757d27-382c-4a6c-b629-e33ce233bade admin admin] RBAC: Authorizing `identity:delete_project(project_id=626632c9969f44af80a374084afbafe2)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:03:29.297813 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42757d27-382c-4a6c-b629-e33ce233bade admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:03:29.355035 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-42757d27-382c-4a6c-b629-e33ce233bade admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '626632c9969f44af80a374084afbafe2', 'request_id': 'req-42757d27-382c-4a6c-b629-e33ce233bade'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:03:29.362203 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-42757d27-382c-4a6c-b629-e33ce233bade admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '626632c9969f44af80a374084afbafe2', 'request_id': 'req-42757d27-382c-4a6c-b629-e33ce233bade'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:03:29.377728 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-42757d27-382c-4a6c-b629-e33ce233bade admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '626632c9969f44af80a374084afbafe2', 'request_id': 'req-42757d27-382c-4a6c-b629-e33ce233bade'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:03:29.396640 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-42757d27-382c-4a6c-b629-e33ce233bade admin admin] The token cache is being invalidate because project 626632c9969f44af80a374084afbafe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:03:29.396981 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-42757d27-382c-4a6c-b629-e33ce233bade admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:03:29.397780 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-42757d27-382c-4a6c-b629-e33ce233bade admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:03:29.399379 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1254/2514] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:03:29 2022] DELETE /identity/v3/projects/626632c9969f44af80a374084afbafe2 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 18:03:29.403633 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a7c79f-6fc8-4627-ab8a-519829183f03 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:03:29.405691 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-42a7c79f-6fc8-4627-ab8a-519829183f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:03:29.422955 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a7c79f-6fc8-4627-ab8a-519829183f03 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:03:29.494606 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046809d9-53e9-460a-a074-8e5b96608cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:03:29.495677 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046809d9-53e9-460a-a074-8e5b96608cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:03:29.496513 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046809d9-53e9-460a-a074-8e5b96608cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:03:29.498248 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046809d9-53e9-460a-a074-8e5b96608cb7 admin admin] PATH_INFO: `/v3/users/5a6bb4b8e4c34a3da9515e12136f1865` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:03:29.505844 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046809d9-53e9-460a-a074-8e5b96608cb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a6bb4b8e4c34a3da9515e12136f1865)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:03:29.511598 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046809d9-53e9-460a-a074-8e5b96608cb7 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:03:29.578619 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-046809d9-53e9-460a-a074-8e5b96608cb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a6bb4b8e4c34a3da9515e12136f1865'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:03:29.583412 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:29.589972 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-046809d9-53e9-460a-a074-8e5b96608cb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a6bb4b8e4c34a3da9515e12136f1865'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:03:29.591062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-046809d9-53e9-460a-a074-8e5b96608cb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a6bb4b8e4c34a3da9515e12136f1865'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:03:29.592609 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-046809d9-53e9-460a-a074-8e5b96608cb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a6bb4b8e4c34a3da9515e12136f1865'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:03:29.606567 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-046809d9-53e9-460a-a074-8e5b96608cb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a6bb4b8e4c34a3da9515e12136f1865'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:03:29.633202 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1261/2515] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 18:03:29 2022] DELETE /identity/v3/users/5a6bb4b8e4c34a3da9515e12136f1865 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:03:29.876535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42757d27-382c-4a6c-b629-e33ce233bade admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:03:29.877118 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-42757d27-382c-4a6c-b629-e33ce233bade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:03:29.898106 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42757d27-382c-4a6c-b629-e33ce233bade admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:03:29.980464 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e44db-fa8a-4cc2-bccc-37618d2b1993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:03:29.981327 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e44db-fa8a-4cc2-bccc-37618d2b1993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:03:29.981856 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e44db-fa8a-4cc2-bccc-37618d2b1993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:03:29.982243 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e44db-fa8a-4cc2-bccc-37618d2b1993 admin admin] PATH_INFO: `/v3/projects/1d9e2824b94f4edab08089f440657b70` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:03:29.983556 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e44db-fa8a-4cc2-bccc-37618d2b1993 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d9e2824b94f4edab08089f440657b70)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:03:29.985743 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e44db-fa8a-4cc2-bccc-37618d2b1993 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:03:30.012868 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:30.034854 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afbba4d-1794-41d0-a754-28a649b847a8 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:03:30.035307 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afbba4d-1794-41d0-a754-28a649b847a8 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:03:30.035532 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afbba4d-1794-41d0-a754-28a649b847a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:03:30.058426 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-017e44db-fa8a-4cc2-bccc-37618d2b1993 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d9e2824b94f4edab08089f440657b70', 'request_id': 'req-017e44db-fa8a-4cc2-bccc-37618d2b1993'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:03:30.065179 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-017e44db-fa8a-4cc2-bccc-37618d2b1993 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d9e2824b94f4edab08089f440657b70', 'request_id': 'req-017e44db-fa8a-4cc2-bccc-37618d2b1993'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:03:30.075647 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-017e44db-fa8a-4cc2-bccc-37618d2b1993 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d9e2824b94f4edab08089f440657b70', 'request_id': 'req-017e44db-fa8a-4cc2-bccc-37618d2b1993'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:03:30.080331 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-7afbba4d-1794-41d0-a754-28a649b847a8 None None] MFA Rules not processed for user `1d22386e24cb4c079bfe8a2e9a153034`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:03:30.081777 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-7afbba4d-1794-41d0-a754-28a649b847a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:03:30.092823 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-017e44db-fa8a-4cc2-bccc-37618d2b1993 admin admin] The token cache is being invalidate because project 1d9e2824b94f4edab08089f440657b70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:03:30.092823 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-017e44db-fa8a-4cc2-bccc-37618d2b1993 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:03:30.093883 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-017e44db-fa8a-4cc2-bccc-37618d2b1993 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:03:30.095793 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1255/2516] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:03:29 2022] DELETE /identity/v3/projects/1d9e2824b94f4edab08089f440657b70 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:03:30.189168 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1262/2517] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:03:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:03:30.203941 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e44db-fa8a-4cc2-bccc-37618d2b1993 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:03:30.206448 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-017e44db-fa8a-4cc2-bccc-37618d2b1993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:03:30.301351 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e44db-fa8a-4cc2-bccc-37618d2b1993 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:03:30.308180 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229f7da-aec6-41e8-819a-aa185990fb43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:03:30.309815 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229f7da-aec6-41e8-819a-aa185990fb43 service nova] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:03:30.310338 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229f7da-aec6-41e8-819a-aa185990fb43 service nova] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:03:30.310720 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229f7da-aec6-41e8-819a-aa185990fb43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:03:30.325348 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229f7da-aec6-41e8-819a-aa185990fb43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:03:30.325348 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229f7da-aec6-41e8-819a-aa185990fb43 service nova] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:03:30.359281 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1256/2518] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:03:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:03:31.657203 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad13232-d31c-440d-a1d4-731f0936ab38 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:03:31.657689 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad13232-d31c-440d-a1d4-731f0936ab38 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:03:31.657786 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad13232-d31c-440d-a1d4-731f0936ab38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:03:31.677271 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-3ad13232-d31c-440d-a1d4-731f0936ab38 None None] MFA Rules not processed for user `1d22386e24cb4c079bfe8a2e9a153034`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:03:31.678464 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-3ad13232-d31c-440d-a1d4-731f0936ab38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:03:31.686320 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1263/2519] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:03:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:03:38.403199 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e60f6-8445-4ef6-be2e-002d2965b63c None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:03:38.403747 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e60f6-8445-4ef6-be2e-002d2965b63c None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:03:38.403747 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e60f6-8445-4ef6-be2e-002d2965b63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:03:38.435408 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-bd2e60f6-8445-4ef6-be2e-002d2965b63c None None] MFA Rules not processed for user `4313fb69eafa45d2a4f8c0ac5ef47de7`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:03:38.436654 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-bd2e60f6-8445-4ef6-be2e-002d2965b63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:03:38.507090 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1257/2520] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:03:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:03:38.818071 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad13232-d31c-440d-a1d4-731f0936ab38 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:03:38.819076 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-3ad13232-d31c-440d-a1d4-731f0936ab38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:03:38.906468 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad13232-d31c-440d-a1d4-731f0936ab38 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:03:38.910154 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1099b-6aad-4354-b1e6-2d2f49158e46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:03:38.910760 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1099b-6aad-4354-b1e6-2d2f49158e46 service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:03:38.911041 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1099b-6aad-4354-b1e6-2d2f49158e46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:03:38.911313 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1099b-6aad-4354-b1e6-2d2f49158e46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:03:38.913076 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-7fa1099b-6aad-4354-b1e6-2d2f49158e46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:03:38.923243 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1099b-6aad-4354-b1e6-2d2f49158e46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:03:38.924702 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1099b-6aad-4354-b1e6-2d2f49158e46 service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:03:38.932692 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1264/2521] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:03:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:03:48.505300 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:03:48.929170 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=86,keystone:DELETE=2 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:04:47.047864 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e60f6-8445-4ef6-be2e-002d2965b63c None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:04:47.049285 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-bd2e60f6-8445-4ef6-be2e-002d2965b63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:04:47.145379 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e60f6-8445-4ef6-be2e-002d2965b63c None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:04:47.150870 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1cea7-47d9-492f-8fde-d53343754200 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5043d835c08458c9f3911a4741bdaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:04:47.151462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1cea7-47d9-492f-8fde-d53343754200 service placement] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:04:47.151738 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1cea7-47d9-492f-8fde-d53343754200 service placement] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:04:47.152011 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1cea7-47d9-492f-8fde-d53343754200 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:04:47.153811 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-adb1cea7-47d9-492f-8fde-d53343754200 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:04:47.164830 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb1cea7-47d9-492f-8fde-d53343754200 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:04:47.167056 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb1cea7-47d9-492f-8fde-d53343754200 service placement] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:04:47.176613 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1258/2522] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:04:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:04:57.172494 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=44 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:04.995062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9663cf5-459b-4c16-a1be-ec663beea0b2 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:05:04.995791 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9663cf5-459b-4c16-a1be-ec663beea0b2 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:05:04.996275 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9663cf5-459b-4c16-a1be-ec663beea0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:05:05.030671 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-c9663cf5-459b-4c16-a1be-ec663beea0b2 None None] MFA Rules not processed for user `8475122232ef4d8893f2a9b98768396e`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:05:05.031880 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-c9663cf5-459b-4c16-a1be-ec663beea0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:05:05.094433 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1265/2523] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Sep 26 18:05:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:05:05.141120 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1cea7-47d9-492f-8fde-d53343754200 service placement] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:05:05.142514 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-adb1cea7-47d9-492f-8fde-d53343754200 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:05:05.212498 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1cea7-47d9-492f-8fde-d53343754200 service placement] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:05:05.218384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f8f81-bd4e-48ab-9ee2-5867e71d9e0d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea49cd9839474232a0cbe66ccffbf082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:05:05.219024 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f8f81-bd4e-48ab-9ee2-5867e71d9e0d service swift] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:05:05.219307 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f8f81-bd4e-48ab-9ee2-5867e71d9e0d service swift] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:05:05.219579 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f8f81-bd4e-48ab-9ee2-5867e71d9e0d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:05:05.228089 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f8f81-bd4e-48ab-9ee2-5867e71d9e0d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:05:05.229723 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f8f81-bd4e-48ab-9ee2-5867e71d9e0d service swift] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:05:05.237563 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1259/2524] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Sep 26 18:05:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 18:05:15.087941 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=32 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:15.234365 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=32 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:27.380541 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3c64b-1d65-462e-8f2d-8ef67f5908f2 None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:05:27.381403 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3c64b-1d65-462e-8f2d-8ef67f5908f2 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:05:27.381706 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3c64b-1d65-462e-8f2d-8ef67f5908f2 None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:05:27.383753 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1266/2525] 10.222.0.62 () {54 vars in 921 bytes} [Mon Sep 26 18:05:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 18:05:27.390709 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff246e6-daad-4151-9c77-b9a3e05c883d None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:05:27.391259 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff246e6-daad-4151-9c77-b9a3e05c883d None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:05:27.391430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff246e6-daad-4151-9c77-b9a3e05c883d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:05:27.437355 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-8ff246e6-daad-4151-9c77-b9a3e05c883d None None] MFA Rules not processed for user `1792e79b9c9a47e1923f19bfd2cd495b`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:05:27.438674 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-8ff246e6-daad-4151-9c77-b9a3e05c883d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:05:27.458140 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1260/2526] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Sep 26 18:05:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:05:27.470914 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3c64b-1d65-462e-8f2d-8ef67f5908f2 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:05:27.472661 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-01e3c64b-1d65-462e-8f2d-8ef67f5908f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:05:27.532878 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3c64b-1d65-462e-8f2d-8ef67f5908f2 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:05:27.536349 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4c1f1-20c6-425a-bee4-4fcbf24f1a3c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab3b7ac09599477bb0c6c1d32e2d5dbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:05:27.536947 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4c1f1-20c6-425a-bee4-4fcbf24f1a3c service glance] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:05:27.537253 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4c1f1-20c6-425a-bee4-4fcbf24f1a3c service glance] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:05:27.537551 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4c1f1-20c6-425a-bee4-4fcbf24f1a3c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:05:27.548013 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4c1f1-20c6-425a-bee4-4fcbf24f1a3c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:05:27.549458 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4c1f1-20c6-425a-bee4-4fcbf24f1a3c service glance] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:05:27.560635 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1267/2527] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:05:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:05:27.629801 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33dbb1-61ad-4aaf-b286-ba07572fac0f None None] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:05:27.630084 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33dbb1-61ad-4aaf-b286-ba07572fac0f None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:05:27.630354 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33dbb1-61ad-4aaf-b286-ba07572fac0f None None] PATH_INFO: `/` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:05:27.631785 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1261/2528] 10.222.0.62 () {54 vars in 921 bytes} [Mon Sep 26 18:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 18:05:27.636425 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecbbc0a-e84f-4afe-bb09-587d5f70bc8c None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:05:27.636709 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecbbc0a-e84f-4afe-bb09-587d5f70bc8c None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:05:27.637002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecbbc0a-e84f-4afe-bb09-587d5f70bc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:05:27.668180 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-aecbbc0a-e84f-4afe-bb09-587d5f70bc8c None None] MFA Rules not processed for user `a0ed50f4edcf468192a053b1e0fd6910`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:05:27.669414 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-aecbbc0a-e84f-4afe-bb09-587d5f70bc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:05:27.685955 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1268/2529] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Sep 26 18:05:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:05:27.698587 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33dbb1-61ad-4aaf-b286-ba07572fac0f None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:05:27.709285 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33dbb1-61ad-4aaf-b286-ba07572fac0f None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:05:27.712829 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec3681-ab5f-4338-bdd0-683ccea8a4fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:05:27.713520 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec3681-ab5f-4338-bdd0-683ccea8a4fa service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:05:27.713792 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec3681-ab5f-4338-bdd0-683ccea8a4fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:05:27.714060 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec3681-ab5f-4338-bdd0-683ccea8a4fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:05:27.721197 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec3681-ab5f-4338-bdd0-683ccea8a4fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:05:27.722623 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec3681-ab5f-4338-bdd0-683ccea8a4fa service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:05:27.730803 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1262/2530] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:05:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:05:27.812500 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81b5b9-e10c-4f4d-9473-71f57c93ae8b None None] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:05:27.812794 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81b5b9-e10c-4f4d-9473-71f57c93ae8b None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:05:27.813093 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81b5b9-e10c-4f4d-9473-71f57c93ae8b None None] PATH_INFO: `/` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:05:27.814530 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1269/2531] 10.222.0.62 () {54 vars in 921 bytes} [Mon Sep 26 18:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 18:05:27.819192 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353edd4f-1a79-41bd-a024-21e64b11bc92 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:05:27.819479 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353edd4f-1a79-41bd-a024-21e64b11bc92 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:05:27.819785 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353edd4f-1a79-41bd-a024-21e64b11bc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:05:27.839310 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-353edd4f-1a79-41bd-a024-21e64b11bc92 None None] MFA Rules not processed for user `1792e79b9c9a47e1923f19bfd2cd495b`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:05:27.840497 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-353edd4f-1a79-41bd-a024-21e64b11bc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:05:27.850592 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1263/2532] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Sep 26 18:05:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:05:27.861439 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81b5b9-e10c-4f4d-9473-71f57c93ae8b None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:05:27.873106 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81b5b9-e10c-4f4d-9473-71f57c93ae8b None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:05:27.876708 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf6b71-19ac-4760-8f58-77603b22ab19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:05:27.877351 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf6b71-19ac-4760-8f58-77603b22ab19 service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:05:27.877630 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf6b71-19ac-4760-8f58-77603b22ab19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:05:27.877900 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf6b71-19ac-4760-8f58-77603b22ab19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:05:27.888236 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf6b71-19ac-4760-8f58-77603b22ab19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:05:27.889643 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf6b71-19ac-4760-8f58-77603b22ab19 service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:05:27.900197 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1270/2533] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:05:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 18:05:29.704750 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b5882-4b8b-43a7-afc9-f6178ba3447c None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:05:29.705291 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b5882-4b8b-43a7-afc9-f6178ba3447c None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:05:29.705538 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b5882-4b8b-43a7-afc9-f6178ba3447c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:05:29.736263 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-1a7b5882-4b8b-43a7-afc9-f6178ba3447c None None] MFA Rules not processed for user `8475122232ef4d8893f2a9b98768396e`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:05:29.738253 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-1a7b5882-4b8b-43a7-afc9-f6178ba3447c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:05:29.750588 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1264/2534] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Sep 26 18:05:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:05:29.763313 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf6b71-19ac-4760-8f58-77603b22ab19 service neutron] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:05:29.775212 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf6b71-19ac-4760-8f58-77603b22ab19 service neutron] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:05:29.780422 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90994bee-f039-436a-a4d0-bfa4d133f2e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea49cd9839474232a0cbe66ccffbf082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:05:29.781058 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90994bee-f039-436a-a4d0-bfa4d133f2e2 service swift] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:05:29.781342 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90994bee-f039-436a-a4d0-bfa4d133f2e2 service swift] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:05:29.781613 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90994bee-f039-436a-a4d0-bfa4d133f2e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:05:29.790615 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90994bee-f039-436a-a4d0-bfa4d133f2e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:05:29.792212 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90994bee-f039-436a-a4d0-bfa4d133f2e2 service swift] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:05:29.800595 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1271/2535] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Sep 26 18:05:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 18:05:39.725899 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=28 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:39.797196 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=50 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:05:48.492977 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b5882-4b8b-43a7-afc9-f6178ba3447c None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:05:48.494570 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-1a7b5882-4b8b-43a7-afc9-f6178ba3447c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:05:48.505786 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b5882-4b8b-43a7-afc9-f6178ba3447c None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:05:48.509976 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49152ad1-5737-4b44-b891-b1e830967b0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:05:48.510589 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49152ad1-5737-4b44-b891-b1e830967b0a service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:05:48.510870 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49152ad1-5737-4b44-b891-b1e830967b0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:05:48.511142 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49152ad1-5737-4b44-b891-b1e830967b0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:05:48.512865 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-49152ad1-5737-4b44-b891-b1e830967b0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:05:48.526008 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49152ad1-5737-4b44-b891-b1e830967b0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:05:48.527438 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49152ad1-5737-4b44-b891-b1e830967b0a service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:05:48.538245 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1265/2536] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:05:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:05:50.606808 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90994bee-f039-436a-a4d0-bfa4d133f2e2 service swift] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:05:50.608242 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-90994bee-f039-436a-a4d0-bfa4d133f2e2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:05:50.688880 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90994bee-f039-436a-a4d0-bfa4d133f2e2 service swift] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:05:50.692460 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf657f9c-d59d-406a-b250-41d9aa09c9e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:05:50.693096 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf657f9c-d59d-406a-b250-41d9aa09c9e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:05:50.693383 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf657f9c-d59d-406a-b250-41d9aa09c9e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:05:50.693660 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf657f9c-d59d-406a-b250-41d9aa09c9e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:05:50.695425 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-cf657f9c-d59d-406a-b250-41d9aa09c9e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:05:50.708731 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf657f9c-d59d-406a-b250-41d9aa09c9e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:05:50.710701 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf657f9c-d59d-406a-b250-41d9aa09c9e7 service cinder] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:05:50.721866 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1272/2537] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:05:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:05:52.411171 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49152ad1-5737-4b44-b891-b1e830967b0a service neutron] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:05:52.430184 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49152ad1-5737-4b44-b891-b1e830967b0a service neutron] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:05:52.433934 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3c454-1b91-436b-ad0f-558512820298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:05:52.434739 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3c454-1b91-436b-ad0f-558512820298 service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:05:52.436648 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3c454-1b91-436b-ad0f-558512820298 service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:05:52.436920 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3c454-1b91-436b-ad0f-558512820298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:05:52.439851 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-02d3c454-1b91-436b-ad0f-558512820298 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:05:52.451533 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3c454-1b91-436b-ad0f-558512820298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:05:52.453230 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3c454-1b91-436b-ad0f-558512820298 service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:05:52.461880 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1266/2538] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:05:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:05:52.545960 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf657f9c-d59d-406a-b250-41d9aa09c9e7 service cinder] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:05:52.562439 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf657f9c-d59d-406a-b250-41d9aa09c9e7 service cinder] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:05:52.566136 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a100fe0-d520-4995-a748-d28d8cd15b06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:05:52.566733 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a100fe0-d520-4995-a748-d28d8cd15b06 service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:05:52.567071 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a100fe0-d520-4995-a748-d28d8cd15b06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:05:52.567345 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a100fe0-d520-4995-a748-d28d8cd15b06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:05:52.569146 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-2a100fe0-d520-4995-a748-d28d8cd15b06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:05:52.583966 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a100fe0-d520-4995-a748-d28d8cd15b06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:05:52.585542 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a100fe0-d520-4995-a748-d28d8cd15b06 service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:05:52.596777 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1273/2539] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:05:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:05:54.095900 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4895f34-0a05-4d6b-bf95-d9418eb25f49 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:05:54.096360 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4895f34-0a05-4d6b-bf95-d9418eb25f49 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:05:54.096463 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4895f34-0a05-4d6b-bf95-d9418eb25f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:05:54.115339 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-a4895f34-0a05-4d6b-bf95-d9418eb25f49 None None] MFA Rules not processed for user `1d22386e24cb4c079bfe8a2e9a153034`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:05:54.117222 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-a4895f34-0a05-4d6b-bf95-d9418eb25f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:05:54.124010 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1267/2540] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:05:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:05:55.124512 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcdd876-7eb6-40e0-b0ce-305f36280a85 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:05:55.125415 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcdd876-7eb6-40e0-b0ce-305f36280a85 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:05:55.126515 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcdd876-7eb6-40e0-b0ce-305f36280a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:05:55.151142 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-7fcdd876-7eb6-40e0-b0ce-305f36280a85 None None] MFA Rules not processed for user `8475122232ef4d8893f2a9b98768396e`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:05:55.152609 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-7fcdd876-7eb6-40e0-b0ce-305f36280a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:05:55.176722 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1274/2541] 10.222.0.62 () {58 vars in 967 bytes} [Mon Sep 26 18:05:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:05:55.177839 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4895f34-0a05-4d6b-bf95-d9418eb25f49 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:05:55.207330 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4895f34-0a05-4d6b-bf95-d9418eb25f49 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:05:55.215291 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b261028e-e3c9-4930-9d56-240a41967163 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea49cd9839474232a0cbe66ccffbf082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:05:55.215916 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261028e-e3c9-4930-9d56-240a41967163 service swift] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:05:55.216241 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261028e-e3c9-4930-9d56-240a41967163 service swift] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:05:55.216454 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261028e-e3c9-4930-9d56-240a41967163 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:05:55.230408 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b261028e-e3c9-4930-9d56-240a41967163 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:05:55.232292 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b261028e-e3c9-4930-9d56-240a41967163 service swift] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:05:55.250840 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1268/2542] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Sep 26 18:05:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 18:06:05.143739 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=44 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:05.237786 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=21 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:20.673639 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcdd876-7eb6-40e0-b0ce-305f36280a85 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:20.683457 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcdd876-7eb6-40e0-b0ce-305f36280a85 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:20.687033 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260440b7-bf9b-49c6-8cd7-739b7bed4184 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:20.687624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260440b7-bf9b-49c6-8cd7-739b7bed4184 service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:20.687900 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260440b7-bf9b-49c6-8cd7-739b7bed4184 service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:20.688167 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260440b7-bf9b-49c6-8cd7-739b7bed4184 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:20.689866 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-260440b7-bf9b-49c6-8cd7-739b7bed4184 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:20.774208 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260440b7-bf9b-49c6-8cd7-739b7bed4184 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:20.775611 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260440b7-bf9b-49c6-8cd7-739b7bed4184 service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:20.794583 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1275/2543] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:06:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:06:23.938691 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b261028e-e3c9-4930-9d56-240a41967163 service swift] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:23.940175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-b261028e-e3c9-4930-9d56-240a41967163 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:23.954952 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b261028e-e3c9-4930-9d56-240a41967163 service swift] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:23.959531 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c625dc-d17c-4e73-b362-8507526a3ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:23.960156 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c625dc-d17c-4e73-b362-8507526a3ff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:23.960434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c625dc-d17c-4e73-b362-8507526a3ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:23.960756 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c625dc-d17c-4e73-b362-8507526a3ff8 admin admin] PATH_INFO: `/v3/users/4313fb69eafa45d2a4f8c0ac5ef47de7` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:23.975626 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c625dc-d17c-4e73-b362-8507526a3ff8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4313fb69eafa45d2a4f8c0ac5ef47de7)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:23.977922 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c625dc-d17c-4e73-b362-8507526a3ff8 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:24.024379 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-12c625dc-d17c-4e73-b362-8507526a3ff8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4313fb69eafa45d2a4f8c0ac5ef47de7'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:24.025004 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-12c625dc-d17c-4e73-b362-8507526a3ff8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4313fb69eafa45d2a4f8c0ac5ef47de7'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:24.025622 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-12c625dc-d17c-4e73-b362-8507526a3ff8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4313fb69eafa45d2a4f8c0ac5ef47de7'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:24.032537 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-12c625dc-d17c-4e73-b362-8507526a3ff8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4313fb69eafa45d2a4f8c0ac5ef47de7'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:24.040767 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-12c625dc-d17c-4e73-b362-8507526a3ff8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4313fb69eafa45d2a4f8c0ac5ef47de7'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:24.058917 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1269/2544] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 18:06:23 2022] DELETE /identity/v3/users/4313fb69eafa45d2a4f8c0ac5ef47de7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:06:24.237950 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260440b7-bf9b-49c6-8cd7-739b7bed4184 service neutron] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:24.250592 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260440b7-bf9b-49c6-8cd7-739b7bed4184 service neutron] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:24.309756 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec4cf0-a9d7-4577-bf2d-f2338577a0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:24.310387 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec4cf0-a9d7-4577-bf2d-f2338577a0f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:24.310668 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec4cf0-a9d7-4577-bf2d-f2338577a0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:24.310942 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec4cf0-a9d7-4577-bf2d-f2338577a0f2 admin admin] PATH_INFO: `/v3/projects/3783159882724c00acb1604e806fd127` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:24.321901 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec4cf0-a9d7-4577-bf2d-f2338577a0f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3783159882724c00acb1604e806fd127)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:24.323910 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec4cf0-a9d7-4577-bf2d-f2338577a0f2 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:24.371566 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-adec4cf0-a9d7-4577-bf2d-f2338577a0f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3783159882724c00acb1604e806fd127', 'request_id': 'req-adec4cf0-a9d7-4577-bf2d-f2338577a0f2'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:24.377392 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-adec4cf0-a9d7-4577-bf2d-f2338577a0f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3783159882724c00acb1604e806fd127', 'request_id': 'req-adec4cf0-a9d7-4577-bf2d-f2338577a0f2'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:24.379173 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:24.386498 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-adec4cf0-a9d7-4577-bf2d-f2338577a0f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3783159882724c00acb1604e806fd127', 'request_id': 'req-adec4cf0-a9d7-4577-bf2d-f2338577a0f2'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:24.399660 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-adec4cf0-a9d7-4577-bf2d-f2338577a0f2 admin admin] The token cache is being invalidate because project 3783159882724c00acb1604e806fd127 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:06:24.399946 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-adec4cf0-a9d7-4577-bf2d-f2338577a0f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:24.400610 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-adec4cf0-a9d7-4577-bf2d-f2338577a0f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:24.402111 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1276/2545] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:06:24 2022] DELETE /identity/v3/projects/3783159882724c00acb1604e806fd127 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:06:24.407140 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7903031-8589-48ad-a2cf-fe5121b98cd5 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:24.407427 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7903031-8589-48ad-a2cf-fe5121b98cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:24.407702 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7903031-8589-48ad-a2cf-fe5121b98cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:24.455576 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-c7903031-8589-48ad-a2cf-fe5121b98cd5 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:06:24.456790 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-c7903031-8589-48ad-a2cf-fe5121b98cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:24.516348 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1270/2546] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 18:06:24.524503 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2461630-c51b-42e4-8106-594644db9cd3 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:24.524783 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2461630-c51b-42e4-8106-594644db9cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:24.525101 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2461630-c51b-42e4-8106-594644db9cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:24.548430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-a2461630-c51b-42e4-8106-594644db9cd3 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:06:24.549707 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-a2461630-c51b-42e4-8106-594644db9cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:24.557600 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1277/2547] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:06:24.561979 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7903031-8589-48ad-a2cf-fe5121b98cd5 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:24.571685 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7903031-8589-48ad-a2cf-fe5121b98cd5 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:24.576400 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb67cf7-d819-475f-9d36-a97452068ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:24.577088 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb67cf7-d819-475f-9d36-a97452068ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:24.577309 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb67cf7-d819-475f-9d36-a97452068ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:24.577581 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb67cf7-d819-475f-9d36-a97452068ae7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:24.578232 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb67cf7-d819-475f-9d36-a97452068ae7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 18:06:24.578537 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb67cf7-d819-475f-9d36-a97452068ae7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:24.580139 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb67cf7-d819-475f-9d36-a97452068ae7 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:24.592481 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1271/2548] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 18:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 18:06:24.596893 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2461630-c51b-42e4-8106-594644db9cd3 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:24.606920 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2461630-c51b-42e4-8106-594644db9cd3 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:24.611548 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c28ab-8fa5-4ff2-867d-6ade4f556ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:24.612139 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c28ab-8fa5-4ff2-867d-6ade4f556ef6 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:24.612437 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c28ab-8fa5-4ff2-867d-6ade4f556ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:24.612703 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c28ab-8fa5-4ff2-867d-6ade4f556ef6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:24.613385 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56c28ab-8fa5-4ff2-867d-6ade4f556ef6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:24.615263 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56c28ab-8fa5-4ff2-867d-6ade4f556ef6 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:24.651018 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1278/2549] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 18:06:24 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:06:24.655208 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb67cf7-d819-475f-9d36-a97452068ae7 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:24.665771 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb67cf7-d819-475f-9d36-a97452068ae7 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:24.689424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:24.724962 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ad882-a232-478f-9ed9-c8fb4f94cb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:24.725592 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ad882-a232-478f-9ed9-c8fb4f94cb4f admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:24.725868 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ad882-a232-478f-9ed9-c8fb4f94cb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:24.726132 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ad882-a232-478f-9ed9-c8fb4f94cb4f admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:24.726753 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ad882-a232-478f-9ed9-c8fb4f94cb4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:24.728654 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ad882-a232-478f-9ed9-c8fb4f94cb4f admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:24.751334 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1272/2550] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 18:06:24 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:06:24.756024 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c28ab-8fa5-4ff2-867d-6ade4f556ef6 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:24.766481 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c28ab-8fa5-4ff2-867d-6ade4f556ef6 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:24.771654 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4fb25-7fdc-4100-9d0f-09799f4fc964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:24.772247 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4fb25-7fdc-4100-9d0f-09799f4fc964 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:24.772519 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4fb25-7fdc-4100-9d0f-09799f4fc964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:24.773021 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4fb25-7fdc-4100-9d0f-09799f4fc964 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:24.773460 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f4fb25-7fdc-4100-9d0f-09799f4fc964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:24.775037 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f4fb25-7fdc-4100-9d0f-09799f4fc964 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:24.784860 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1279/2551] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:06:24.788899 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ad882-a232-478f-9ed9-c8fb4f94cb4f admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:24.799145 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ad882-a232-478f-9ed9-c8fb4f94cb4f admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:24.803827 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4f286-9b27-4822-93c1-092deb7d925e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:24.804420 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4f286-9b27-4822-93c1-092deb7d925e admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:24.804697 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4f286-9b27-4822-93c1-092deb7d925e admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:24.804965 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4f286-9b27-4822-93c1-092deb7d925e admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:24.805635 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4f286-9b27-4822-93c1-092deb7d925e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:24.807235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4f286-9b27-4822-93c1-092deb7d925e admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:24.818306 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1273/2552] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:06:24.822581 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4fb25-7fdc-4100-9d0f-09799f4fc964 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:24.832418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4fb25-7fdc-4100-9d0f-09799f4fc964 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:24.837671 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478ef7e-c43c-4ba4-aa80-f6ea51afae84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:24.838315 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478ef7e-c43c-4ba4-aa80-f6ea51afae84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:24.838596 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478ef7e-c43c-4ba4-aa80-f6ea51afae84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:24.838880 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478ef7e-c43c-4ba4-aa80-f6ea51afae84 admin admin] PATH_INFO: `/v3/projects/4cdc4fcd4456484a991c7dc74ce83dcb/users/4d1933ce05f44bbdafa148fefbd3a371/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:24.854156 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478ef7e-c43c-4ba4-aa80-f6ea51afae84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cdc4fcd4456484a991c7dc74ce83dcb, user_id=4d1933ce05f44bbdafa148fefbd3a371, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:24.856819 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478ef7e-c43c-4ba4-aa80-f6ea51afae84 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:24.869842 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1280/2553] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:06:24 2022] PUT /identity/v3/projects/4cdc4fcd4456484a991c7dc74ce83dcb/users/4d1933ce05f44bbdafa148fefbd3a371/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:06:24.881701 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdccfcc-8474-4d9b-9a51-e11b9bff6315 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:24.882052 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdccfcc-8474-4d9b-9a51-e11b9bff6315 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:24.882249 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdccfcc-8474-4d9b-9a51-e11b9bff6315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:24.910315 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-ecdccfcc-8474-4d9b-9a51-e11b9bff6315 None None] MFA Rules not processed for user `4d1933ce05f44bbdafa148fefbd3a371`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:06:24.911440 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-ecdccfcc-8474-4d9b-9a51-e11b9bff6315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:24.976127 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1274/2554] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:06:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:06:24.987474 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478ef7e-c43c-4ba4-aa80-f6ea51afae84 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:24.989191 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-b478ef7e-c43c-4ba4-aa80-f6ea51afae84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:25.062951 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478ef7e-c43c-4ba4-aa80-f6ea51afae84 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:25.068478 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a8590-1563-47c9-a08f-2649033e1cda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:25.069103 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a8590-1563-47c9-a08f-2649033e1cda service nova] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:25.069382 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a8590-1563-47c9-a08f-2649033e1cda service nova] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:25.069650 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a8590-1563-47c9-a08f-2649033e1cda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:25.077423 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a8590-1563-47c9-a08f-2649033e1cda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:25.079008 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a8590-1563-47c9-a08f-2649033e1cda service nova] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:25.088589 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1281/2555] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:06:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:06:30.307159 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdccfcc-8474-4d9b-9a51-e11b9bff6315 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:30.371785 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdccfcc-8474-4d9b-9a51-e11b9bff6315 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:30.376438 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc6746-fef4-4140-85e8-dfd40054c280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:30.377138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc6746-fef4-4140-85e8-dfd40054c280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:30.377417 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc6746-fef4-4140-85e8-dfd40054c280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:30.377687 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc6746-fef4-4140-85e8-dfd40054c280 admin admin] PATH_INFO: `/v3/users/4d1933ce05f44bbdafa148fefbd3a371` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:30.378858 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc6746-fef4-4140-85e8-dfd40054c280 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d1933ce05f44bbdafa148fefbd3a371)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:30.381967 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc6746-fef4-4140-85e8-dfd40054c280 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:30.421497 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:30.432755 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-62bc6746-fef4-4140-85e8-dfd40054c280 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d1933ce05f44bbdafa148fefbd3a371'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:30.433450 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-62bc6746-fef4-4140-85e8-dfd40054c280 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d1933ce05f44bbdafa148fefbd3a371'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:30.434051 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-62bc6746-fef4-4140-85e8-dfd40054c280 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d1933ce05f44bbdafa148fefbd3a371'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:30.441038 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-62bc6746-fef4-4140-85e8-dfd40054c280 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d1933ce05f44bbdafa148fefbd3a371'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:30.449351 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-62bc6746-fef4-4140-85e8-dfd40054c280 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d1933ce05f44bbdafa148fefbd3a371'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:30.466946 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1275/2556] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 18:06:30 2022] DELETE /identity/v3/users/4d1933ce05f44bbdafa148fefbd3a371 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:06:30.471408 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb15cfe-ef9b-4c5b-a293-39b6b15be547 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:30.471864 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb15cfe-ef9b-4c5b-a293-39b6b15be547 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:30.471994 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb15cfe-ef9b-4c5b-a293-39b6b15be547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:30.491342 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-9cb15cfe-ef9b-4c5b-a293-39b6b15be547 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:06:30.492542 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-9cb15cfe-ef9b-4c5b-a293-39b6b15be547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:30.542034 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:30.555348 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1282/2557] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:06:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:06:30.561815 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc6746-fef4-4140-85e8-dfd40054c280 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:30.563232 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-62bc6746-fef4-4140-85e8-dfd40054c280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:30.619963 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc6746-fef4-4140-85e8-dfd40054c280 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:30.623651 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9df4d-9d15-495d-a67e-cad52bdb54be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:30.624189 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9df4d-9d15-495d-a67e-cad52bdb54be service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:30.624464 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9df4d-9d15-495d-a67e-cad52bdb54be service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:30.624732 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9df4d-9d15-495d-a67e-cad52bdb54be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:30.634498 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9df4d-9d15-495d-a67e-cad52bdb54be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:30.635919 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9df4d-9d15-495d-a67e-cad52bdb54be service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:30.645123 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1276/2558] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:06:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:06:30.924588 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb15cfe-ef9b-4c5b-a293-39b6b15be547 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:30.926228 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-9cb15cfe-ef9b-4c5b-a293-39b6b15be547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:30.939621 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb15cfe-ef9b-4c5b-a293-39b6b15be547 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:30.945180 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459fbea-9f40-4f90-9b5c-b44c8b1f59d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:30.945848 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459fbea-9f40-4f90-9b5c-b44c8b1f59d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:30.946129 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459fbea-9f40-4f90-9b5c-b44c8b1f59d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:30.946402 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459fbea-9f40-4f90-9b5c-b44c8b1f59d0 admin admin] PATH_INFO: `/v3/projects/4cdc4fcd4456484a991c7dc74ce83dcb` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:30.947609 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459fbea-9f40-4f90-9b5c-b44c8b1f59d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cdc4fcd4456484a991c7dc74ce83dcb)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:30.949585 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459fbea-9f40-4f90-9b5c-b44c8b1f59d0 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:31.001753 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-4459fbea-9f40-4f90-9b5c-b44c8b1f59d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cdc4fcd4456484a991c7dc74ce83dcb', 'request_id': 'req-4459fbea-9f40-4f90-9b5c-b44c8b1f59d0'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:31.008299 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-4459fbea-9f40-4f90-9b5c-b44c8b1f59d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cdc4fcd4456484a991c7dc74ce83dcb', 'request_id': 'req-4459fbea-9f40-4f90-9b5c-b44c8b1f59d0'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:31.015856 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-4459fbea-9f40-4f90-9b5c-b44c8b1f59d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cdc4fcd4456484a991c7dc74ce83dcb', 'request_id': 'req-4459fbea-9f40-4f90-9b5c-b44c8b1f59d0'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:31.028018 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-4459fbea-9f40-4f90-9b5c-b44c8b1f59d0 admin admin] The token cache is being invalidate because project 4cdc4fcd4456484a991c7dc74ce83dcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:06:31.028310 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-4459fbea-9f40-4f90-9b5c-b44c8b1f59d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:31.028960 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-4459fbea-9f40-4f90-9b5c-b44c8b1f59d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:31.030492 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1283/2559] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:06:30 2022] DELETE /identity/v3/projects/4cdc4fcd4456484a991c7dc74ce83dcb => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:06:31.035604 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71004d-eb50-476c-8227-049dbe8db0d6 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:31.035916 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71004d-eb50-476c-8227-049dbe8db0d6 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:31.036241 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71004d-eb50-476c-8227-049dbe8db0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:31.056047 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-ca71004d-eb50-476c-8227-049dbe8db0d6 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:06:31.057319 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-ca71004d-eb50-476c-8227-049dbe8db0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:31.116283 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1277/2560] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:06:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 18:06:31.124158 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965b09d-b00c-4f4e-ab1b-9b77889f57ab None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:31.124443 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965b09d-b00c-4f4e-ab1b-9b77889f57ab None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:31.124721 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965b09d-b00c-4f4e-ab1b-9b77889f57ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:31.144561 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-3965b09d-b00c-4f4e-ab1b-9b77889f57ab None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:06:31.146310 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-3965b09d-b00c-4f4e-ab1b-9b77889f57ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:31.154101 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1284/2561] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:06:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:06:31.158634 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71004d-eb50-476c-8227-049dbe8db0d6 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:31.169221 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71004d-eb50-476c-8227-049dbe8db0d6 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:31.173819 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69174af-588c-40e1-ac7a-2d1efb46c744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:31.174414 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69174af-588c-40e1-ac7a-2d1efb46c744 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:31.174693 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69174af-588c-40e1-ac7a-2d1efb46c744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:31.174967 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69174af-588c-40e1-ac7a-2d1efb46c744 admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:31.175642 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69174af-588c-40e1-ac7a-2d1efb46c744 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 18:06:31.175945 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69174af-588c-40e1-ac7a-2d1efb46c744 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:31.177621 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69174af-588c-40e1-ac7a-2d1efb46c744 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:31.189098 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1278/2562] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 18:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 18:06:31.193655 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965b09d-b00c-4f4e-ab1b-9b77889f57ab None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:31.203092 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965b09d-b00c-4f4e-ab1b-9b77889f57ab None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:31.208561 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925805e-0fde-4529-a386-f53dfcd03c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:31.209207 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925805e-0fde-4529-a386-f53dfcd03c30 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:31.209487 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925805e-0fde-4529-a386-f53dfcd03c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:31.209757 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925805e-0fde-4529-a386-f53dfcd03c30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:31.210423 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925805e-0fde-4529-a386-f53dfcd03c30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:31.212413 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925805e-0fde-4529-a386-f53dfcd03c30 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:31.241148 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1285/2563] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 18:06:31 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:06:31.245173 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69174af-588c-40e1-ac7a-2d1efb46c744 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:31.255050 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69174af-588c-40e1-ac7a-2d1efb46c744 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:31.297693 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:31.314279 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea885a-908e-498f-8c85-5b9e9d66941c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:31.314944 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea885a-908e-498f-8c85-5b9e9d66941c admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:31.315244 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea885a-908e-498f-8c85-5b9e9d66941c admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:31.315514 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea885a-908e-498f-8c85-5b9e9d66941c admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:31.316148 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea885a-908e-498f-8c85-5b9e9d66941c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:31.318229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea885a-908e-498f-8c85-5b9e9d66941c admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:31.343809 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1279/2564] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 18:06:31 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:06:31.345967 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925805e-0fde-4529-a386-f53dfcd03c30 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:31.356704 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925805e-0fde-4529-a386-f53dfcd03c30 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:31.361416 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3054fa-25db-437b-ab87-cc3616ff6f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:31.362012 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3054fa-25db-437b-ab87-cc3616ff6f8f admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:31.362291 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3054fa-25db-437b-ab87-cc3616ff6f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:31.362557 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3054fa-25db-437b-ab87-cc3616ff6f8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:31.363188 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3054fa-25db-437b-ab87-cc3616ff6f8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:31.365323 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3054fa-25db-437b-ab87-cc3616ff6f8f admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:31.375157 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1286/2565] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 18:06:31.379217 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea885a-908e-498f-8c85-5b9e9d66941c admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:31.389986 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea885a-908e-498f-8c85-5b9e9d66941c admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:31.394602 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b06538-7872-4c8b-99e1-a69182bde2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:31.395204 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b06538-7872-4c8b-99e1-a69182bde2b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:31.395546 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b06538-7872-4c8b-99e1-a69182bde2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:31.395783 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b06538-7872-4c8b-99e1-a69182bde2b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:31.396446 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b06538-7872-4c8b-99e1-a69182bde2b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:31.398729 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b06538-7872-4c8b-99e1-a69182bde2b2 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:31.408961 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1280/2566] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:06:31.413330 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3054fa-25db-437b-ab87-cc3616ff6f8f admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:31.423732 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3054fa-25db-437b-ab87-cc3616ff6f8f admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:31.429356 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556cd60-1fd3-43cc-9ab0-4e474037746c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:31.430115 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556cd60-1fd3-43cc-9ab0-4e474037746c admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:31.430396 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556cd60-1fd3-43cc-9ab0-4e474037746c admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:31.430666 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556cd60-1fd3-43cc-9ab0-4e474037746c admin admin] PATH_INFO: `/v3/projects/75b143b10dc943fbab3bdfdf0de5513b/users/b3489418001542afa6d83b61d6cbcd43/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:31.445805 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6556cd60-1fd3-43cc-9ab0-4e474037746c admin admin] RBAC: Authorizing `identity:create_grant(project_id=75b143b10dc943fbab3bdfdf0de5513b, user_id=b3489418001542afa6d83b61d6cbcd43, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:31.448494 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6556cd60-1fd3-43cc-9ab0-4e474037746c admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:31.461645 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1287/2567] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:06:31 2022] PUT /identity/v3/projects/75b143b10dc943fbab3bdfdf0de5513b/users/b3489418001542afa6d83b61d6cbcd43/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:06:31.473341 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c80d3-f28a-44e8-96b8-370d007e2893 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:31.474182 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c80d3-f28a-44e8-96b8-370d007e2893 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:31.474442 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c80d3-f28a-44e8-96b8-370d007e2893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:31.502679 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-cd3c80d3-f28a-44e8-96b8-370d007e2893 None None] MFA Rules not processed for user `b3489418001542afa6d83b61d6cbcd43`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:06:31.503899 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-cd3c80d3-f28a-44e8-96b8-370d007e2893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:31.568909 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1281/2568] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:06:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:06:31.583034 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556cd60-1fd3-43cc-9ab0-4e474037746c admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:31.585063 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-6556cd60-1fd3-43cc-9ab0-4e474037746c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:31.660027 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556cd60-1fd3-43cc-9ab0-4e474037746c admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:31.671340 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3713433-b1e0-4ef6-a3e6-f8220d2f2886 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:31.671946 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3713433-b1e0-4ef6-a3e6-f8220d2f2886 service nova] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:31.672243 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3713433-b1e0-4ef6-a3e6-f8220d2f2886 service nova] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:31.672499 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3713433-b1e0-4ef6-a3e6-f8220d2f2886 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:31.681260 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3713433-b1e0-4ef6-a3e6-f8220d2f2886 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:31.682799 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3713433-b1e0-4ef6-a3e6-f8220d2f2886 service nova] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:31.691766 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1288/2569] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:06:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:06:31.906033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c80d3-f28a-44e8-96b8-370d007e2893 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:31.968415 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c80d3-f28a-44e8-96b8-370d007e2893 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:31.972781 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac0ab9-4d66-42ac-81e5-d0a190c08559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:31.973439 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac0ab9-4d66-42ac-81e5-d0a190c08559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:31.973756 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac0ab9-4d66-42ac-81e5-d0a190c08559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:31.974026 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac0ab9-4d66-42ac-81e5-d0a190c08559 admin admin] PATH_INFO: `/v3/users/b3489418001542afa6d83b61d6cbcd43` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:31.975705 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac0ab9-4d66-42ac-81e5-d0a190c08559 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3489418001542afa6d83b61d6cbcd43)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:31.977604 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac0ab9-4d66-42ac-81e5-d0a190c08559 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:32.023940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-bfac0ab9-4d66-42ac-81e5-d0a190c08559 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3489418001542afa6d83b61d6cbcd43'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:32.024597 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-bfac0ab9-4d66-42ac-81e5-d0a190c08559 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3489418001542afa6d83b61d6cbcd43'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:32.025236 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-bfac0ab9-4d66-42ac-81e5-d0a190c08559 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3489418001542afa6d83b61d6cbcd43'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:32.030550 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:32.033045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-bfac0ab9-4d66-42ac-81e5-d0a190c08559 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3489418001542afa6d83b61d6cbcd43'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:32.042166 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-bfac0ab9-4d66-42ac-81e5-d0a190c08559 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3489418001542afa6d83b61d6cbcd43'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:32.066614 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1282/2570] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 18:06:31 2022] DELETE /identity/v3/users/b3489418001542afa6d83b61d6cbcd43 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:06:32.071516 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5855d-7ac0-447b-afc0-ca2774bcc15b None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:32.071806 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5855d-7ac0-447b-afc0-ca2774bcc15b None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:32.072082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5855d-7ac0-447b-afc0-ca2774bcc15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:32.080355 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:32.100811 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-8bb5855d-7ac0-447b-afc0-ca2774bcc15b None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:06:32.102097 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-8bb5855d-7ac0-447b-afc0-ca2774bcc15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:32.163501 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1289/2571] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:06:32.173543 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac0ab9-4d66-42ac-81e5-d0a190c08559 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:32.174939 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-bfac0ab9-4d66-42ac-81e5-d0a190c08559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:32.234115 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac0ab9-4d66-42ac-81e5-d0a190c08559 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:32.237685 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e0180-99a0-4d1e-a2d6-8e5faf6e7edb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:32.238288 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e0180-99a0-4d1e-a2d6-8e5faf6e7edb service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:32.238568 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e0180-99a0-4d1e-a2d6-8e5faf6e7edb service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:32.238839 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e0180-99a0-4d1e-a2d6-8e5faf6e7edb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:32.247917 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e0180-99a0-4d1e-a2d6-8e5faf6e7edb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:32.249404 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e0180-99a0-4d1e-a2d6-8e5faf6e7edb service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:32.259545 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1283/2572] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:06:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:06:32.530551 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5855d-7ac0-447b-afc0-ca2774bcc15b None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:32.532109 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-8bb5855d-7ac0-447b-afc0-ca2774bcc15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:32.544694 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5855d-7ac0-447b-afc0-ca2774bcc15b None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:32.549669 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3998fd1-70ca-4a6e-a38f-ce550a8b4333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:32.550377 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3998fd1-70ca-4a6e-a38f-ce550a8b4333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:32.550759 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3998fd1-70ca-4a6e-a38f-ce550a8b4333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:32.551080 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3998fd1-70ca-4a6e-a38f-ce550a8b4333 admin admin] PATH_INFO: `/v3/projects/75b143b10dc943fbab3bdfdf0de5513b` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:32.552319 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3998fd1-70ca-4a6e-a38f-ce550a8b4333 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75b143b10dc943fbab3bdfdf0de5513b)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:32.554404 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3998fd1-70ca-4a6e-a38f-ce550a8b4333 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:32.602888 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-f3998fd1-70ca-4a6e-a38f-ce550a8b4333 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75b143b10dc943fbab3bdfdf0de5513b', 'request_id': 'req-f3998fd1-70ca-4a6e-a38f-ce550a8b4333'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:32.608822 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-f3998fd1-70ca-4a6e-a38f-ce550a8b4333 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75b143b10dc943fbab3bdfdf0de5513b', 'request_id': 'req-f3998fd1-70ca-4a6e-a38f-ce550a8b4333'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:32.617309 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-f3998fd1-70ca-4a6e-a38f-ce550a8b4333 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75b143b10dc943fbab3bdfdf0de5513b', 'request_id': 'req-f3998fd1-70ca-4a6e-a38f-ce550a8b4333'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:32.628584 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-f3998fd1-70ca-4a6e-a38f-ce550a8b4333 admin admin] The token cache is being invalidate because project 75b143b10dc943fbab3bdfdf0de5513b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:06:32.628866 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-f3998fd1-70ca-4a6e-a38f-ce550a8b4333 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:32.629545 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-f3998fd1-70ca-4a6e-a38f-ce550a8b4333 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:32.631104 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1290/2573] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:06:32 2022] DELETE /identity/v3/projects/75b143b10dc943fbab3bdfdf0de5513b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:06:32.636249 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a450c6b-5793-4b7d-bb80-df0ec6b71a15 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:32.636825 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a450c6b-5793-4b7d-bb80-df0ec6b71a15 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:32.636927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a450c6b-5793-4b7d-bb80-df0ec6b71a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:32.657842 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-1a450c6b-5793-4b7d-bb80-df0ec6b71a15 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:06:32.659037 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-1a450c6b-5793-4b7d-bb80-df0ec6b71a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:32.717887 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1284/2574] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:06:32.726414 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a52c2-686f-4441-9077-5269ae5a993a None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:32.726710 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a52c2-686f-4441-9077-5269ae5a993a None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:32.726988 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a52c2-686f-4441-9077-5269ae5a993a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:32.746524 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-e33a52c2-686f-4441-9077-5269ae5a993a None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:06:32.747740 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-e33a52c2-686f-4441-9077-5269ae5a993a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:32.755684 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1291/2575] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:06:32.760060 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a450c6b-5793-4b7d-bb80-df0ec6b71a15 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:32.769698 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a450c6b-5793-4b7d-bb80-df0ec6b71a15 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:32.774762 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18ea04-41fe-4542-9b0a-a04c5a29cc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:32.775294 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18ea04-41fe-4542-9b0a-a04c5a29cc5a admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:32.775564 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18ea04-41fe-4542-9b0a-a04c5a29cc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:32.775829 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18ea04-41fe-4542-9b0a-a04c5a29cc5a admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:32.776463 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18ea04-41fe-4542-9b0a-a04c5a29cc5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 18:06:32.776758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18ea04-41fe-4542-9b0a-a04c5a29cc5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:32.778377 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18ea04-41fe-4542-9b0a-a04c5a29cc5a admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:32.790533 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1285/2576] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 18:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 18:06:32.794910 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a52c2-686f-4441-9077-5269ae5a993a None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:32.804246 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a52c2-686f-4441-9077-5269ae5a993a None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:32.808918 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c293473-5849-46e6-8135-3f95e6ce4f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:32.809540 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c293473-5849-46e6-8135-3f95e6ce4f2c admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:32.809822 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c293473-5849-46e6-8135-3f95e6ce4f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:32.810092 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c293473-5849-46e6-8135-3f95e6ce4f2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:32.810725 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c293473-5849-46e6-8135-3f95e6ce4f2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:32.812657 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c293473-5849-46e6-8135-3f95e6ce4f2c admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:32.840813 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1292/2577] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 18:06:32 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:06:32.845272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18ea04-41fe-4542-9b0a-a04c5a29cc5a admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:32.856128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18ea04-41fe-4542-9b0a-a04c5a29cc5a admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:32.915089 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb593474-7d59-42bf-8b9c-53ea32985b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:32.915696 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb593474-7d59-42bf-8b9c-53ea32985b4d admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:32.915970 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb593474-7d59-42bf-8b9c-53ea32985b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:32.916242 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb593474-7d59-42bf-8b9c-53ea32985b4d admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:32.916864 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb593474-7d59-42bf-8b9c-53ea32985b4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:32.918812 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb593474-7d59-42bf-8b9c-53ea32985b4d admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:32.927812 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:32.946132 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1286/2578] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 18:06:32 2022] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:06:32.947320 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c293473-5849-46e6-8135-3f95e6ce4f2c admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:32.957793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c293473-5849-46e6-8135-3f95e6ce4f2c admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:32.963166 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7a6fa-306e-4da9-87f2-6438ffdc451d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:32.963885 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7a6fa-306e-4da9-87f2-6438ffdc451d admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:32.964168 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7a6fa-306e-4da9-87f2-6438ffdc451d admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:32.964440 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7a6fa-306e-4da9-87f2-6438ffdc451d admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:32.965124 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7a6fa-306e-4da9-87f2-6438ffdc451d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:32.966985 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7a6fa-306e-4da9-87f2-6438ffdc451d admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:32.976986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1293/2579] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 18:06:32.981102 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb593474-7d59-42bf-8b9c-53ea32985b4d admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:32.990867 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb593474-7d59-42bf-8b9c-53ea32985b4d admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:32.995536 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7ebf0-91b9-4dee-a0d2-90d623643ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:32.996543 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7ebf0-91b9-4dee-a0d2-90d623643ffe admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:32.996543 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7ebf0-91b9-4dee-a0d2-90d623643ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:32.996762 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7ebf0-91b9-4dee-a0d2-90d623643ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:32.997317 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b7ebf0-91b9-4dee-a0d2-90d623643ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:32.998903 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b7ebf0-91b9-4dee-a0d2-90d623643ffe admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:33.009981 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1287/2580] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:06:33.014229 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7a6fa-306e-4da9-87f2-6438ffdc451d admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:33.025326 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7a6fa-306e-4da9-87f2-6438ffdc451d admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:33.029881 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841d06a-f5a3-4659-b43d-e73b563b8514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:33.030520 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841d06a-f5a3-4659-b43d-e73b563b8514 admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:33.030797 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841d06a-f5a3-4659-b43d-e73b563b8514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:33.031065 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841d06a-f5a3-4659-b43d-e73b563b8514 admin admin] PATH_INFO: `/v3/projects/c850b018e87945ffb11a3a286342ca22/users/565ae306f293411ebb4ae28f36115235/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:33.045772 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841d06a-f5a3-4659-b43d-e73b563b8514 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c850b018e87945ffb11a3a286342ca22, user_id=565ae306f293411ebb4ae28f36115235, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:33.048421 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841d06a-f5a3-4659-b43d-e73b563b8514 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:33.061406 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1294/2581] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:06:33 2022] PUT /identity/v3/projects/c850b018e87945ffb11a3a286342ca22/users/565ae306f293411ebb4ae28f36115235/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 18:06:33.072536 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa22efe-d858-4204-bd5d-b47fa9f7f228 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:33.072819 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa22efe-d858-4204-bd5d-b47fa9f7f228 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:33.073130 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa22efe-d858-4204-bd5d-b47fa9f7f228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:33.101455 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-2aa22efe-d858-4204-bd5d-b47fa9f7f228 None None] MFA Rules not processed for user `565ae306f293411ebb4ae28f36115235`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:06:33.102463 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-2aa22efe-d858-4204-bd5d-b47fa9f7f228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:33.165068 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1288/2582] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:06:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:06:33.169727 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841d06a-f5a3-4659-b43d-e73b563b8514 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:33.196427 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:33.232620 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841d06a-f5a3-4659-b43d-e73b563b8514 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:33.237352 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee564a4-262a-4ecb-97f7-884377eb33f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:33.237957 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee564a4-262a-4ecb-97f7-884377eb33f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:33.238247 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee564a4-262a-4ecb-97f7-884377eb33f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:33.238501 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee564a4-262a-4ecb-97f7-884377eb33f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:33.239240 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee564a4-262a-4ecb-97f7-884377eb33f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:33.241162 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee564a4-262a-4ecb-97f7-884377eb33f8 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:33.268281 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1295/2583] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 18:06:33 2022] POST /identity/v3/projects => generated 363 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:06:33.272996 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa22efe-d858-4204-bd5d-b47fa9f7f228 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:33.283680 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa22efe-d858-4204-bd5d-b47fa9f7f228 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:33.341997 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1d05a-84d4-45a1-a808-10d58742c065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:33.342602 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1d05a-84d4-45a1-a808-10d58742c065 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:33.342879 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1d05a-84d4-45a1-a808-10d58742c065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:33.343147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1d05a-84d4-45a1-a808-10d58742c065 admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:33.343786 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1d05a-84d4-45a1-a808-10d58742c065 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:33.345766 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1d05a-84d4-45a1-a808-10d58742c065 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:33.368351 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1289/2584] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 18:06:33 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:06:33.372456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee564a4-262a-4ecb-97f7-884377eb33f8 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:33.383646 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee564a4-262a-4ecb-97f7-884377eb33f8 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:33.388326 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0df01-a46e-4303-aaf1-6d333b56ac2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:33.388940 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0df01-a46e-4303-aaf1-6d333b56ac2c admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:33.389258 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0df01-a46e-4303-aaf1-6d333b56ac2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:33.389671 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0df01-a46e-4303-aaf1-6d333b56ac2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:33.390318 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0df01-a46e-4303-aaf1-6d333b56ac2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:33.391917 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0df01-a46e-4303-aaf1-6d333b56ac2c admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:33.402901 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1296/2585] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:06:33.407125 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1d05a-84d4-45a1-a808-10d58742c065 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:33.417824 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1d05a-84d4-45a1-a808-10d58742c065 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:33.422681 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8d3b6-f950-416b-8e08-9f806b0f8e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:33.423381 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8d3b6-f950-416b-8e08-9f806b0f8e81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:33.423768 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8d3b6-f950-416b-8e08-9f806b0f8e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:33.424173 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8d3b6-f950-416b-8e08-9f806b0f8e81 admin admin] PATH_INFO: `/v3/projects/1546fd24770a451e8abfca3976d24fd5/users/a1369054868b4c3e9409422d1be86565/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:33.439523 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e8d3b6-f950-416b-8e08-9f806b0f8e81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1546fd24770a451e8abfca3976d24fd5, user_id=a1369054868b4c3e9409422d1be86565, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:33.442275 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e8d3b6-f950-416b-8e08-9f806b0f8e81 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:33.456534 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1290/2586] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:06:33 2022] PUT /identity/v3/projects/1546fd24770a451e8abfca3976d24fd5/users/a1369054868b4c3e9409422d1be86565/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:06:33.461001 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0df01-a46e-4303-aaf1-6d333b56ac2c admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:33.471602 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0df01-a46e-4303-aaf1-6d333b56ac2c admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:33.527781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73886e6-8131-4fdf-88c2-e0e891e0acf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:33.528459 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73886e6-8131-4fdf-88c2-e0e891e0acf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:33.528738 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73886e6-8131-4fdf-88c2-e0e891e0acf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:33.529025 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73886e6-8131-4fdf-88c2-e0e891e0acf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:33.529675 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73886e6-8131-4fdf-88c2-e0e891e0acf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:33.531273 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73886e6-8131-4fdf-88c2-e0e891e0acf0 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:33.542752 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1297/2587] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:06:33.546915 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8d3b6-f950-416b-8e08-9f806b0f8e81 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:33.557221 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8d3b6-f950-416b-8e08-9f806b0f8e81 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:33.562015 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe52ab-3c83-41e4-9852-e910a7d3d22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:33.562663 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe52ab-3c83-41e4-9852-e910a7d3d22d admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:33.562941 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe52ab-3c83-41e4-9852-e910a7d3d22d admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:33.563211 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe52ab-3c83-41e4-9852-e910a7d3d22d admin admin] PATH_INFO: `/v3/projects/1546fd24770a451e8abfca3976d24fd5/users/a1369054868b4c3e9409422d1be86565/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:33.565191 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe52ab-3c83-41e4-9852-e910a7d3d22d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1546fd24770a451e8abfca3976d24fd5, user_id=a1369054868b4c3e9409422d1be86565, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:33.567853 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe52ab-3c83-41e4-9852-e910a7d3d22d admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:33.578011 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1291/2588] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:06:33 2022] PUT /identity/v3/projects/1546fd24770a451e8abfca3976d24fd5/users/a1369054868b4c3e9409422d1be86565/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:06:33.590098 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f920c-a001-4835-aabc-71decae28bcb None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:33.590387 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f920c-a001-4835-aabc-71decae28bcb None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:33.590662 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f920c-a001-4835-aabc-71decae28bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:33.619580 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-6f6f920c-a001-4835-aabc-71decae28bcb None None] MFA Rules not processed for user `a1369054868b4c3e9409422d1be86565`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:06:33.620828 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-6f6f920c-a001-4835-aabc-71decae28bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:33.688905 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1298/2589] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:06:33 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:06:33.700711 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe52ab-3c83-41e4-9852-e910a7d3d22d admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:33.702569 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-1dbe52ab-3c83-41e4-9852-e910a7d3d22d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:33.729536 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:33.761503 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe52ab-3c83-41e4-9852-e910a7d3d22d admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:33.765128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a218bc9-6cea-41b1-95c0-f19bd6194e78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:33.765732 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a218bc9-6cea-41b1-95c0-f19bd6194e78 service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:33.766010 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a218bc9-6cea-41b1-95c0-f19bd6194e78 service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:33.766285 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a218bc9-6cea-41b1-95c0-f19bd6194e78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:33.776057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a218bc9-6cea-41b1-95c0-f19bd6194e78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:33.777525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a218bc9-6cea-41b1-95c0-f19bd6194e78 service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:33.786827 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1292/2590] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:06:33 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 18:06:33.863066 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f920c-a001-4835-aabc-71decae28bcb None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:33.873195 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f920c-a001-4835-aabc-71decae28bcb None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:33.876783 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50312e4-d930-4554-9b30-85e52f2db53f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:33.877418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50312e4-d930-4554-9b30-85e52f2db53f service cinder] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:33.877702 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50312e4-d930-4554-9b30-85e52f2db53f service cinder] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:33.877971 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50312e4-d930-4554-9b30-85e52f2db53f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:33.895264 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:33.938755 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50312e4-d930-4554-9b30-85e52f2db53f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:33.940226 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50312e4-d930-4554-9b30-85e52f2db53f service cinder] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:33.949877 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1299/2591] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:06:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 18:06:40.996611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a218bc9-6cea-41b1-95c0-f19bd6194e78 service cinder] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:41.058036 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a218bc9-6cea-41b1-95c0-f19bd6194e78 service cinder] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:41.062535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d63388-f1a4-44fe-a420-27bb5e6ee130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:41.063169 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d63388-f1a4-44fe-a420-27bb5e6ee130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:41.063452 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d63388-f1a4-44fe-a420-27bb5e6ee130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:41.063727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d63388-f1a4-44fe-a420-27bb5e6ee130 admin admin] PATH_INFO: `/v3/users/565ae306f293411ebb4ae28f36115235` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:41.064845 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d63388-f1a4-44fe-a420-27bb5e6ee130 admin admin] RBAC: Authorizing `identity:delete_user(user_id=565ae306f293411ebb4ae28f36115235)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:41.066825 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d63388-f1a4-44fe-a420-27bb5e6ee130 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:41.112473 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-c7d63388-f1a4-44fe-a420-27bb5e6ee130 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '565ae306f293411ebb4ae28f36115235'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:41.113075 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-c7d63388-f1a4-44fe-a420-27bb5e6ee130 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '565ae306f293411ebb4ae28f36115235'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:41.114220 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-c7d63388-f1a4-44fe-a420-27bb5e6ee130 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '565ae306f293411ebb4ae28f36115235'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:41.121177 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-c7d63388-f1a4-44fe-a420-27bb5e6ee130 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '565ae306f293411ebb4ae28f36115235'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:41.129127 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-c7d63388-f1a4-44fe-a420-27bb5e6ee130 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '565ae306f293411ebb4ae28f36115235'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:41.147339 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1293/2592] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 18:06:40 2022] DELETE /identity/v3/users/565ae306f293411ebb4ae28f36115235 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:06:41.151805 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cf01c-8951-4b1c-90b6-0750640bb3e4 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:41.152298 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cf01c-8951-4b1c-90b6-0750640bb3e4 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:41.152410 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cf01c-8951-4b1c-90b6-0750640bb3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:41.293020 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-c48cf01c-8951-4b1c-90b6-0750640bb3e4 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:06:41.294252 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-c48cf01c-8951-4b1c-90b6-0750640bb3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:41.353772 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1300/2593] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:06:41.363776 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d63388-f1a4-44fe-a420-27bb5e6ee130 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:41.365133 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-c7d63388-f1a4-44fe-a420-27bb5e6ee130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:41.414177 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:41.428432 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d63388-f1a4-44fe-a420-27bb5e6ee130 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:41.432190 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755742a9-7eaf-4789-983d-174d41b56a9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:41.432788 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755742a9-7eaf-4789-983d-174d41b56a9f service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:41.433096 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755742a9-7eaf-4789-983d-174d41b56a9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:41.433368 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755742a9-7eaf-4789-983d-174d41b56a9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:41.443117 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755742a9-7eaf-4789-983d-174d41b56a9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:41.444564 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755742a9-7eaf-4789-983d-174d41b56a9f service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:41.454094 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1294/2594] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:06:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:06:41.726464 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48cf01c-8951-4b1c-90b6-0750640bb3e4 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:41.729284 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-c48cf01c-8951-4b1c-90b6-0750640bb3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:41.742924 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48cf01c-8951-4b1c-90b6-0750640bb3e4 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:41.747632 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635cb375-8e84-4295-b972-a8af33c8bd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:41.748259 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cb375-8e84-4295-b972-a8af33c8bd34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:41.748534 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cb375-8e84-4295-b972-a8af33c8bd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:41.748796 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cb375-8e84-4295-b972-a8af33c8bd34 admin admin] PATH_INFO: `/v3/projects/c850b018e87945ffb11a3a286342ca22` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:41.750100 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635cb375-8e84-4295-b972-a8af33c8bd34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c850b018e87945ffb11a3a286342ca22)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:41.752019 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635cb375-8e84-4295-b972-a8af33c8bd34 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:41.798793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-635cb375-8e84-4295-b972-a8af33c8bd34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c850b018e87945ffb11a3a286342ca22', 'request_id': 'req-635cb375-8e84-4295-b972-a8af33c8bd34'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:41.805000 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-635cb375-8e84-4295-b972-a8af33c8bd34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c850b018e87945ffb11a3a286342ca22', 'request_id': 'req-635cb375-8e84-4295-b972-a8af33c8bd34'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:41.812589 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-635cb375-8e84-4295-b972-a8af33c8bd34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c850b018e87945ffb11a3a286342ca22', 'request_id': 'req-635cb375-8e84-4295-b972-a8af33c8bd34'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:41.824446 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-635cb375-8e84-4295-b972-a8af33c8bd34 admin admin] The token cache is being invalidate because project c850b018e87945ffb11a3a286342ca22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:06:41.824736 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-635cb375-8e84-4295-b972-a8af33c8bd34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:41.825393 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-635cb375-8e84-4295-b972-a8af33c8bd34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:41.826922 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1301/2595] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:06:41 2022] DELETE /identity/v3/projects/c850b018e87945ffb11a3a286342ca22 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:06:41.831170 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755742a9-7eaf-4789-983d-174d41b56a9f service neutron] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:41.840926 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755742a9-7eaf-4789-983d-174d41b56a9f service neutron] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:41.898037 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60139d11-87d1-4ffc-839c-abdd79041925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:41.898669 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60139d11-87d1-4ffc-839c-abdd79041925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:41.899012 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60139d11-87d1-4ffc-839c-abdd79041925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:41.899229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60139d11-87d1-4ffc-839c-abdd79041925 admin admin] PATH_INFO: `/v3/users/a1369054868b4c3e9409422d1be86565` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:41.900371 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60139d11-87d1-4ffc-839c-abdd79041925 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1369054868b4c3e9409422d1be86565)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:41.902390 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60139d11-87d1-4ffc-839c-abdd79041925 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:41.949880 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-60139d11-87d1-4ffc-839c-abdd79041925 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1369054868b4c3e9409422d1be86565'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:41.950532 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-60139d11-87d1-4ffc-839c-abdd79041925 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1369054868b4c3e9409422d1be86565'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:41.951142 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-60139d11-87d1-4ffc-839c-abdd79041925 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1369054868b4c3e9409422d1be86565'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:41.958253 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-60139d11-87d1-4ffc-839c-abdd79041925 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1369054868b4c3e9409422d1be86565'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:41.965742 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-60139d11-87d1-4ffc-839c-abdd79041925 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1369054868b4c3e9409422d1be86565'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:41.984696 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1295/2596] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 18:06:41 2022] DELETE /identity/v3/users/a1369054868b4c3e9409422d1be86565 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:06:42.257856 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635cb375-8e84-4295-b972-a8af33c8bd34 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:42.259326 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-635cb375-8e84-4295-b972-a8af33c8bd34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:42.273987 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635cb375-8e84-4295-b972-a8af33c8bd34 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:42.319688 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:42.338930 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2925c5-815d-4a39-b298-9689a6499bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:42.339572 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2925c5-815d-4a39-b298-9689a6499bdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:42.339852 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2925c5-815d-4a39-b298-9689a6499bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:42.340126 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2925c5-815d-4a39-b298-9689a6499bdf admin admin] PATH_INFO: `/v3/projects/1546fd24770a451e8abfca3976d24fd5` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:42.341548 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2925c5-815d-4a39-b298-9689a6499bdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=1546fd24770a451e8abfca3976d24fd5)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:42.343432 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2925c5-815d-4a39-b298-9689a6499bdf admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:42.396251 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-6c2925c5-815d-4a39-b298-9689a6499bdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1546fd24770a451e8abfca3976d24fd5', 'request_id': 'req-6c2925c5-815d-4a39-b298-9689a6499bdf'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:42.402292 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-6c2925c5-815d-4a39-b298-9689a6499bdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1546fd24770a451e8abfca3976d24fd5', 'request_id': 'req-6c2925c5-815d-4a39-b298-9689a6499bdf'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:42.411243 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-6c2925c5-815d-4a39-b298-9689a6499bdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1546fd24770a451e8abfca3976d24fd5', 'request_id': 'req-6c2925c5-815d-4a39-b298-9689a6499bdf'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:42.422635 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-6c2925c5-815d-4a39-b298-9689a6499bdf admin admin] The token cache is being invalidate because project 1546fd24770a451e8abfca3976d24fd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:06:42.422946 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-6c2925c5-815d-4a39-b298-9689a6499bdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:42.423644 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-6c2925c5-815d-4a39-b298-9689a6499bdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:42.425237 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1302/2597] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:06:42 2022] DELETE /identity/v3/projects/1546fd24770a451e8abfca3976d24fd5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:06:42.430418 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776dd160-4871-43f3-b664-3436f0eb7f94 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:42.431064 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776dd160-4871-43f3-b664-3436f0eb7f94 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:42.431384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776dd160-4871-43f3-b664-3436f0eb7f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:42.450994 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-776dd160-4871-43f3-b664-3436f0eb7f94 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:06:42.452213 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-776dd160-4871-43f3-b664-3436f0eb7f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:42.511194 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1296/2598] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:06:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:06:42.518992 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0047c83-bd51-46be-bdc7-96db2104015c None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:42.519277 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0047c83-bd51-46be-bdc7-96db2104015c None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:42.519545 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0047c83-bd51-46be-bdc7-96db2104015c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:42.540956 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-d0047c83-bd51-46be-bdc7-96db2104015c None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:06:42.542202 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-d0047c83-bd51-46be-bdc7-96db2104015c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:42.550003 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1303/2599] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:06:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:06:42.554450 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776dd160-4871-43f3-b664-3436f0eb7f94 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:42.564063 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776dd160-4871-43f3-b664-3436f0eb7f94 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:42.568528 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbaed9-75f3-4bd3-934f-8c2a901c5007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:42.569167 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbaed9-75f3-4bd3-934f-8c2a901c5007 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:42.569437 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbaed9-75f3-4bd3-934f-8c2a901c5007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:42.569700 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbaed9-75f3-4bd3-934f-8c2a901c5007 admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:42.570335 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbaed9-75f3-4bd3-934f-8c2a901c5007 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 18:06:42.570750 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbaed9-75f3-4bd3-934f-8c2a901c5007 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:42.572345 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbaed9-75f3-4bd3-934f-8c2a901c5007 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:42.573812 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:42.589150 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1297/2600] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 18:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 18:06:42.590298 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0047c83-bd51-46be-bdc7-96db2104015c None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:42.600099 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0047c83-bd51-46be-bdc7-96db2104015c None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:42.604647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990e5ba-8db5-4d8c-812c-07eacb77d02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:42.605267 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990e5ba-8db5-4d8c-812c-07eacb77d02f admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:42.605542 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990e5ba-8db5-4d8c-812c-07eacb77d02f admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:42.605806 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990e5ba-8db5-4d8c-812c-07eacb77d02f admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:42.606421 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4990e5ba-8db5-4d8c-812c-07eacb77d02f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:42.608319 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4990e5ba-8db5-4d8c-812c-07eacb77d02f admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:42.634923 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1304/2601] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 18:06:42 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 18:06:42.639325 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbaed9-75f3-4bd3-934f-8c2a901c5007 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:42.649869 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbaed9-75f3-4bd3-934f-8c2a901c5007 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:42.705961 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644500a8-8985-48f8-9344-8a7954d099a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:42.706474 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644500a8-8985-48f8-9344-8a7954d099a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:42.706747 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644500a8-8985-48f8-9344-8a7954d099a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:42.707013 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644500a8-8985-48f8-9344-8a7954d099a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:42.708273 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644500a8-8985-48f8-9344-8a7954d099a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:42.710197 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644500a8-8985-48f8-9344-8a7954d099a7 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:42.731492 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1298/2602] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 18:06:42 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 18:06:42.735833 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990e5ba-8db5-4d8c-812c-07eacb77d02f admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:42.745965 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990e5ba-8db5-4d8c-812c-07eacb77d02f admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:42.750526 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ddbc22-dac5-4230-9216-55234cdcab34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:42.751124 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ddbc22-dac5-4230-9216-55234cdcab34 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:42.751402 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ddbc22-dac5-4230-9216-55234cdcab34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:42.751673 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ddbc22-dac5-4230-9216-55234cdcab34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:42.752313 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ddbc22-dac5-4230-9216-55234cdcab34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:42.753926 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ddbc22-dac5-4230-9216-55234cdcab34 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:42.765169 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1305/2603] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:06:42.769109 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644500a8-8985-48f8-9344-8a7954d099a7 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:42.779506 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644500a8-8985-48f8-9344-8a7954d099a7 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:42.784254 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ed875-6dd2-4ed1-89e4-46a04fb6cbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:42.784848 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ed875-6dd2-4ed1-89e4-46a04fb6cbfd admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:42.785167 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ed875-6dd2-4ed1-89e4-46a04fb6cbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:42.785456 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ed875-6dd2-4ed1-89e4-46a04fb6cbfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:42.786243 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ed875-6dd2-4ed1-89e4-46a04fb6cbfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:42.787853 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ed875-6dd2-4ed1-89e4-46a04fb6cbfd admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:42.798436 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1299/2604] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:06:42.802448 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ddbc22-dac5-4230-9216-55234cdcab34 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:42.812150 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ddbc22-dac5-4230-9216-55234cdcab34 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:42.817250 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41557a-8275-4584-a0bc-9b4f90c56c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:42.817893 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41557a-8275-4584-a0bc-9b4f90c56c5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:42.818169 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41557a-8275-4584-a0bc-9b4f90c56c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:42.818437 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41557a-8275-4584-a0bc-9b4f90c56c5b admin admin] PATH_INFO: `/v3/projects/b0f5faa3827e4174976bfd77cc46df22/users/0331a1bf674348b28ba4c830b53c2e59/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:42.833155 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa41557a-8275-4584-a0bc-9b4f90c56c5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0f5faa3827e4174976bfd77cc46df22, user_id=0331a1bf674348b28ba4c830b53c2e59, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:42.835806 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa41557a-8275-4584-a0bc-9b4f90c56c5b admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:42.849173 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1306/2605] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:06:42 2022] PUT /identity/v3/projects/b0f5faa3827e4174976bfd77cc46df22/users/0331a1bf674348b28ba4c830b53c2e59/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 18:06:42.859371 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827a433-abfa-43a9-ac08-86c0acf82cf2 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:42.859655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827a433-abfa-43a9-ac08-86c0acf82cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:42.859928 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827a433-abfa-43a9-ac08-86c0acf82cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:42.888469 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-7827a433-abfa-43a9-ac08-86c0acf82cf2 None None] MFA Rules not processed for user `0331a1bf674348b28ba4c830b53c2e59`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:06:42.889716 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-7827a433-abfa-43a9-ac08-86c0acf82cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:42.956172 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1300/2606] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:06:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:06:42.961209 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41557a-8275-4584-a0bc-9b4f90c56c5b admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:43.029179 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41557a-8275-4584-a0bc-9b4f90c56c5b admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:43.033769 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634f795-cd02-4755-8038-0dbf1c808dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:43.034368 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634f795-cd02-4755-8038-0dbf1c808dc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:43.034642 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634f795-cd02-4755-8038-0dbf1c808dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:43.034908 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634f795-cd02-4755-8038-0dbf1c808dc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:43.035539 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9634f795-cd02-4755-8038-0dbf1c808dc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:43.037500 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9634f795-cd02-4755-8038-0dbf1c808dc8 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:43.051938 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:43.065907 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1307/2607] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 18:06:42 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:06:43.070513 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827a433-abfa-43a9-ac08-86c0acf82cf2 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:43.080946 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827a433-abfa-43a9-ac08-86c0acf82cf2 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:43.137429 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985e3d2-5e05-45e7-bc46-7b5f3419e292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:43.138065 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985e3d2-5e05-45e7-bc46-7b5f3419e292 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:43.138435 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985e3d2-5e05-45e7-bc46-7b5f3419e292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:43.138711 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985e3d2-5e05-45e7-bc46-7b5f3419e292 admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:43.139348 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985e3d2-5e05-45e7-bc46-7b5f3419e292 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:43.141309 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985e3d2-5e05-45e7-bc46-7b5f3419e292 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:43.150383 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:43.163485 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1301/2608] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 18:06:43 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:06:43.167714 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634f795-cd02-4755-8038-0dbf1c808dc8 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:43.178531 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634f795-cd02-4755-8038-0dbf1c808dc8 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:43.183584 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8887f2-e7d3-4a23-872e-7ef2f6f7271e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:43.184178 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8887f2-e7d3-4a23-872e-7ef2f6f7271e admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:43.184455 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8887f2-e7d3-4a23-872e-7ef2f6f7271e admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:43.184724 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8887f2-e7d3-4a23-872e-7ef2f6f7271e admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:43.185398 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8887f2-e7d3-4a23-872e-7ef2f6f7271e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:43.186968 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8887f2-e7d3-4a23-872e-7ef2f6f7271e admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:43.197489 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1308/2609] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:06:43.201603 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985e3d2-5e05-45e7-bc46-7b5f3419e292 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:43.211687 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985e3d2-5e05-45e7-bc46-7b5f3419e292 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:43.216760 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2da20e-aa38-499b-8b9c-dd6510071faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:43.217455 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2da20e-aa38-499b-8b9c-dd6510071faf admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:43.217735 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2da20e-aa38-499b-8b9c-dd6510071faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:43.218011 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2da20e-aa38-499b-8b9c-dd6510071faf admin admin] PATH_INFO: `/v3/projects/d951adddbe7142168996abd576c123cc/users/ac7c946011a441eba56a81f163fb540b/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:43.235194 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2da20e-aa38-499b-8b9c-dd6510071faf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d951adddbe7142168996abd576c123cc, user_id=ac7c946011a441eba56a81f163fb540b, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:43.237926 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2da20e-aa38-499b-8b9c-dd6510071faf admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:43.252044 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1302/2610] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:06:43 2022] PUT /identity/v3/projects/d951adddbe7142168996abd576c123cc/users/ac7c946011a441eba56a81f163fb540b/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:06:43.256605 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8887f2-e7d3-4a23-872e-7ef2f6f7271e admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:43.266524 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8887f2-e7d3-4a23-872e-7ef2f6f7271e admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:43.346028 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5058d317-bb84-4faa-b353-be39b6795a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:43.346644 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058d317-bb84-4faa-b353-be39b6795a43 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:43.346941 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058d317-bb84-4faa-b353-be39b6795a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:43.347238 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058d317-bb84-4faa-b353-be39b6795a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:43.347924 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5058d317-bb84-4faa-b353-be39b6795a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:43.350265 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5058d317-bb84-4faa-b353-be39b6795a43 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:43.360698 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1309/2611] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:06:43.365123 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2da20e-aa38-499b-8b9c-dd6510071faf admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:43.375471 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2da20e-aa38-499b-8b9c-dd6510071faf admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:43.380147 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae68eca-1ad3-4ca0-a7bc-28b3a445093d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:43.380866 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae68eca-1ad3-4ca0-a7bc-28b3a445093d admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:43.381133 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae68eca-1ad3-4ca0-a7bc-28b3a445093d admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:43.381570 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae68eca-1ad3-4ca0-a7bc-28b3a445093d admin admin] PATH_INFO: `/v3/projects/d951adddbe7142168996abd576c123cc/users/ac7c946011a441eba56a81f163fb540b/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:43.383545 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae68eca-1ad3-4ca0-a7bc-28b3a445093d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d951adddbe7142168996abd576c123cc, user_id=ac7c946011a441eba56a81f163fb540b, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:43.386268 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae68eca-1ad3-4ca0-a7bc-28b3a445093d admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:43.397754 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1303/2612] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:06:43 2022] PUT /identity/v3/projects/d951adddbe7142168996abd576c123cc/users/ac7c946011a441eba56a81f163fb540b/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:06:43.409073 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47db633-6875-4443-b2c5-a109aa6c8f27 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:43.409362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47db633-6875-4443-b2c5-a109aa6c8f27 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:43.409639 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47db633-6875-4443-b2c5-a109aa6c8f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:43.438560 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-c47db633-6875-4443-b2c5-a109aa6c8f27 None None] MFA Rules not processed for user `ac7c946011a441eba56a81f163fb540b`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:06:43.439766 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-c47db633-6875-4443-b2c5-a109aa6c8f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:43.508747 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1310/2613] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:06:43 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:06:43.521635 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae68eca-1ad3-4ca0-a7bc-28b3a445093d admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:43.523521 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-eae68eca-1ad3-4ca0-a7bc-28b3a445093d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:43.584074 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae68eca-1ad3-4ca0-a7bc-28b3a445093d admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:43.587765 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727e389-95a2-4224-9112-5753899dfad0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:43.588399 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727e389-95a2-4224-9112-5753899dfad0 service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:43.588684 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727e389-95a2-4224-9112-5753899dfad0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:43.588991 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727e389-95a2-4224-9112-5753899dfad0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:43.598450 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727e389-95a2-4224-9112-5753899dfad0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:43.599878 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727e389-95a2-4224-9112-5753899dfad0 service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:43.609518 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1304/2614] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:06:43 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:06:43.960207 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47db633-6875-4443-b2c5-a109aa6c8f27 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:43.969740 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47db633-6875-4443-b2c5-a109aa6c8f27 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:43.974197 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72bdb52-8ba0-4b95-9cee-824a4cd41c72 tempest-VolumeQuotaClassesTest-731353381 tempest-VolumeQuotaClassesTest-731353381-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac7c946011a441eba56a81f163fb540b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd951adddbe7142168996abd576c123cc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:43.974787 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bdb52-8ba0-4b95-9cee-824a4cd41c72 tempest-VolumeQuotaClassesTest-731353381 tempest-VolumeQuotaClassesTest-731353381-project-admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:43.975070 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bdb52-8ba0-4b95-9cee-824a4cd41c72 tempest-VolumeQuotaClassesTest-731353381 tempest-VolumeQuotaClassesTest-731353381-project-admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:43.975343 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bdb52-8ba0-4b95-9cee-824a4cd41c72 tempest-VolumeQuotaClassesTest-731353381 tempest-VolumeQuotaClassesTest-731353381-project-admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:43.975975 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72bdb52-8ba0-4b95-9cee-824a4cd41c72 tempest-VolumeQuotaClassesTest-731353381 tempest-VolumeQuotaClassesTest-731353381-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 18:06:43.976300 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72bdb52-8ba0-4b95-9cee-824a4cd41c72 tempest-VolumeQuotaClassesTest-731353381 tempest-VolumeQuotaClassesTest-731353381-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:43.978055 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72bdb52-8ba0-4b95-9cee-824a4cd41c72 tempest-VolumeQuotaClassesTest-731353381 tempest-VolumeQuotaClassesTest-731353381-project-admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:43.989848 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1311/2615] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 18:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 18:06:43.994039 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727e389-95a2-4224-9112-5753899dfad0 service cinder] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:44.003013 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727e389-95a2-4224-9112-5753899dfad0 service cinder] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:44.008115 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626a328-662b-4339-b5af-e1da7cfdf2a6 tempest-VolumeQuotaClassesTest-731353381 tempest-VolumeQuotaClassesTest-731353381-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac7c946011a441eba56a81f163fb540b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd951adddbe7142168996abd576c123cc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:44.008725 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626a328-662b-4339-b5af-e1da7cfdf2a6 tempest-VolumeQuotaClassesTest-731353381 tempest-VolumeQuotaClassesTest-731353381-project-admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:44.009028 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626a328-662b-4339-b5af-e1da7cfdf2a6 tempest-VolumeQuotaClassesTest-731353381 tempest-VolumeQuotaClassesTest-731353381-project-admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:44.009305 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626a328-662b-4339-b5af-e1da7cfdf2a6 tempest-VolumeQuotaClassesTest-731353381 tempest-VolumeQuotaClassesTest-731353381-project-admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:44.009954 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626a328-662b-4339-b5af-e1da7cfdf2a6 tempest-VolumeQuotaClassesTest-731353381 tempest-VolumeQuotaClassesTest-731353381-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:44.011864 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626a328-662b-4339-b5af-e1da7cfdf2a6 tempest-VolumeQuotaClassesTest-731353381 tempest-VolumeQuotaClassesTest-731353381-project-admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:44.039053 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1305/2616] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 18:06:43 2022] POST /identity/v3/projects => generated 353 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:06:44.043227 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72bdb52-8ba0-4b95-9cee-824a4cd41c72 tempest-VolumeQuotaClassesTest-731353381 tempest-VolumeQuotaClassesTest-731353381-project-admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:44.053694 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72bdb52-8ba0-4b95-9cee-824a4cd41c72 tempest-VolumeQuotaClassesTest-731353381 tempest-VolumeQuotaClassesTest-731353381-project-admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:44.098859 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:44.109734 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1620a85-6da7-4dc5-9138-1c97585642ce tempest-VolumeQuotaClassesTest-731353381 tempest-VolumeQuotaClassesTest-731353381-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac7c946011a441eba56a81f163fb540b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd951adddbe7142168996abd576c123cc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:44.110334 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1620a85-6da7-4dc5-9138-1c97585642ce tempest-VolumeQuotaClassesTest-731353381 tempest-VolumeQuotaClassesTest-731353381-project-admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:44.110616 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1620a85-6da7-4dc5-9138-1c97585642ce tempest-VolumeQuotaClassesTest-731353381 tempest-VolumeQuotaClassesTest-731353381-project-admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:44.110891 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1620a85-6da7-4dc5-9138-1c97585642ce tempest-VolumeQuotaClassesTest-731353381 tempest-VolumeQuotaClassesTest-731353381-project-admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:44.111525 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1620a85-6da7-4dc5-9138-1c97585642ce tempest-VolumeQuotaClassesTest-731353381 tempest-VolumeQuotaClassesTest-731353381-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 18:06:44.111828 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1620a85-6da7-4dc5-9138-1c97585642ce tempest-VolumeQuotaClassesTest-731353381 tempest-VolumeQuotaClassesTest-731353381-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:44.113942 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1620a85-6da7-4dc5-9138-1c97585642ce tempest-VolumeQuotaClassesTest-731353381 tempest-VolumeQuotaClassesTest-731353381-project-admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:44.125830 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1312/2617] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 18:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 18:06:44.162744 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626a328-662b-4339-b5af-e1da7cfdf2a6 tempest-VolumeQuotaClassesTest-731353381 tempest-VolumeQuotaClassesTest-731353381-project-admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:44.177234 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626a328-662b-4339-b5af-e1da7cfdf2a6 tempest-VolumeQuotaClassesTest-731353381 tempest-VolumeQuotaClassesTest-731353381-project-admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:44.181944 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ba0a3-eea8-4c5f-afa3-e24ad40600c0 tempest-VolumeQuotaClassesTest-731353381 tempest-VolumeQuotaClassesTest-731353381-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac7c946011a441eba56a81f163fb540b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd951adddbe7142168996abd576c123cc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:44.182604 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ba0a3-eea8-4c5f-afa3-e24ad40600c0 tempest-VolumeQuotaClassesTest-731353381 tempest-VolumeQuotaClassesTest-731353381-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:44.182906 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ba0a3-eea8-4c5f-afa3-e24ad40600c0 tempest-VolumeQuotaClassesTest-731353381 tempest-VolumeQuotaClassesTest-731353381-project-admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:44.183164 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ba0a3-eea8-4c5f-afa3-e24ad40600c0 tempest-VolumeQuotaClassesTest-731353381 tempest-VolumeQuotaClassesTest-731353381-project-admin] PATH_INFO: `/v3/projects/12ab7345722249e68168122610dff7a0` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:44.184302 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ba0a3-eea8-4c5f-afa3-e24ad40600c0 tempest-VolumeQuotaClassesTest-731353381 tempest-VolumeQuotaClassesTest-731353381-project-admin] RBAC: Authorizing `identity:delete_project(project_id=12ab7345722249e68168122610dff7a0)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:44.186263 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ba0a3-eea8-4c5f-afa3-e24ad40600c0 tempest-VolumeQuotaClassesTest-731353381 tempest-VolumeQuotaClassesTest-731353381-project-admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:44.238198 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b59ba0a3-eea8-4c5f-afa3-e24ad40600c0 tempest-VolumeQuotaClassesTest-731353381 tempest-VolumeQuotaClassesTest-731353381-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12ab7345722249e68168122610dff7a0', 'request_id': 'req-b59ba0a3-eea8-4c5f-afa3-e24ad40600c0'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:44.247704 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b59ba0a3-eea8-4c5f-afa3-e24ad40600c0 tempest-VolumeQuotaClassesTest-731353381 tempest-VolumeQuotaClassesTest-731353381-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12ab7345722249e68168122610dff7a0', 'request_id': 'req-b59ba0a3-eea8-4c5f-afa3-e24ad40600c0'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:44.256693 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b59ba0a3-eea8-4c5f-afa3-e24ad40600c0 tempest-VolumeQuotaClassesTest-731353381 tempest-VolumeQuotaClassesTest-731353381-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12ab7345722249e68168122610dff7a0', 'request_id': 'req-b59ba0a3-eea8-4c5f-afa3-e24ad40600c0'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:44.272193 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b59ba0a3-eea8-4c5f-afa3-e24ad40600c0 tempest-VolumeQuotaClassesTest-731353381 tempest-VolumeQuotaClassesTest-731353381-project-admin] The token cache is being invalidate because project 12ab7345722249e68168122610dff7a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:06:44.272460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b59ba0a3-eea8-4c5f-afa3-e24ad40600c0 tempest-VolumeQuotaClassesTest-731353381 tempest-VolumeQuotaClassesTest-731353381-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:44.273302 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b59ba0a3-eea8-4c5f-afa3-e24ad40600c0 tempest-VolumeQuotaClassesTest-731353381 tempest-VolumeQuotaClassesTest-731353381-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:44.275076 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1306/2618] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:06:44 2022] DELETE /identity/v3/projects/12ab7345722249e68168122610dff7a0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:06:44.482623 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1620a85-6da7-4dc5-9138-1c97585642ce tempest-VolumeQuotaClassesTest-731353381 tempest-VolumeQuotaClassesTest-731353381-project-admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:44.484498 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-a1620a85-6da7-4dc5-9138-1c97585642ce tempest-VolumeQuotaClassesTest-731353381 tempest-VolumeQuotaClassesTest-731353381-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:44.549407 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1620a85-6da7-4dc5-9138-1c97585642ce tempest-VolumeQuotaClassesTest-731353381 tempest-VolumeQuotaClassesTest-731353381-project-admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:44.606680 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18a227-3247-4d3a-a321-2ff77a57846e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:44.607456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18a227-3247-4d3a-a321-2ff77a57846e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:44.607721 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18a227-3247-4d3a-a321-2ff77a57846e admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:44.607840 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18a227-3247-4d3a-a321-2ff77a57846e admin admin] PATH_INFO: `/v3/users/0331a1bf674348b28ba4c830b53c2e59` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:44.609256 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a18a227-3247-4d3a-a321-2ff77a57846e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0331a1bf674348b28ba4c830b53c2e59)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:44.611202 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a18a227-3247-4d3a-a321-2ff77a57846e admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:44.659613 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-3a18a227-3247-4d3a-a321-2ff77a57846e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0331a1bf674348b28ba4c830b53c2e59'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:44.667378 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-3a18a227-3247-4d3a-a321-2ff77a57846e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0331a1bf674348b28ba4c830b53c2e59'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:44.667977 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-3a18a227-3247-4d3a-a321-2ff77a57846e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0331a1bf674348b28ba4c830b53c2e59'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:44.668872 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-3a18a227-3247-4d3a-a321-2ff77a57846e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0331a1bf674348b28ba4c830b53c2e59'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:44.675965 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-3a18a227-3247-4d3a-a321-2ff77a57846e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0331a1bf674348b28ba4c830b53c2e59'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:44.692953 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1313/2619] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 18:06:44 2022] DELETE /identity/v3/users/0331a1bf674348b28ba4c830b53c2e59 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:06:44.697574 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99659372-4c95-461a-9c32-a538aaf0ea9f None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:44.698050 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99659372-4c95-461a-9c32-a538aaf0ea9f None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:44.698175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99659372-4c95-461a-9c32-a538aaf0ea9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:44.717625 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-99659372-4c95-461a-9c32-a538aaf0ea9f None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:06:44.718765 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-99659372-4c95-461a-9c32-a538aaf0ea9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:44.731102 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:INSERT=6,keystone:SELECT=87,keystone:DELETE=7 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:44.800454 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1307/2620] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:06:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:06:44.810345 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18a227-3247-4d3a-a321-2ff77a57846e admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:44.811883 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-3a18a227-3247-4d3a-a321-2ff77a57846e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:44.825668 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:44.872831 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18a227-3247-4d3a-a321-2ff77a57846e admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:44.876546 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0277a31-90de-4c29-b668-2c8d806e4224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:44.877194 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0277a31-90de-4c29-b668-2c8d806e4224 service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:44.877478 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0277a31-90de-4c29-b668-2c8d806e4224 service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:44.877748 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0277a31-90de-4c29-b668-2c8d806e4224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:44.886928 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0277a31-90de-4c29-b668-2c8d806e4224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:44.888356 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0277a31-90de-4c29-b668-2c8d806e4224 service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:44.898385 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1314/2621] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:06:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:06:45.172818 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99659372-4c95-461a-9c32-a538aaf0ea9f None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:45.174416 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-99659372-4c95-461a-9c32-a538aaf0ea9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:45.186507 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99659372-4c95-461a-9c32-a538aaf0ea9f None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:45.191149 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee869138-f11b-4af0-ad78-c64e47753bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:45.192265 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee869138-f11b-4af0-ad78-c64e47753bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:45.192589 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee869138-f11b-4af0-ad78-c64e47753bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:45.192859 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee869138-f11b-4af0-ad78-c64e47753bb2 admin admin] PATH_INFO: `/v3/projects/b0f5faa3827e4174976bfd77cc46df22` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:45.194119 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee869138-f11b-4af0-ad78-c64e47753bb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0f5faa3827e4174976bfd77cc46df22)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:45.196314 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee869138-f11b-4af0-ad78-c64e47753bb2 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:45.243709 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-ee869138-f11b-4af0-ad78-c64e47753bb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0f5faa3827e4174976bfd77cc46df22', 'request_id': 'req-ee869138-f11b-4af0-ad78-c64e47753bb2'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:45.249247 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-ee869138-f11b-4af0-ad78-c64e47753bb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0f5faa3827e4174976bfd77cc46df22', 'request_id': 'req-ee869138-f11b-4af0-ad78-c64e47753bb2'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:45.257898 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-ee869138-f11b-4af0-ad78-c64e47753bb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0f5faa3827e4174976bfd77cc46df22', 'request_id': 'req-ee869138-f11b-4af0-ad78-c64e47753bb2'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:45.270534 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-ee869138-f11b-4af0-ad78-c64e47753bb2 admin admin] The token cache is being invalidate because project b0f5faa3827e4174976bfd77cc46df22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:06:45.270840 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-ee869138-f11b-4af0-ad78-c64e47753bb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:45.271476 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-ee869138-f11b-4af0-ad78-c64e47753bb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:45.272950 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1308/2622] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:06:45 2022] DELETE /identity/v3/projects/b0f5faa3827e4174976bfd77cc46df22 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:06:45.276913 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0277a31-90de-4c29-b668-2c8d806e4224 service neutron] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:45.286337 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0277a31-90de-4c29-b668-2c8d806e4224 service neutron] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:45.344320 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87221b82-8e47-4ffd-aee9-0a0ac3aa496d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:45.344959 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87221b82-8e47-4ffd-aee9-0a0ac3aa496d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:45.345270 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87221b82-8e47-4ffd-aee9-0a0ac3aa496d admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:45.345545 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87221b82-8e47-4ffd-aee9-0a0ac3aa496d admin admin] PATH_INFO: `/v3/users/ac7c946011a441eba56a81f163fb540b` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:45.346673 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87221b82-8e47-4ffd-aee9-0a0ac3aa496d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac7c946011a441eba56a81f163fb540b)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:45.348597 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87221b82-8e47-4ffd-aee9-0a0ac3aa496d admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:45.400086 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-87221b82-8e47-4ffd-aee9-0a0ac3aa496d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac7c946011a441eba56a81f163fb540b'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:45.407614 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-87221b82-8e47-4ffd-aee9-0a0ac3aa496d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac7c946011a441eba56a81f163fb540b'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:45.408333 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-87221b82-8e47-4ffd-aee9-0a0ac3aa496d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac7c946011a441eba56a81f163fb540b'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:45.409033 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-87221b82-8e47-4ffd-aee9-0a0ac3aa496d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac7c946011a441eba56a81f163fb540b'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:45.416983 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-87221b82-8e47-4ffd-aee9-0a0ac3aa496d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac7c946011a441eba56a81f163fb540b'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:45.435940 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1315/2623] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 18:06:45 2022] DELETE /identity/v3/users/ac7c946011a441eba56a81f163fb540b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:06:45.714166 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee869138-f11b-4af0-ad78-c64e47753bb2 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:45.715639 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-ee869138-f11b-4af0-ad78-c64e47753bb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:45.732478 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee869138-f11b-4af0-ad78-c64e47753bb2 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:45.791840 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329eaf2-02c7-47f8-adf5-30f59382f43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:45.792387 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329eaf2-02c7-47f8-adf5-30f59382f43b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:45.792667 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329eaf2-02c7-47f8-adf5-30f59382f43b admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:45.792943 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329eaf2-02c7-47f8-adf5-30f59382f43b admin admin] PATH_INFO: `/v3/projects/d951adddbe7142168996abd576c123cc` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:45.794094 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329eaf2-02c7-47f8-adf5-30f59382f43b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d951adddbe7142168996abd576c123cc)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:45.796006 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329eaf2-02c7-47f8-adf5-30f59382f43b admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:45.839766 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:45.843978 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-c329eaf2-02c7-47f8-adf5-30f59382f43b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd951adddbe7142168996abd576c123cc', 'request_id': 'req-c329eaf2-02c7-47f8-adf5-30f59382f43b'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:45.850504 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-c329eaf2-02c7-47f8-adf5-30f59382f43b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd951adddbe7142168996abd576c123cc', 'request_id': 'req-c329eaf2-02c7-47f8-adf5-30f59382f43b'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:45.859538 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-c329eaf2-02c7-47f8-adf5-30f59382f43b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd951adddbe7142168996abd576c123cc', 'request_id': 'req-c329eaf2-02c7-47f8-adf5-30f59382f43b'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:45.871066 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-c329eaf2-02c7-47f8-adf5-30f59382f43b admin admin] The token cache is being invalidate because project d951adddbe7142168996abd576c123cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:06:45.871356 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-c329eaf2-02c7-47f8-adf5-30f59382f43b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:45.871991 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-c329eaf2-02c7-47f8-adf5-30f59382f43b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:45.873526 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1309/2624] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:06:45 2022] DELETE /identity/v3/projects/d951adddbe7142168996abd576c123cc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 18:06:45.880167 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a742e-6e01-4e17-8fa6-1d0021d71a2b None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:45.880695 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a742e-6e01-4e17-8fa6-1d0021d71a2b None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:45.880695 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a742e-6e01-4e17-8fa6-1d0021d71a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:45.900933 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-210a742e-6e01-4e17-8fa6-1d0021d71a2b None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:06:45.902172 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-210a742e-6e01-4e17-8fa6-1d0021d71a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:45.932271 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:45.965633 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1316/2625] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:06:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:06:45.973858 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcf6ca-dc38-427f-bcb3-b73254fe24fe None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:45.974171 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcf6ca-dc38-427f-bcb3-b73254fe24fe None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:45.974448 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcf6ca-dc38-427f-bcb3-b73254fe24fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:45.993956 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-ccdcf6ca-dc38-427f-bcb3-b73254fe24fe None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:06:45.995251 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-ccdcf6ca-dc38-427f-bcb3-b73254fe24fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:46.003105 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1310/2626] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:06:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:06:46.007767 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a742e-6e01-4e17-8fa6-1d0021d71a2b None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:46.017558 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a742e-6e01-4e17-8fa6-1d0021d71a2b None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:46.023377 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233a34f-80c2-4881-8f2c-c03179e39c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:46.023990 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233a34f-80c2-4881-8f2c-c03179e39c46 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:46.024270 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233a34f-80c2-4881-8f2c-c03179e39c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:46.024541 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233a34f-80c2-4881-8f2c-c03179e39c46 admin admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:46.025211 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233a34f-80c2-4881-8f2c-c03179e39c46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 18:06:46.025518 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233a34f-80c2-4881-8f2c-c03179e39c46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:46.027110 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233a34f-80c2-4881-8f2c-c03179e39c46 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:46.038555 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1317/2627] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 18:06:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 18:06:46.043492 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcf6ca-dc38-427f-bcb3-b73254fe24fe None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:46.052735 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcf6ca-dc38-427f-bcb3-b73254fe24fe None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:46.057369 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cfa05d-df47-4cb9-be13-1403d74fae48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:46.057961 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cfa05d-df47-4cb9-be13-1403d74fae48 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:46.058239 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cfa05d-df47-4cb9-be13-1403d74fae48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:46.058507 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cfa05d-df47-4cb9-be13-1403d74fae48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:46.059138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cfa05d-df47-4cb9-be13-1403d74fae48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:46.061051 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cfa05d-df47-4cb9-be13-1403d74fae48 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:46.088725 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1311/2628] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 18:06:46 2022] POST /identity/v3/projects => generated 397 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:06:46.093722 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233a34f-80c2-4881-8f2c-c03179e39c46 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:46.103338 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233a34f-80c2-4881-8f2c-c03179e39c46 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:46.160187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a59bb-ddb5-4e12-baa1-376fba84d974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:46.161418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a59bb-ddb5-4e12-baa1-376fba84d974 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:46.161698 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a59bb-ddb5-4e12-baa1-376fba84d974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:46.161967 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a59bb-ddb5-4e12-baa1-376fba84d974 admin admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:46.162588 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a59bb-ddb5-4e12-baa1-376fba84d974 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:46.164490 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a59bb-ddb5-4e12-baa1-376fba84d974 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:46.185140 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1318/2629] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 18:06:46 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:06:46.189281 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cfa05d-df47-4cb9-be13-1403d74fae48 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:46.199490 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cfa05d-df47-4cb9-be13-1403d74fae48 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:46.204131 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23cd6b-36ea-4543-81e4-9374c4ac0e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:46.204721 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23cd6b-36ea-4543-81e4-9374c4ac0e48 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:46.205020 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23cd6b-36ea-4543-81e4-9374c4ac0e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:46.205299 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23cd6b-36ea-4543-81e4-9374c4ac0e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:46.205936 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23cd6b-36ea-4543-81e4-9374c4ac0e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:46.208036 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23cd6b-36ea-4543-81e4-9374c4ac0e48 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:46.218334 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1312/2630] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:06:46.223421 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a59bb-ddb5-4e12-baa1-376fba84d974 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:46.233677 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a59bb-ddb5-4e12-baa1-376fba84d974 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:46.238709 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c043a-79c8-4202-9e4c-a6eb0b7f784b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:46.239314 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c043a-79c8-4202-9e4c-a6eb0b7f784b admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:46.239602 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c043a-79c8-4202-9e4c-a6eb0b7f784b admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:46.239977 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c043a-79c8-4202-9e4c-a6eb0b7f784b admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:46.240737 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c043a-79c8-4202-9e4c-a6eb0b7f784b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:46.242478 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c043a-79c8-4202-9e4c-a6eb0b7f784b admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:46.253209 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1319/2631] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:06:46.257937 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23cd6b-36ea-4543-81e4-9374c4ac0e48 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:46.267909 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23cd6b-36ea-4543-81e4-9374c4ac0e48 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:46.273037 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee961237-59e3-4b59-b1e9-2c14e505e821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:46.273690 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee961237-59e3-4b59-b1e9-2c14e505e821 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:46.273971 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee961237-59e3-4b59-b1e9-2c14e505e821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:46.274250 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee961237-59e3-4b59-b1e9-2c14e505e821 admin admin] PATH_INFO: `/v3/projects/68158ac05c32458393eef62c5c50e495/users/ca471f5dadae4473bfd35b2fc0316045/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:46.289337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee961237-59e3-4b59-b1e9-2c14e505e821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68158ac05c32458393eef62c5c50e495, user_id=ca471f5dadae4473bfd35b2fc0316045, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:46.292008 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee961237-59e3-4b59-b1e9-2c14e505e821 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:46.304685 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1313/2632] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:06:46 2022] PUT /identity/v3/projects/68158ac05c32458393eef62c5c50e495/users/ca471f5dadae4473bfd35b2fc0316045/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:06:46.315037 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b387253-c8e8-4ddd-b7e0-5d3750b544e5 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:46.315323 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b387253-c8e8-4ddd-b7e0-5d3750b544e5 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:46.315596 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b387253-c8e8-4ddd-b7e0-5d3750b544e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:46.344372 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-2b387253-c8e8-4ddd-b7e0-5d3750b544e5 None None] MFA Rules not processed for user `ca471f5dadae4473bfd35b2fc0316045`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:06:46.345630 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-2b387253-c8e8-4ddd-b7e0-5d3750b544e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:46.411853 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1320/2633] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:06:46 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:06:46.426639 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee961237-59e3-4b59-b1e9-2c14e505e821 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:46.428352 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-ee961237-59e3-4b59-b1e9-2c14e505e821 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:46.486618 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee961237-59e3-4b59-b1e9-2c14e505e821 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:46.490958 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0a85e-0520-45b0-8485-3bed143791e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:46.491558 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0a85e-0520-45b0-8485-3bed143791e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:46.491839 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0a85e-0520-45b0-8485-3bed143791e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:46.492110 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0a85e-0520-45b0-8485-3bed143791e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:46.500310 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd0a85e-0520-45b0-8485-3bed143791e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:46.501789 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd0a85e-0520-45b0-8485-3bed143791e8 service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:46.510680 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1314/2634] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:06:46 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 18:06:51.513301 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b387253-c8e8-4ddd-b7e0-5d3750b544e5 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:51.545867 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:51.577894 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b387253-c8e8-4ddd-b7e0-5d3750b544e5 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:51.582873 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47123a4-2a32-4330-94e0-80f8cfcd461b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:51.583491 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47123a4-2a32-4330-94e0-80f8cfcd461b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:51.583771 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47123a4-2a32-4330-94e0-80f8cfcd461b admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:51.584037 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47123a4-2a32-4330-94e0-80f8cfcd461b admin admin] PATH_INFO: `/v3/users/ca471f5dadae4473bfd35b2fc0316045` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:51.585181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47123a4-2a32-4330-94e0-80f8cfcd461b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca471f5dadae4473bfd35b2fc0316045)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:51.587081 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47123a4-2a32-4330-94e0-80f8cfcd461b admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:51.632947 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-d47123a4-2a32-4330-94e0-80f8cfcd461b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca471f5dadae4473bfd35b2fc0316045'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:51.640730 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-d47123a4-2a32-4330-94e0-80f8cfcd461b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca471f5dadae4473bfd35b2fc0316045'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:51.641356 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-d47123a4-2a32-4330-94e0-80f8cfcd461b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca471f5dadae4473bfd35b2fc0316045'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:51.641954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-d47123a4-2a32-4330-94e0-80f8cfcd461b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca471f5dadae4473bfd35b2fc0316045'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:51.648841 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-d47123a4-2a32-4330-94e0-80f8cfcd461b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca471f5dadae4473bfd35b2fc0316045'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:51.665513 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1321/2635] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 18:06:51 2022] DELETE /identity/v3/users/ca471f5dadae4473bfd35b2fc0316045 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:06:51.669956 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0b8f5-78ff-4c68-83d7-f95e743ae009 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:51.670449 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0b8f5-78ff-4c68-83d7-f95e743ae009 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:51.670560 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0b8f5-78ff-4c68-83d7-f95e743ae009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:51.690950 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-d2d0b8f5-78ff-4c68-83d7-f95e743ae009 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:06:51.692897 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-d2d0b8f5-78ff-4c68-83d7-f95e743ae009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:51.744144 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47123a4-2a32-4330-94e0-80f8cfcd461b admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:51.745917 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-d47123a4-2a32-4330-94e0-80f8cfcd461b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:51.754695 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1315/2636] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:06:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:06:51.764102 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0b8f5-78ff-4c68-83d7-f95e743ae009 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:51.765482 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-d2d0b8f5-78ff-4c68-83d7-f95e743ae009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:51.780163 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:51.805655 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47123a4-2a32-4330-94e0-80f8cfcd461b admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:51.809475 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c847c-a1eb-4218-b01e-ddef5043de13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:51.810083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c847c-a1eb-4218-b01e-ddef5043de13 service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:51.810458 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c847c-a1eb-4218-b01e-ddef5043de13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:51.810640 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c847c-a1eb-4218-b01e-ddef5043de13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:51.812382 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-d17c847c-a1eb-4218-b01e-ddef5043de13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:51.822386 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c847c-a1eb-4218-b01e-ddef5043de13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:51.823844 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c847c-a1eb-4218-b01e-ddef5043de13 service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:51.828454 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0b8f5-78ff-4c68-83d7-f95e743ae009 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:51.831802 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1322/2637] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:06:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 18:06:51.832064 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abeeb1b-36e9-4ddd-8650-688865cd2cb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:51.832711 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abeeb1b-36e9-4ddd-8650-688865cd2cb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:51.833091 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abeeb1b-36e9-4ddd-8650-688865cd2cb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:51.833410 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abeeb1b-36e9-4ddd-8650-688865cd2cb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:51.842998 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abeeb1b-36e9-4ddd-8650-688865cd2cb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:51.844463 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abeeb1b-36e9-4ddd-8650-688865cd2cb8 service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:51.855219 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1316/2638] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:06:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 18:06:52.383172 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c847c-a1eb-4218-b01e-ddef5043de13 service neutron] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:06:52.385346 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-d17c847c-a1eb-4218-b01e-ddef5043de13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:06:52.410434 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c847c-a1eb-4218-b01e-ddef5043de13 service neutron] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:06:52.416929 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598598a0-4221-4159-9d44-115076c6911c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:06:52.417836 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598598a0-4221-4159-9d44-115076c6911c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:06:52.418090 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598598a0-4221-4159-9d44-115076c6911c admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:06:52.418372 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598598a0-4221-4159-9d44-115076c6911c admin admin] PATH_INFO: `/v3/projects/68158ac05c32458393eef62c5c50e495` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:06:52.419564 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598598a0-4221-4159-9d44-115076c6911c admin admin] RBAC: Authorizing `identity:delete_project(project_id=68158ac05c32458393eef62c5c50e495)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:06:52.421455 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598598a0-4221-4159-9d44-115076c6911c admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:06:52.469973 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:06:52.473231 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-598598a0-4221-4159-9d44-115076c6911c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68158ac05c32458393eef62c5c50e495', 'request_id': 'req-598598a0-4221-4159-9d44-115076c6911c'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:52.480582 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-598598a0-4221-4159-9d44-115076c6911c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68158ac05c32458393eef62c5c50e495', 'request_id': 'req-598598a0-4221-4159-9d44-115076c6911c'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:52.489905 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-598598a0-4221-4159-9d44-115076c6911c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68158ac05c32458393eef62c5c50e495', 'request_id': 'req-598598a0-4221-4159-9d44-115076c6911c'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:52.501583 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-598598a0-4221-4159-9d44-115076c6911c admin admin] The token cache is being invalidate because project 68158ac05c32458393eef62c5c50e495 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:06:52.501870 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-598598a0-4221-4159-9d44-115076c6911c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:52.502507 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-598598a0-4221-4159-9d44-115076c6911c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:06:52.504244 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1323/2639] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:06:52 2022] DELETE /identity/v3/projects/68158ac05c32458393eef62c5c50e495 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:07:01.850648 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=21 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:02.498403 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:28.964414 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abeeb1b-36e9-4ddd-8650-688865cd2cb8 service neutron] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:28.966191 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-3abeeb1b-36e9-4ddd-8650-688865cd2cb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:29.044045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abeeb1b-36e9-4ddd-8650-688865cd2cb8 service neutron] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:29.124574 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5bb1c5-931c-4228-8519-a621540d43f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:29.125146 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bb1c5-931c-4228-8519-a621540d43f2 service nova] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:29.125430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bb1c5-931c-4228-8519-a621540d43f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:29.126222 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bb1c5-931c-4228-8519-a621540d43f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:29.127663 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-8b5bb1c5-931c-4228-8519-a621540d43f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:29.244215 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5bb1c5-931c-4228-8519-a621540d43f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:29.245856 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5bb1c5-931c-4228-8519-a621540d43f2 service nova] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:29.265341 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1317/2640] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:07:28 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:07:32.388416 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598598a0-4221-4159-9d44-115076c6911c admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:32.389876 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-598598a0-4221-4159-9d44-115076c6911c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:32.446043 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598598a0-4221-4159-9d44-115076c6911c admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:32.449586 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9535c-1844-4539-b8d9-35b375fd235c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:32.450179 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9535c-1844-4539-b8d9-35b375fd235c service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:32.450457 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9535c-1844-4539-b8d9-35b375fd235c service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:32.450725 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9535c-1844-4539-b8d9-35b375fd235c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:32.452440 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-3ce9535c-1844-4539-b8d9-35b375fd235c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:32.514458 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9535c-1844-4539-b8d9-35b375fd235c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:32.515882 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9535c-1844-4539-b8d9-35b375fd235c service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:32.526401 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1324/2641] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:07:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:07:35.464493 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5bb1c5-931c-4228-8519-a621540d43f2 service nova] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:35.466488 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-8b5bb1c5-931c-4228-8519-a621540d43f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:35.481813 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5bb1c5-931c-4228-8519-a621540d43f2 service nova] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:35.488173 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e172f-7f91-4f01-bc27-58bd234d4391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:35.488800 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e172f-7f91-4f01-bc27-58bd234d4391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:35.489105 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e172f-7f91-4f01-bc27-58bd234d4391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:35.489397 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e172f-7f91-4f01-bc27-58bd234d4391 admin admin] PATH_INFO: `/v3/users/2b3ef3111ca1492abd44a59756c99e22` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:35.490485 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e172f-7f91-4f01-bc27-58bd234d4391 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b3ef3111ca1492abd44a59756c99e22)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:35.492440 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e172f-7f91-4f01-bc27-58bd234d4391 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:35.494153 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=100 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:35.539432 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b59e172f-7f91-4f01-bc27-58bd234d4391 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b3ef3111ca1492abd44a59756c99e22'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:35.540115 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b59e172f-7f91-4f01-bc27-58bd234d4391 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b3ef3111ca1492abd44a59756c99e22'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:35.540788 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b59e172f-7f91-4f01-bc27-58bd234d4391 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b3ef3111ca1492abd44a59756c99e22'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:35.547649 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b59e172f-7f91-4f01-bc27-58bd234d4391 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b3ef3111ca1492abd44a59756c99e22'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:35.556032 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b59e172f-7f91-4f01-bc27-58bd234d4391 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b3ef3111ca1492abd44a59756c99e22'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:35.572916 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1318/2642] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 18:07:35 2022] DELETE /identity/v3/users/2b3ef3111ca1492abd44a59756c99e22 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:07:35.749579 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9535c-1844-4539-b8d9-35b375fd235c service neutron] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:35.760089 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9535c-1844-4539-b8d9-35b375fd235c service neutron] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:35.816191 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c5217-f8a9-4c16-aa57-48be69f90e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:35.816833 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c5217-f8a9-4c16-aa57-48be69f90e11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:35.817174 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c5217-f8a9-4c16-aa57-48be69f90e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:35.817446 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c5217-f8a9-4c16-aa57-48be69f90e11 admin admin] PATH_INFO: `/v3/projects/894aa7acb7b748ddbd743ea08383ed88` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:35.818566 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c5217-f8a9-4c16-aa57-48be69f90e11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=894aa7acb7b748ddbd743ea08383ed88)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:35.820504 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c5217-f8a9-4c16-aa57-48be69f90e11 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:35.868207 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-764c5217-f8a9-4c16-aa57-48be69f90e11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '894aa7acb7b748ddbd743ea08383ed88', 'request_id': 'req-764c5217-f8a9-4c16-aa57-48be69f90e11'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:35.870113 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:35.874406 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-764c5217-f8a9-4c16-aa57-48be69f90e11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '894aa7acb7b748ddbd743ea08383ed88', 'request_id': 'req-764c5217-f8a9-4c16-aa57-48be69f90e11'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:35.882175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-764c5217-f8a9-4c16-aa57-48be69f90e11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '894aa7acb7b748ddbd743ea08383ed88', 'request_id': 'req-764c5217-f8a9-4c16-aa57-48be69f90e11'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:35.893861 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-764c5217-f8a9-4c16-aa57-48be69f90e11 admin admin] The token cache is being invalidate because project 894aa7acb7b748ddbd743ea08383ed88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:07:35.894226 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-764c5217-f8a9-4c16-aa57-48be69f90e11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:35.894859 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-764c5217-f8a9-4c16-aa57-48be69f90e11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:35.896328 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1325/2643] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:07:35 2022] DELETE /identity/v3/projects/894aa7acb7b748ddbd743ea08383ed88 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:07:35.901424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da42170-7a1a-4266-bad2-d1f2292830c0 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:35.901737 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da42170-7a1a-4266-bad2-d1f2292830c0 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:35.902014 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da42170-7a1a-4266-bad2-d1f2292830c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:35.922030 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-0da42170-7a1a-4266-bad2-d1f2292830c0 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:07:35.923133 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-0da42170-7a1a-4266-bad2-d1f2292830c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:35.983210 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1319/2644] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:07:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:07:35.991169 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece8023-778f-4a78-89ab-77b8a9d1182c None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:35.991485 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece8023-778f-4a78-89ab-77b8a9d1182c None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:35.991783 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece8023-778f-4a78-89ab-77b8a9d1182c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:36.012732 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-bece8023-778f-4a78-89ab-77b8a9d1182c None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:07:36.013967 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-bece8023-778f-4a78-89ab-77b8a9d1182c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:36.022241 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1326/2645] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:07:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:07:36.026483 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da42170-7a1a-4266-bad2-d1f2292830c0 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:36.036684 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da42170-7a1a-4266-bad2-d1f2292830c0 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:36.041416 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3fd9b-595b-4feb-8778-bfef1052f822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:36.042011 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3fd9b-595b-4feb-8778-bfef1052f822 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:36.042290 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3fd9b-595b-4feb-8778-bfef1052f822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:36.042564 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3fd9b-595b-4feb-8778-bfef1052f822 admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:36.043204 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e3fd9b-595b-4feb-8778-bfef1052f822 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 18:07:36.043508 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e3fd9b-595b-4feb-8778-bfef1052f822 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:36.045151 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e3fd9b-595b-4feb-8778-bfef1052f822 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:36.057128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1320/2646] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 18:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 18:07:36.061225 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece8023-778f-4a78-89ab-77b8a9d1182c None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:36.070739 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece8023-778f-4a78-89ab-77b8a9d1182c None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:36.075312 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d940a-a52e-4583-842c-00089a1b7f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:36.075900 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d940a-a52e-4583-842c-00089a1b7f95 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:36.076176 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d940a-a52e-4583-842c-00089a1b7f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:36.076439 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d940a-a52e-4583-842c-00089a1b7f95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:36.077091 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39d940a-a52e-4583-842c-00089a1b7f95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:36.078964 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39d940a-a52e-4583-842c-00089a1b7f95 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:36.105896 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1327/2647] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 18:07:36 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:07:36.110107 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3fd9b-595b-4feb-8778-bfef1052f822 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:36.119909 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3fd9b-595b-4feb-8778-bfef1052f822 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:36.178179 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da807cb8-7a48-4eeb-8e69-5ac4453240ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:36.178710 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da807cb8-7a48-4eeb-8e69-5ac4453240ae admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:36.178991 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da807cb8-7a48-4eeb-8e69-5ac4453240ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:36.179318 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da807cb8-7a48-4eeb-8e69-5ac4453240ae admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:36.179993 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da807cb8-7a48-4eeb-8e69-5ac4453240ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:36.181994 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da807cb8-7a48-4eeb-8e69-5ac4453240ae admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:36.194125 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:36.209275 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1321/2648] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 18:07:36 2022] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:07:36.210847 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d940a-a52e-4583-842c-00089a1b7f95 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:36.222237 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d940a-a52e-4583-842c-00089a1b7f95 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:36.228363 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e322a6-d04f-44a5-8e00-b99f6d3a5023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:36.228976 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e322a6-d04f-44a5-8e00-b99f6d3a5023 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:36.229286 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e322a6-d04f-44a5-8e00-b99f6d3a5023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:36.229558 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e322a6-d04f-44a5-8e00-b99f6d3a5023 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:36.230204 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e322a6-d04f-44a5-8e00-b99f6d3a5023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:36.231796 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e322a6-d04f-44a5-8e00-b99f6d3a5023 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:36.242321 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1328/2649] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:07:36.246488 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da807cb8-7a48-4eeb-8e69-5ac4453240ae admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:36.257380 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da807cb8-7a48-4eeb-8e69-5ac4453240ae admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:36.262254 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42524f39-7680-4b38-b1bb-90950ad7e3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:36.262851 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42524f39-7680-4b38-b1bb-90950ad7e3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:36.263128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42524f39-7680-4b38-b1bb-90950ad7e3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:36.263398 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42524f39-7680-4b38-b1bb-90950ad7e3f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:36.264064 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42524f39-7680-4b38-b1bb-90950ad7e3f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:36.265732 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42524f39-7680-4b38-b1bb-90950ad7e3f5 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:36.277060 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1322/2650] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:07:36.281427 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e322a6-d04f-44a5-8e00-b99f6d3a5023 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:36.291975 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e322a6-d04f-44a5-8e00-b99f6d3a5023 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:36.296611 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba5cf5b-ec40-4067-b45d-84bdeeb7a581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:36.297297 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5cf5b-ec40-4067-b45d-84bdeeb7a581 admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:36.297576 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5cf5b-ec40-4067-b45d-84bdeeb7a581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:36.297847 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5cf5b-ec40-4067-b45d-84bdeeb7a581 admin admin] PATH_INFO: `/v3/projects/75165054f4d9455087583a83f50fb4ef/users/72c68f00e30d4422852898b8ad7582fa/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:36.312468 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba5cf5b-ec40-4067-b45d-84bdeeb7a581 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75165054f4d9455087583a83f50fb4ef, user_id=72c68f00e30d4422852898b8ad7582fa, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:36.315670 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba5cf5b-ec40-4067-b45d-84bdeeb7a581 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:36.329070 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1329/2651] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:07:36 2022] PUT /identity/v3/projects/75165054f4d9455087583a83f50fb4ef/users/72c68f00e30d4422852898b8ad7582fa/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:07:36.341601 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8355a-3163-440c-a895-ce4ec740bc88 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:36.341915 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8355a-3163-440c-a895-ce4ec740bc88 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:36.342188 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8355a-3163-440c-a895-ce4ec740bc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:36.371232 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-abe8355a-3163-440c-a895-ce4ec740bc88 None None] MFA Rules not processed for user `72c68f00e30d4422852898b8ad7582fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:07:36.372463 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-abe8355a-3163-440c-a895-ce4ec740bc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:36.437856 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1323/2652] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:07:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:07:36.442960 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba5cf5b-ec40-4067-b45d-84bdeeb7a581 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:36.503085 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba5cf5b-ec40-4067-b45d-84bdeeb7a581 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:36.507762 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b7d79-d1d9-4121-ac4a-d52bc49e033d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:36.508359 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b7d79-d1d9-4121-ac4a-d52bc49e033d admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:36.508635 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b7d79-d1d9-4121-ac4a-d52bc49e033d admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:36.508935 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b7d79-d1d9-4121-ac4a-d52bc49e033d admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:36.509596 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b7d79-d1d9-4121-ac4a-d52bc49e033d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:36.511488 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b7d79-d1d9-4121-ac4a-d52bc49e033d admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:36.538308 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1330/2653] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 18:07:36 2022] POST /identity/v3/projects => generated 365 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:07:36.542486 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe8355a-3163-440c-a895-ce4ec740bc88 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:36.553607 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe8355a-3163-440c-a895-ce4ec740bc88 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:36.609493 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41aea77-1637-4737-8b80-c1aa8b038d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:36.610090 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41aea77-1637-4737-8b80-c1aa8b038d6f admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:36.610366 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41aea77-1637-4737-8b80-c1aa8b038d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:36.610632 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41aea77-1637-4737-8b80-c1aa8b038d6f admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:36.611811 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41aea77-1637-4737-8b80-c1aa8b038d6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:36.613749 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41aea77-1637-4737-8b80-c1aa8b038d6f admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:36.634821 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1324/2654] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 18:07:36 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:07:36.639066 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b7d79-d1d9-4121-ac4a-d52bc49e033d admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:36.649639 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b7d79-d1d9-4121-ac4a-d52bc49e033d admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:36.654193 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3479a527-e600-4d0c-a38b-106abcfe68fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:36.654781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479a527-e600-4d0c-a38b-106abcfe68fb admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:36.655070 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479a527-e600-4d0c-a38b-106abcfe68fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:36.655319 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479a527-e600-4d0c-a38b-106abcfe68fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:36.655939 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3479a527-e600-4d0c-a38b-106abcfe68fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:36.657542 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3479a527-e600-4d0c-a38b-106abcfe68fb admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:36.668471 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1331/2655] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:07:36.672529 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41aea77-1637-4737-8b80-c1aa8b038d6f admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:36.682484 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41aea77-1637-4737-8b80-c1aa8b038d6f admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:36.687575 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d1114-9847-4f7a-a6a7-71644cc96db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:36.688273 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d1114-9847-4f7a-a6a7-71644cc96db4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:36.688499 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d1114-9847-4f7a-a6a7-71644cc96db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:36.688794 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d1114-9847-4f7a-a6a7-71644cc96db4 admin admin] PATH_INFO: `/v3/projects/660b9b90dbec4534a0842daef4b33960/users/8c1274b60c3e4175ae7da78727b8eb44/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:36.704687 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d1114-9847-4f7a-a6a7-71644cc96db4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=660b9b90dbec4534a0842daef4b33960, user_id=8c1274b60c3e4175ae7da78727b8eb44, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:36.707994 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d1114-9847-4f7a-a6a7-71644cc96db4 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:36.722120 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1325/2656] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:07:36 2022] PUT /identity/v3/projects/660b9b90dbec4534a0842daef4b33960/users/8c1274b60c3e4175ae7da78727b8eb44/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 18:07:36.726118 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3479a527-e600-4d0c-a38b-106abcfe68fb admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:36.735937 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3479a527-e600-4d0c-a38b-106abcfe68fb admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:36.783568 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:36.796002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a7671-eba7-4bf6-9245-776b8978bd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:36.796618 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a7671-eba7-4bf6-9245-776b8978bd91 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:36.796903 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a7671-eba7-4bf6-9245-776b8978bd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:36.797218 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a7671-eba7-4bf6-9245-776b8978bd91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:36.797858 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a7671-eba7-4bf6-9245-776b8978bd91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:36.799470 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a7671-eba7-4bf6-9245-776b8978bd91 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:36.809230 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1332/2657] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:07:36.813337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d1114-9847-4f7a-a6a7-71644cc96db4 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:36.823864 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d1114-9847-4f7a-a6a7-71644cc96db4 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:36.828454 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627bde8-856d-4308-80ef-46de0ced923b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:36.829132 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627bde8-856d-4308-80ef-46de0ced923b admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:36.829412 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627bde8-856d-4308-80ef-46de0ced923b admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:36.829687 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627bde8-856d-4308-80ef-46de0ced923b admin admin] PATH_INFO: `/v3/projects/660b9b90dbec4534a0842daef4b33960/users/8c1274b60c3e4175ae7da78727b8eb44/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:36.831652 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3627bde8-856d-4308-80ef-46de0ced923b admin admin] RBAC: Authorizing `identity:create_grant(project_id=660b9b90dbec4534a0842daef4b33960, user_id=8c1274b60c3e4175ae7da78727b8eb44, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:36.834343 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3627bde8-856d-4308-80ef-46de0ced923b admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:36.845003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1326/2658] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:07:36 2022] PUT /identity/v3/projects/660b9b90dbec4534a0842daef4b33960/users/8c1274b60c3e4175ae7da78727b8eb44/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:07:36.855823 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232b790-99d6-401f-8154-62e11c0cb333 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:36.856113 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232b790-99d6-401f-8154-62e11c0cb333 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:36.856385 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232b790-99d6-401f-8154-62e11c0cb333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:36.883730 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-f232b790-99d6-401f-8154-62e11c0cb333 None None] MFA Rules not processed for user `8c1274b60c3e4175ae7da78727b8eb44`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:07:36.884929 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-f232b790-99d6-401f-8154-62e11c0cb333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:36.950110 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1333/2659] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:07:36 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:07:36.961327 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627bde8-856d-4308-80ef-46de0ced923b admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:36.963060 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-3627bde8-856d-4308-80ef-46de0ced923b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:36.994843 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:37.022870 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627bde8-856d-4308-80ef-46de0ced923b admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:37.026519 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1c9df-61aa-40e3-b6f3-95894196898e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:37.027231 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1c9df-61aa-40e3-b6f3-95894196898e service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:37.027509 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1c9df-61aa-40e3-b6f3-95894196898e service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:37.027777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1c9df-61aa-40e3-b6f3-95894196898e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:37.038561 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa1c9df-61aa-40e3-b6f3-95894196898e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:37.039998 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa1c9df-61aa-40e3-b6f3-95894196898e service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:37.051352 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1327/2660] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:07:36 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:07:37.127870 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232b790-99d6-401f-8154-62e11c0cb333 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:37.137356 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232b790-99d6-401f-8154-62e11c0cb333 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:37.140860 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a72a7-c765-45a5-a0d5-088625204a94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:37.141490 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a72a7-c765-45a5-a0d5-088625204a94 service cinder] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:37.141763 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a72a7-c765-45a5-a0d5-088625204a94 service cinder] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:37.142028 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a72a7-c765-45a5-a0d5-088625204a94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:37.196477 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a72a7-c765-45a5-a0d5-088625204a94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:37.197923 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a72a7-c765-45a5-a0d5-088625204a94 service cinder] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:37.207213 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1334/2661] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:07:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:07:39.941938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1c9df-61aa-40e3-b6f3-95894196898e service cinder] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:40.003610 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1c9df-61aa-40e3-b6f3-95894196898e service cinder] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:40.008159 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513f5d6-4e45-4998-abd5-dd4d8ecf8a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:40.008785 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513f5d6-4e45-4998-abd5-dd4d8ecf8a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:40.009092 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513f5d6-4e45-4998-abd5-dd4d8ecf8a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:40.009368 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513f5d6-4e45-4998-abd5-dd4d8ecf8a21 admin admin] PATH_INFO: `/v3/users/72c68f00e30d4422852898b8ad7582fa` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:40.010481 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513f5d6-4e45-4998-abd5-dd4d8ecf8a21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72c68f00e30d4422852898b8ad7582fa)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:40.012390 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513f5d6-4e45-4998-abd5-dd4d8ecf8a21 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:40.058270 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-5513f5d6-4e45-4998-abd5-dd4d8ecf8a21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72c68f00e30d4422852898b8ad7582fa'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:40.058923 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-5513f5d6-4e45-4998-abd5-dd4d8ecf8a21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72c68f00e30d4422852898b8ad7582fa'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:40.059533 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-5513f5d6-4e45-4998-abd5-dd4d8ecf8a21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72c68f00e30d4422852898b8ad7582fa'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:40.066918 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-5513f5d6-4e45-4998-abd5-dd4d8ecf8a21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72c68f00e30d4422852898b8ad7582fa'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:40.074327 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-5513f5d6-4e45-4998-abd5-dd4d8ecf8a21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72c68f00e30d4422852898b8ad7582fa'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:40.092761 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1328/2662] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 18:07:39 2022] DELETE /identity/v3/users/72c68f00e30d4422852898b8ad7582fa => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:07:40.097369 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917d77e-7ee6-41ce-9985-c773ee01f545 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:40.097884 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917d77e-7ee6-41ce-9985-c773ee01f545 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:40.097884 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917d77e-7ee6-41ce-9985-c773ee01f545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:40.117705 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-1917d77e-7ee6-41ce-9985-c773ee01f545 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:07:40.118882 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-1917d77e-7ee6-41ce-9985-c773ee01f545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:40.176087 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1335/2663] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:07:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:07:40.185941 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513f5d6-4e45-4998-abd5-dd4d8ecf8a21 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:40.187425 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-5513f5d6-4e45-4998-abd5-dd4d8ecf8a21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:40.242345 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:40.246739 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513f5d6-4e45-4998-abd5-dd4d8ecf8a21 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:40.251393 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc575e6-d81b-49c3-873f-cdd4355c9867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:40.252848 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc575e6-d81b-49c3-873f-cdd4355c9867 service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:40.253341 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc575e6-d81b-49c3-873f-cdd4355c9867 service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:40.253842 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc575e6-d81b-49c3-873f-cdd4355c9867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:40.263215 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc575e6-d81b-49c3-873f-cdd4355c9867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:40.264691 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc575e6-d81b-49c3-873f-cdd4355c9867 service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:40.274540 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1329/2664] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:07:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:07:40.545205 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917d77e-7ee6-41ce-9985-c773ee01f545 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:40.546635 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-1917d77e-7ee6-41ce-9985-c773ee01f545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:40.561278 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917d77e-7ee6-41ce-9985-c773ee01f545 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:40.568197 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f54e38-bd89-4d22-9422-c85ab6a58a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:40.568995 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f54e38-bd89-4d22-9422-c85ab6a58a04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:40.569184 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f54e38-bd89-4d22-9422-c85ab6a58a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:40.569662 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f54e38-bd89-4d22-9422-c85ab6a58a04 admin admin] PATH_INFO: `/v3/projects/75165054f4d9455087583a83f50fb4ef` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:40.570724 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f54e38-bd89-4d22-9422-c85ab6a58a04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75165054f4d9455087583a83f50fb4ef)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:40.572956 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f54e38-bd89-4d22-9422-c85ab6a58a04 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:40.579748 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:40.621699 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-a3f54e38-bd89-4d22-9422-c85ab6a58a04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75165054f4d9455087583a83f50fb4ef', 'request_id': 'req-a3f54e38-bd89-4d22-9422-c85ab6a58a04'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:40.627155 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-a3f54e38-bd89-4d22-9422-c85ab6a58a04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75165054f4d9455087583a83f50fb4ef', 'request_id': 'req-a3f54e38-bd89-4d22-9422-c85ab6a58a04'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:40.634557 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-a3f54e38-bd89-4d22-9422-c85ab6a58a04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75165054f4d9455087583a83f50fb4ef', 'request_id': 'req-a3f54e38-bd89-4d22-9422-c85ab6a58a04'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:40.646127 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-a3f54e38-bd89-4d22-9422-c85ab6a58a04 admin admin] The token cache is being invalidate because project 75165054f4d9455087583a83f50fb4ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:07:40.646415 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-a3f54e38-bd89-4d22-9422-c85ab6a58a04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:40.647046 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-a3f54e38-bd89-4d22-9422-c85ab6a58a04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:40.648511 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1336/2665] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:07:40 2022] DELETE /identity/v3/projects/75165054f4d9455087583a83f50fb4ef => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 18:07:40.652544 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc575e6-d81b-49c3-873f-cdd4355c9867 service neutron] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:40.662930 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc575e6-d81b-49c3-873f-cdd4355c9867 service neutron] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:40.719323 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c425fc-f70b-4260-85f1-996b865e0c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:40.719952 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c425fc-f70b-4260-85f1-996b865e0c48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:40.720768 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c425fc-f70b-4260-85f1-996b865e0c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:40.721074 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c425fc-f70b-4260-85f1-996b865e0c48 admin admin] PATH_INFO: `/v3/users/8c1274b60c3e4175ae7da78727b8eb44` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:40.722206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c425fc-f70b-4260-85f1-996b865e0c48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c1274b60c3e4175ae7da78727b8eb44)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:40.724124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c425fc-f70b-4260-85f1-996b865e0c48 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:40.772449 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-47c425fc-f70b-4260-85f1-996b865e0c48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c1274b60c3e4175ae7da78727b8eb44'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:40.773137 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-47c425fc-f70b-4260-85f1-996b865e0c48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c1274b60c3e4175ae7da78727b8eb44'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:40.773786 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-47c425fc-f70b-4260-85f1-996b865e0c48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c1274b60c3e4175ae7da78727b8eb44'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:40.780633 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-47c425fc-f70b-4260-85f1-996b865e0c48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c1274b60c3e4175ae7da78727b8eb44'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:40.788212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-47c425fc-f70b-4260-85f1-996b865e0c48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c1274b60c3e4175ae7da78727b8eb44'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:40.805184 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1330/2666] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 18:07:40 2022] DELETE /identity/v3/users/8c1274b60c3e4175ae7da78727b8eb44 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:07:41.307915 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f54e38-bd89-4d22-9422-c85ab6a58a04 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:41.309542 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-a3f54e38-bd89-4d22-9422-c85ab6a58a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:41.323291 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f54e38-bd89-4d22-9422-c85ab6a58a04 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:41.381816 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56bee4-b5ae-489e-bfae-9df1b5d83393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:41.382500 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56bee4-b5ae-489e-bfae-9df1b5d83393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:41.382821 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56bee4-b5ae-489e-bfae-9df1b5d83393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:41.383525 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56bee4-b5ae-489e-bfae-9df1b5d83393 admin admin] PATH_INFO: `/v3/projects/660b9b90dbec4534a0842daef4b33960` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:41.384378 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56bee4-b5ae-489e-bfae-9df1b5d83393 admin admin] RBAC: Authorizing `identity:delete_project(project_id=660b9b90dbec4534a0842daef4b33960)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:41.386326 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56bee4-b5ae-489e-bfae-9df1b5d83393 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:41.433270 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-cd56bee4-b5ae-489e-bfae-9df1b5d83393 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '660b9b90dbec4534a0842daef4b33960', 'request_id': 'req-cd56bee4-b5ae-489e-bfae-9df1b5d83393'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:41.438815 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-cd56bee4-b5ae-489e-bfae-9df1b5d83393 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '660b9b90dbec4534a0842daef4b33960', 'request_id': 'req-cd56bee4-b5ae-489e-bfae-9df1b5d83393'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:41.446716 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-cd56bee4-b5ae-489e-bfae-9df1b5d83393 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '660b9b90dbec4534a0842daef4b33960', 'request_id': 'req-cd56bee4-b5ae-489e-bfae-9df1b5d83393'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:41.459083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-cd56bee4-b5ae-489e-bfae-9df1b5d83393 admin admin] The token cache is being invalidate because project 660b9b90dbec4534a0842daef4b33960 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:07:41.459369 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-cd56bee4-b5ae-489e-bfae-9df1b5d83393 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:41.460052 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-cd56bee4-b5ae-489e-bfae-9df1b5d83393 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:41.461559 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1337/2667] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:07:41 2022] DELETE /identity/v3/projects/660b9b90dbec4534a0842daef4b33960 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:07:41.466936 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb123a-f46f-4f50-9f0b-0bc72fa966b3 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:41.467423 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb123a-f46f-4f50-9f0b-0bc72fa966b3 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:41.467533 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb123a-f46f-4f50-9f0b-0bc72fa966b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:41.487909 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-9feb123a-f46f-4f50-9f0b-0bc72fa966b3 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:07:41.489140 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-9feb123a-f46f-4f50-9f0b-0bc72fa966b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:41.547406 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1331/2668] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:07:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:07:41.555777 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e2a22-7d75-4873-b39c-23772e183ef2 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:41.556093 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e2a22-7d75-4873-b39c-23772e183ef2 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:41.556362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e2a22-7d75-4873-b39c-23772e183ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:41.575816 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-bb1e2a22-7d75-4873-b39c-23772e183ef2 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:07:41.577020 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-bb1e2a22-7d75-4873-b39c-23772e183ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:41.585345 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1338/2669] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:07:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:07:41.589480 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb123a-f46f-4f50-9f0b-0bc72fa966b3 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:41.599952 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb123a-f46f-4f50-9f0b-0bc72fa966b3 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:41.604436 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb51bf0-d14e-4f5c-a985-ef0874102dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:41.605041 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb51bf0-d14e-4f5c-a985-ef0874102dba admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:41.605325 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb51bf0-d14e-4f5c-a985-ef0874102dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:41.605590 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb51bf0-d14e-4f5c-a985-ef0874102dba admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:41.606231 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb51bf0-d14e-4f5c-a985-ef0874102dba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 18:07:41.606529 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb51bf0-d14e-4f5c-a985-ef0874102dba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:41.608113 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb51bf0-d14e-4f5c-a985-ef0874102dba admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:41.614848 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:41.624319 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1332/2670] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 18:07:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 18:07:41.625545 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e2a22-7d75-4873-b39c-23772e183ef2 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:41.634737 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e2a22-7d75-4873-b39c-23772e183ef2 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:41.639408 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191697e-6525-44e7-9b4f-5a8a8e3f276e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:41.639997 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191697e-6525-44e7-9b4f-5a8a8e3f276e admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:41.640277 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191697e-6525-44e7-9b4f-5a8a8e3f276e admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:41.640545 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191697e-6525-44e7-9b4f-5a8a8e3f276e admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:41.641206 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191697e-6525-44e7-9b4f-5a8a8e3f276e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:41.643666 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191697e-6525-44e7-9b4f-5a8a8e3f276e admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:41.660254 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:41.673315 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1339/2671] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 18:07:41 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:07:41.677502 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb51bf0-d14e-4f5c-a985-ef0874102dba admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:41.687259 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb51bf0-d14e-4f5c-a985-ef0874102dba admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:41.744906 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec97e1c-c5e3-4868-8494-a1684b8d0533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:41.745562 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec97e1c-c5e3-4868-8494-a1684b8d0533 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:41.745840 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec97e1c-c5e3-4868-8494-a1684b8d0533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:41.746113 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec97e1c-c5e3-4868-8494-a1684b8d0533 admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:41.746753 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec97e1c-c5e3-4868-8494-a1684b8d0533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:41.748877 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec97e1c-c5e3-4868-8494-a1684b8d0533 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:41.771904 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1333/2672] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 18:07:41 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:07:41.783316 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191697e-6525-44e7-9b4f-5a8a8e3f276e admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:41.794407 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191697e-6525-44e7-9b4f-5a8a8e3f276e admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:41.799317 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3f948-0c04-4f81-96e8-6b0ca8a86947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:41.799908 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3f948-0c04-4f81-96e8-6b0ca8a86947 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:41.800187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3f948-0c04-4f81-96e8-6b0ca8a86947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:41.800597 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3f948-0c04-4f81-96e8-6b0ca8a86947 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:41.801240 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3f948-0c04-4f81-96e8-6b0ca8a86947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:41.802821 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3f948-0c04-4f81-96e8-6b0ca8a86947 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:41.812810 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1340/2673] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:07:41.816782 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec97e1c-c5e3-4868-8494-a1684b8d0533 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:41.826484 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec97e1c-c5e3-4868-8494-a1684b8d0533 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:41.831564 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39129827-5279-47b9-af12-d99ac2e0f20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:41.832150 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39129827-5279-47b9-af12-d99ac2e0f20f admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:41.832427 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39129827-5279-47b9-af12-d99ac2e0f20f admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:41.832695 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39129827-5279-47b9-af12-d99ac2e0f20f admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:41.833388 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39129827-5279-47b9-af12-d99ac2e0f20f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:41.834966 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39129827-5279-47b9-af12-d99ac2e0f20f admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:41.846360 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1334/2674] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:07:41.850426 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3f948-0c04-4f81-96e8-6b0ca8a86947 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:41.860175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3f948-0c04-4f81-96e8-6b0ca8a86947 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:41.864809 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a93cf3-5a8f-4f7a-bea2-36eb1900f19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:41.865488 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a93cf3-5a8f-4f7a-bea2-36eb1900f19d admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:41.865763 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a93cf3-5a8f-4f7a-bea2-36eb1900f19d admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:41.866029 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a93cf3-5a8f-4f7a-bea2-36eb1900f19d admin admin] PATH_INFO: `/v3/projects/0f09be36ef584332958b9ef72ec41508/users/b3f3ef95db7e4279bc1cf4aa6c00d2e9/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:41.880047 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a93cf3-5a8f-4f7a-bea2-36eb1900f19d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f09be36ef584332958b9ef72ec41508, user_id=b3f3ef95db7e4279bc1cf4aa6c00d2e9, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:41.882706 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a93cf3-5a8f-4f7a-bea2-36eb1900f19d admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:41.896032 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1341/2675] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:07:41 2022] PUT /identity/v3/projects/0f09be36ef584332958b9ef72ec41508/users/b3f3ef95db7e4279bc1cf4aa6c00d2e9/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:07:41.907525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897b773-d321-4b21-8e08-6f2e75ab636b None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:41.908429 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897b773-d321-4b21-8e08-6f2e75ab636b None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:41.908702 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897b773-d321-4b21-8e08-6f2e75ab636b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:41.935900 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-6897b773-d321-4b21-8e08-6f2e75ab636b None None] MFA Rules not processed for user `b3f3ef95db7e4279bc1cf4aa6c00d2e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:07:41.937154 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-6897b773-d321-4b21-8e08-6f2e75ab636b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:42.001289 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1335/2676] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:07:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:07:42.005735 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a93cf3-5a8f-4f7a-bea2-36eb1900f19d admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:42.075841 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a93cf3-5a8f-4f7a-bea2-36eb1900f19d admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:42.080465 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62306414-abd5-4565-b87a-29dec1a9463f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:42.081089 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62306414-abd5-4565-b87a-29dec1a9463f admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:42.081373 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62306414-abd5-4565-b87a-29dec1a9463f admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:42.081853 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62306414-abd5-4565-b87a-29dec1a9463f admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:42.082286 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62306414-abd5-4565-b87a-29dec1a9463f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:42.084165 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62306414-abd5-4565-b87a-29dec1a9463f admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:42.112154 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1342/2677] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 18:07:42 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 18:07:42.116378 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897b773-d321-4b21-8e08-6f2e75ab636b None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:42.126994 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897b773-d321-4b21-8e08-6f2e75ab636b None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:42.182992 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f18130-2e8a-4473-940d-929b630b717b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:42.183595 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f18130-2e8a-4473-940d-929b630b717b admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:42.183874 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f18130-2e8a-4473-940d-929b630b717b admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:42.184151 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f18130-2e8a-4473-940d-929b630b717b admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:42.184788 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f18130-2e8a-4473-940d-929b630b717b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:42.186749 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f18130-2e8a-4473-940d-929b630b717b admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:42.197881 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:42.208709 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1336/2678] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 18:07:42 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:07:42.212692 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62306414-abd5-4565-b87a-29dec1a9463f admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:42.223897 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62306414-abd5-4565-b87a-29dec1a9463f admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:42.231175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28bf8a-1392-44f2-92a4-850492669bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:42.231773 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28bf8a-1392-44f2-92a4-850492669bed admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:42.232053 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28bf8a-1392-44f2-92a4-850492669bed admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:42.232326 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28bf8a-1392-44f2-92a4-850492669bed admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:42.232960 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28bf8a-1392-44f2-92a4-850492669bed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:42.234569 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28bf8a-1392-44f2-92a4-850492669bed admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:42.246115 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1343/2679] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:07:42.250150 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f18130-2e8a-4473-940d-929b630b717b admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:42.260602 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f18130-2e8a-4473-940d-929b630b717b admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:42.265422 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e3956-1a16-4bd3-9d62-c781cc4499c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:42.266079 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e3956-1a16-4bd3-9d62-c781cc4499c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:42.266353 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e3956-1a16-4bd3-9d62-c781cc4499c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:42.266630 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e3956-1a16-4bd3-9d62-c781cc4499c9 admin admin] PATH_INFO: `/v3/projects/55c193724b44493481339dee9a26a9e2/users/c92a095b9e13450a8ad45d03b45c653f/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:42.281712 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e3956-1a16-4bd3-9d62-c781cc4499c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55c193724b44493481339dee9a26a9e2, user_id=c92a095b9e13450a8ad45d03b45c653f, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:42.285259 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e3956-1a16-4bd3-9d62-c781cc4499c9 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:42.298105 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1337/2680] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:07:42 2022] PUT /identity/v3/projects/55c193724b44493481339dee9a26a9e2/users/c92a095b9e13450a8ad45d03b45c653f/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:07:42.302752 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28bf8a-1392-44f2-92a4-850492669bed admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:42.312682 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28bf8a-1392-44f2-92a4-850492669bed admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:42.370733 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6edc441-4eee-496f-a27a-5ebde3996b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:42.371338 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6edc441-4eee-496f-a27a-5ebde3996b3a admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:42.371626 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6edc441-4eee-496f-a27a-5ebde3996b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:42.371894 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6edc441-4eee-496f-a27a-5ebde3996b3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:42.372529 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6edc441-4eee-496f-a27a-5ebde3996b3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:42.374155 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6edc441-4eee-496f-a27a-5ebde3996b3a admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:42.384937 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1344/2681] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:07:42.392164 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e3956-1a16-4bd3-9d62-c781cc4499c9 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:42.399874 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e3956-1a16-4bd3-9d62-c781cc4499c9 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:42.404557 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f197eae-56b0-4d00-8a96-30e34e1f81f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:42.405239 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f197eae-56b0-4d00-8a96-30e34e1f81f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:42.405514 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f197eae-56b0-4d00-8a96-30e34e1f81f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:42.405782 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f197eae-56b0-4d00-8a96-30e34e1f81f3 admin admin] PATH_INFO: `/v3/projects/55c193724b44493481339dee9a26a9e2/users/c92a095b9e13450a8ad45d03b45c653f/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:42.407727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f197eae-56b0-4d00-8a96-30e34e1f81f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55c193724b44493481339dee9a26a9e2, user_id=c92a095b9e13450a8ad45d03b45c653f, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:42.410408 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f197eae-56b0-4d00-8a96-30e34e1f81f3 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:42.420790 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1338/2682] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:07:42 2022] PUT /identity/v3/projects/55c193724b44493481339dee9a26a9e2/users/c92a095b9e13450a8ad45d03b45c653f/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:07:42.431688 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05df71e-3f0a-40bc-a8a5-d6f03ab6dd11 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:42.431971 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05df71e-3f0a-40bc-a8a5-d6f03ab6dd11 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:42.432245 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05df71e-3f0a-40bc-a8a5-d6f03ab6dd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:42.459861 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-e05df71e-3f0a-40bc-a8a5-d6f03ab6dd11 None None] MFA Rules not processed for user `c92a095b9e13450a8ad45d03b45c653f`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:07:42.461087 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-e05df71e-3f0a-40bc-a8a5-d6f03ab6dd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:42.479031 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:42.529570 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1345/2683] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:07:42 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:07:42.540799 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f197eae-56b0-4d00-8a96-30e34e1f81f3 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:42.542609 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-5f197eae-56b0-4d00-8a96-30e34e1f81f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:42.600346 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f197eae-56b0-4d00-8a96-30e34e1f81f3 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:42.603974 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f911c7-d9be-4a15-aa2d-9976276cd039 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:42.604579 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f911c7-d9be-4a15-aa2d-9976276cd039 service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:42.604875 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f911c7-d9be-4a15-aa2d-9976276cd039 service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:42.605165 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f911c7-d9be-4a15-aa2d-9976276cd039 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:42.614082 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f911c7-d9be-4a15-aa2d-9976276cd039 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:42.615510 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f911c7-d9be-4a15-aa2d-9976276cd039 service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:42.624655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1339/2684] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:07:42 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:07:42.692351 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05df71e-3f0a-40bc-a8a5-d6f03ab6dd11 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:42.752801 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05df71e-3f0a-40bc-a8a5-d6f03ab6dd11 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:42.757429 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593fb04-45cd-412b-94ab-9cc8716cfcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:42.758052 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593fb04-45cd-412b-94ab-9cc8716cfcf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:42.758327 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593fb04-45cd-412b-94ab-9cc8716cfcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:42.758596 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593fb04-45cd-412b-94ab-9cc8716cfcf1 admin admin] PATH_INFO: `/v3/users/b3f3ef95db7e4279bc1cf4aa6c00d2e9` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:42.759699 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3593fb04-45cd-412b-94ab-9cc8716cfcf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3f3ef95db7e4279bc1cf4aa6c00d2e9)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:42.761640 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3593fb04-45cd-412b-94ab-9cc8716cfcf1 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:42.809779 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-3593fb04-45cd-412b-94ab-9cc8716cfcf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3f3ef95db7e4279bc1cf4aa6c00d2e9'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:42.817864 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-3593fb04-45cd-412b-94ab-9cc8716cfcf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3f3ef95db7e4279bc1cf4aa6c00d2e9'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:42.818487 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-3593fb04-45cd-412b-94ab-9cc8716cfcf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3f3ef95db7e4279bc1cf4aa6c00d2e9'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:42.819097 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-3593fb04-45cd-412b-94ab-9cc8716cfcf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3f3ef95db7e4279bc1cf4aa6c00d2e9'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:42.826087 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-3593fb04-45cd-412b-94ab-9cc8716cfcf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3f3ef95db7e4279bc1cf4aa6c00d2e9'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:42.843754 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1346/2685] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 18:07:42 2022] DELETE /identity/v3/users/b3f3ef95db7e4279bc1cf4aa6c00d2e9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:07:42.848594 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f1346-0818-48ee-b0d8-c9b67f428645 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:42.849583 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f1346-0818-48ee-b0d8-c9b67f428645 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:42.849583 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f1346-0818-48ee-b0d8-c9b67f428645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:42.869001 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-d21f1346-0818-48ee-b0d8-c9b67f428645 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:07:42.870241 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-d21f1346-0818-48ee-b0d8-c9b67f428645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:42.927911 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1340/2686] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:07:42.937514 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593fb04-45cd-412b-94ab-9cc8716cfcf1 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:42.939461 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-3593fb04-45cd-412b-94ab-9cc8716cfcf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:42.985496 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:43.004434 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593fb04-45cd-412b-94ab-9cc8716cfcf1 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:43.008210 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a106080-c5a5-4d06-ba8c-9b9b762b2fb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:43.008812 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a106080-c5a5-4d06-ba8c-9b9b762b2fb7 service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:43.009140 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a106080-c5a5-4d06-ba8c-9b9b762b2fb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:43.009430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a106080-c5a5-4d06-ba8c-9b9b762b2fb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:43.018868 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a106080-c5a5-4d06-ba8c-9b9b762b2fb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:43.020288 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a106080-c5a5-4d06-ba8c-9b9b762b2fb7 service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:43.029669 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1347/2687] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:07:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:07:43.300097 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f1346-0818-48ee-b0d8-c9b67f428645 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:43.302169 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-d21f1346-0818-48ee-b0d8-c9b67f428645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:43.314396 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f1346-0818-48ee-b0d8-c9b67f428645 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:43.318994 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261eda73-9efd-4809-a28e-a21804c2eee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:43.319626 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261eda73-9efd-4809-a28e-a21804c2eee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:43.319937 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261eda73-9efd-4809-a28e-a21804c2eee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:43.320175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261eda73-9efd-4809-a28e-a21804c2eee0 admin admin] PATH_INFO: `/v3/projects/0f09be36ef584332958b9ef72ec41508` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:43.321346 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261eda73-9efd-4809-a28e-a21804c2eee0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f09be36ef584332958b9ef72ec41508)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:43.323261 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261eda73-9efd-4809-a28e-a21804c2eee0 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:43.370967 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-261eda73-9efd-4809-a28e-a21804c2eee0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f09be36ef584332958b9ef72ec41508', 'request_id': 'req-261eda73-9efd-4809-a28e-a21804c2eee0'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:43.375715 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:43.377154 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-261eda73-9efd-4809-a28e-a21804c2eee0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f09be36ef584332958b9ef72ec41508', 'request_id': 'req-261eda73-9efd-4809-a28e-a21804c2eee0'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:43.386279 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-261eda73-9efd-4809-a28e-a21804c2eee0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f09be36ef584332958b9ef72ec41508', 'request_id': 'req-261eda73-9efd-4809-a28e-a21804c2eee0'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:43.399116 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-261eda73-9efd-4809-a28e-a21804c2eee0 admin admin] The token cache is being invalidate because project 0f09be36ef584332958b9ef72ec41508 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:07:43.399407 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-261eda73-9efd-4809-a28e-a21804c2eee0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:43.400057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-261eda73-9efd-4809-a28e-a21804c2eee0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:43.401594 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1341/2688] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:07:43 2022] DELETE /identity/v3/projects/0f09be36ef584332958b9ef72ec41508 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 18:07:43.405745 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a106080-c5a5-4d06-ba8c-9b9b762b2fb7 service neutron] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:43.415988 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a106080-c5a5-4d06-ba8c-9b9b762b2fb7 service neutron] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:43.480110 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52194078-8431-4a45-825b-f4fb24536879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:43.480740 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52194078-8431-4a45-825b-f4fb24536879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:43.481028 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52194078-8431-4a45-825b-f4fb24536879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:43.481321 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52194078-8431-4a45-825b-f4fb24536879 admin admin] PATH_INFO: `/v3/users/c92a095b9e13450a8ad45d03b45c653f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:43.482432 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52194078-8431-4a45-825b-f4fb24536879 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c92a095b9e13450a8ad45d03b45c653f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:43.484329 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52194078-8431-4a45-825b-f4fb24536879 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:43.530672 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-52194078-8431-4a45-825b-f4fb24536879 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c92a095b9e13450a8ad45d03b45c653f'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:43.538576 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-52194078-8431-4a45-825b-f4fb24536879 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c92a095b9e13450a8ad45d03b45c653f'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:43.539188 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-52194078-8431-4a45-825b-f4fb24536879 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c92a095b9e13450a8ad45d03b45c653f'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:43.539782 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-52194078-8431-4a45-825b-f4fb24536879 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c92a095b9e13450a8ad45d03b45c653f'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:43.546788 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-52194078-8431-4a45-825b-f4fb24536879 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c92a095b9e13450a8ad45d03b45c653f'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:43.564647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1348/2689] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 18:07:43 2022] DELETE /identity/v3/users/c92a095b9e13450a8ad45d03b45c653f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:07:43.869743 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261eda73-9efd-4809-a28e-a21804c2eee0 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:43.871317 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-261eda73-9efd-4809-a28e-a21804c2eee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:43.885229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261eda73-9efd-4809-a28e-a21804c2eee0 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:43.949003 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5730228-a97f-440d-bd05-4111de594648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:43.949658 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5730228-a97f-440d-bd05-4111de594648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:43.949934 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5730228-a97f-440d-bd05-4111de594648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:43.950201 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5730228-a97f-440d-bd05-4111de594648 admin admin] PATH_INFO: `/v3/projects/55c193724b44493481339dee9a26a9e2` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:43.951627 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5730228-a97f-440d-bd05-4111de594648 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55c193724b44493481339dee9a26a9e2)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:43.953602 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5730228-a97f-440d-bd05-4111de594648 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:44.006685 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-a5730228-a97f-440d-bd05-4111de594648 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55c193724b44493481339dee9a26a9e2', 'request_id': 'req-a5730228-a97f-440d-bd05-4111de594648'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:44.022025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-a5730228-a97f-440d-bd05-4111de594648 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55c193724b44493481339dee9a26a9e2', 'request_id': 'req-a5730228-a97f-440d-bd05-4111de594648'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:44.031798 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-a5730228-a97f-440d-bd05-4111de594648 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55c193724b44493481339dee9a26a9e2', 'request_id': 'req-a5730228-a97f-440d-bd05-4111de594648'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:44.046889 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-a5730228-a97f-440d-bd05-4111de594648 admin admin] The token cache is being invalidate because project 55c193724b44493481339dee9a26a9e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:07:44.047171 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-a5730228-a97f-440d-bd05-4111de594648 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:44.047824 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-a5730228-a97f-440d-bd05-4111de594648 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:44.050132 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1342/2690] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:07:43 2022] DELETE /identity/v3/projects/55c193724b44493481339dee9a26a9e2 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:07:44.055120 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ee0e3-4178-476c-bf60-89aa2320cc14 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:44.055404 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ee0e3-4178-476c-bf60-89aa2320cc14 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:44.055673 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ee0e3-4178-476c-bf60-89aa2320cc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:44.076463 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-de4ee0e3-4178-476c-bf60-89aa2320cc14 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:07:44.077693 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-de4ee0e3-4178-476c-bf60-89aa2320cc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:44.131718 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:44.144919 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1349/2691] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:07:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:07:44.152908 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa37428-fdcb-4c6f-a942-3a32e049af88 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:44.153490 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa37428-fdcb-4c6f-a942-3a32e049af88 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:44.153766 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa37428-fdcb-4c6f-a942-3a32e049af88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:44.176716 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-bfa37428-fdcb-4c6f-a942-3a32e049af88 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:07:44.177411 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-bfa37428-fdcb-4c6f-a942-3a32e049af88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:44.185366 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1343/2692] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:07:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:07:44.189828 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ee0e3-4178-476c-bf60-89aa2320cc14 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:44.199638 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ee0e3-4178-476c-bf60-89aa2320cc14 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:44.205078 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8de49-c7de-4288-b7b5-401f042992b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:44.205684 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8de49-c7de-4288-b7b5-401f042992b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:44.205957 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8de49-c7de-4288-b7b5-401f042992b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:44.206225 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8de49-c7de-4288-b7b5-401f042992b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:44.206869 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8de49-c7de-4288-b7b5-401f042992b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 18:07:44.207161 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8de49-c7de-4288-b7b5-401f042992b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:44.208899 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8de49-c7de-4288-b7b5-401f042992b9 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:44.221722 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1350/2693] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 18:07:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 18:07:44.227104 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa37428-fdcb-4c6f-a942-3a32e049af88 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:44.236200 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa37428-fdcb-4c6f-a942-3a32e049af88 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:44.240786 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e19ac04-78f3-4106-8cdd-d455cd35933c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:44.241407 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19ac04-78f3-4106-8cdd-d455cd35933c admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:44.241680 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19ac04-78f3-4106-8cdd-d455cd35933c admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:44.241944 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19ac04-78f3-4106-8cdd-d455cd35933c admin admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:44.242580 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e19ac04-78f3-4106-8cdd-d455cd35933c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:44.244462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e19ac04-78f3-4106-8cdd-d455cd35933c admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:44.271226 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1344/2694] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 18:07:44 2022] POST /identity/v3/projects => generated 389 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 18:07:44.275280 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8de49-c7de-4288-b7b5-401f042992b9 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:44.286749 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8de49-c7de-4288-b7b5-401f042992b9 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:44.342501 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be38669-1a69-4ee7-af93-9f31fbb02e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:44.343097 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be38669-1a69-4ee7-af93-9f31fbb02e04 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:44.343376 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be38669-1a69-4ee7-af93-9f31fbb02e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:44.343645 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be38669-1a69-4ee7-af93-9f31fbb02e04 admin admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:44.344294 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be38669-1a69-4ee7-af93-9f31fbb02e04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:44.346806 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be38669-1a69-4ee7-af93-9f31fbb02e04 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:44.367603 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1351/2695] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 18:07:44 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 18:07:44.371870 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e19ac04-78f3-4106-8cdd-d455cd35933c admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:44.382946 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e19ac04-78f3-4106-8cdd-d455cd35933c admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:44.387747 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874a8bb-b5dc-418e-b73f-df121593a4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:44.388353 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874a8bb-b5dc-418e-b73f-df121593a4dd admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:44.388634 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874a8bb-b5dc-418e-b73f-df121593a4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:44.388907 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874a8bb-b5dc-418e-b73f-df121593a4dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:44.389580 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5874a8bb-b5dc-418e-b73f-df121593a4dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:44.391175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5874a8bb-b5dc-418e-b73f-df121593a4dd admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:44.402485 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1345/2696] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:07:44.406523 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be38669-1a69-4ee7-af93-9f31fbb02e04 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:44.417385 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be38669-1a69-4ee7-af93-9f31fbb02e04 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:44.421775 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee252c8-28ef-46cd-92f9-18e59175f77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:44.422368 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee252c8-28ef-46cd-92f9-18e59175f77d admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:44.422647 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee252c8-28ef-46cd-92f9-18e59175f77d admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:44.422920 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee252c8-28ef-46cd-92f9-18e59175f77d admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:44.423560 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee252c8-28ef-46cd-92f9-18e59175f77d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:44.425495 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee252c8-28ef-46cd-92f9-18e59175f77d admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:44.435737 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1352/2697] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 18:07:44.439900 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874a8bb-b5dc-418e-b73f-df121593a4dd admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:44.449946 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874a8bb-b5dc-418e-b73f-df121593a4dd admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:44.454994 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f88100-d391-4616-aa25-303434be3cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:44.455631 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f88100-d391-4616-aa25-303434be3cf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:44.455908 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f88100-d391-4616-aa25-303434be3cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:44.456179 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f88100-d391-4616-aa25-303434be3cf0 admin admin] PATH_INFO: `/v3/projects/075e7a3d86784c7294b6142aa362000b/users/cbbe3f710af2470b935a949096d2813f/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:44.470699 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f88100-d391-4616-aa25-303434be3cf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=075e7a3d86784c7294b6142aa362000b, user_id=cbbe3f710af2470b935a949096d2813f, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:44.473560 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f88100-d391-4616-aa25-303434be3cf0 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:44.486740 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1346/2698] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:07:44 2022] PUT /identity/v3/projects/075e7a3d86784c7294b6142aa362000b/users/cbbe3f710af2470b935a949096d2813f/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:07:44.498363 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfec1dc-f54c-4c1e-833a-7952068de37c None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:44.498673 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfec1dc-f54c-4c1e-833a-7952068de37c None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:44.498992 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfec1dc-f54c-4c1e-833a-7952068de37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:44.527022 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-5cfec1dc-f54c-4c1e-833a-7952068de37c None None] MFA Rules not processed for user `cbbe3f710af2470b935a949096d2813f`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:07:44.528241 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-5cfec1dc-f54c-4c1e-833a-7952068de37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:44.590851 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1353/2699] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:07:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:07:44.596004 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f88100-d391-4616-aa25-303434be3cf0 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:44.608250 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:44.659462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f88100-d391-4616-aa25-303434be3cf0 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:44.664008 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dcf426-190e-4d3f-b731-e852c44e5d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:44.664605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcf426-190e-4d3f-b731-e852c44e5d93 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:44.664882 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcf426-190e-4d3f-b731-e852c44e5d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:44.665197 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcf426-190e-4d3f-b731-e852c44e5d93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:44.665825 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dcf426-190e-4d3f-b731-e852c44e5d93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:44.667716 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dcf426-190e-4d3f-b731-e852c44e5d93 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:44.694754 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1347/2700] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 18:07:44 2022] POST /identity/v3/projects => generated 389 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:07:44.698949 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfec1dc-f54c-4c1e-833a-7952068de37c None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:44.710857 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfec1dc-f54c-4c1e-833a-7952068de37c None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:44.757865 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:44.768197 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c2f67-1c69-4a5b-8e1a-5daddec457ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:44.768813 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c2f67-1c69-4a5b-8e1a-5daddec457ce admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:44.769136 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c2f67-1c69-4a5b-8e1a-5daddec457ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:44.769407 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c2f67-1c69-4a5b-8e1a-5daddec457ce admin admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:44.770056 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c2f67-1c69-4a5b-8e1a-5daddec457ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:44.772024 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c2f67-1c69-4a5b-8e1a-5daddec457ce admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:44.793803 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1354/2701] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 18:07:44 2022] POST /identity/v3/users => generated 301 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:07:44.797784 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dcf426-190e-4d3f-b731-e852c44e5d93 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:44.808921 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dcf426-190e-4d3f-b731-e852c44e5d93 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:44.813557 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da908574-1697-4914-8ce8-d75ab44e1976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:44.814148 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da908574-1697-4914-8ce8-d75ab44e1976 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:44.814424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da908574-1697-4914-8ce8-d75ab44e1976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:44.814698 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da908574-1697-4914-8ce8-d75ab44e1976 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:44.815334 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da908574-1697-4914-8ce8-d75ab44e1976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:44.817075 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da908574-1697-4914-8ce8-d75ab44e1976 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:44.827595 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1348/2702] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:07:44.831945 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c2f67-1c69-4a5b-8e1a-5daddec457ce admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:44.842736 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c2f67-1c69-4a5b-8e1a-5daddec457ce admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:44.850475 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5ddc4-8a17-407e-a5aa-fb4ad35d4dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:44.850475 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5ddc4-8a17-407e-a5aa-fb4ad35d4dd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:44.850751 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5ddc4-8a17-407e-a5aa-fb4ad35d4dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:44.851773 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5ddc4-8a17-407e-a5aa-fb4ad35d4dd7 admin admin] PATH_INFO: `/v3/projects/fe931e6641f048f4bb22ddf1f52c972e/users/709a1e7519644473b17a97fafe7a64d8/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:44.866813 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5ddc4-8a17-407e-a5aa-fb4ad35d4dd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe931e6641f048f4bb22ddf1f52c972e, user_id=709a1e7519644473b17a97fafe7a64d8, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:44.869520 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5ddc4-8a17-407e-a5aa-fb4ad35d4dd7 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:44.882020 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1355/2703] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:07:44 2022] PUT /identity/v3/projects/fe931e6641f048f4bb22ddf1f52c972e/users/709a1e7519644473b17a97fafe7a64d8/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:07:44.886062 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da908574-1697-4914-8ce8-d75ab44e1976 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:44.895960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da908574-1697-4914-8ce8-d75ab44e1976 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:44.951310 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb1d0b-2392-4a05-9292-e2d3a5fc4f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:44.951910 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb1d0b-2392-4a05-9292-e2d3a5fc4f26 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:44.952193 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb1d0b-2392-4a05-9292-e2d3a5fc4f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:44.952463 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb1d0b-2392-4a05-9292-e2d3a5fc4f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:44.953128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb1d0b-2392-4a05-9292-e2d3a5fc4f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:44.955308 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb1d0b-2392-4a05-9292-e2d3a5fc4f26 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:44.964981 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1349/2704] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 18:07:44.969446 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5ddc4-8a17-407e-a5aa-fb4ad35d4dd7 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:44.980581 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5ddc4-8a17-407e-a5aa-fb4ad35d4dd7 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:44.985134 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f3491-0543-4d2a-bdfb-ff85c7052934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:44.986282 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f3491-0543-4d2a-bdfb-ff85c7052934 admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:44.986556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f3491-0543-4d2a-bdfb-ff85c7052934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:44.986815 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f3491-0543-4d2a-bdfb-ff85c7052934 admin admin] PATH_INFO: `/v3/projects/fe931e6641f048f4bb22ddf1f52c972e/users/709a1e7519644473b17a97fafe7a64d8/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:44.988982 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f3491-0543-4d2a-bdfb-ff85c7052934 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe931e6641f048f4bb22ddf1f52c972e, user_id=709a1e7519644473b17a97fafe7a64d8, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:44.991639 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f3491-0543-4d2a-bdfb-ff85c7052934 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:45.002310 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1356/2705] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:07:44 2022] PUT /identity/v3/projects/fe931e6641f048f4bb22ddf1f52c972e/users/709a1e7519644473b17a97fafe7a64d8/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:07:45.012534 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f77ee-9e6c-4a5c-b76e-21eb8883cae0 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:45.012823 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f77ee-9e6c-4a5c-b76e-21eb8883cae0 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:45.013140 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f77ee-9e6c-4a5c-b76e-21eb8883cae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:45.041529 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-321f77ee-9e6c-4a5c-b76e-21eb8883cae0 None None] MFA Rules not processed for user `709a1e7519644473b17a97fafe7a64d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:07:45.042721 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-321f77ee-9e6c-4a5c-b76e-21eb8883cae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:45.112614 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1350/2706] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:07:45 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:07:45.123019 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f3491-0543-4d2a-bdfb-ff85c7052934 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:45.124712 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-2a6f3491-0543-4d2a-bdfb-ff85c7052934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:45.181899 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f3491-0543-4d2a-bdfb-ff85c7052934 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:45.185473 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef799811-cb86-4da2-845a-844db5652b30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:45.186064 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef799811-cb86-4da2-845a-844db5652b30 service cinder] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:45.186338 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef799811-cb86-4da2-845a-844db5652b30 service cinder] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:45.186606 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef799811-cb86-4da2-845a-844db5652b30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:45.195302 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef799811-cb86-4da2-845a-844db5652b30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:45.196701 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef799811-cb86-4da2-845a-844db5652b30 service cinder] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:45.206441 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1357/2707] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:07:45 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:07:45.340729 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f77ee-9e6c-4a5c-b76e-21eb8883cae0 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:45.350231 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:45.420357 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f77ee-9e6c-4a5c-b76e-21eb8883cae0 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:45.424979 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d4498-bd94-4401-aa3a-f569695b0332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:45.426048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d4498-bd94-4401-aa3a-f569695b0332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:45.426048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d4498-bd94-4401-aa3a-f569695b0332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:45.426280 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d4498-bd94-4401-aa3a-f569695b0332 admin admin] PATH_INFO: `/v3/users/cbbe3f710af2470b935a949096d2813f` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:45.427315 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d4498-bd94-4401-aa3a-f569695b0332 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbbe3f710af2470b935a949096d2813f)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:45.429286 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d4498-bd94-4401-aa3a-f569695b0332 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:45.476643 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-533d4498-bd94-4401-aa3a-f569695b0332 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbbe3f710af2470b935a949096d2813f'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:45.477241 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-533d4498-bd94-4401-aa3a-f569695b0332 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbbe3f710af2470b935a949096d2813f'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:45.477845 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-533d4498-bd94-4401-aa3a-f569695b0332 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbbe3f710af2470b935a949096d2813f'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:45.484961 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-533d4498-bd94-4401-aa3a-f569695b0332 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbbe3f710af2470b935a949096d2813f'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:45.492380 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-533d4498-bd94-4401-aa3a-f569695b0332 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbbe3f710af2470b935a949096d2813f'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:45.510818 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1351/2708] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 18:07:45 2022] DELETE /identity/v3/users/cbbe3f710af2470b935a949096d2813f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:07:45.515391 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3f604-38b1-4c10-8ad0-d03bc3769fe1 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:45.515873 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3f604-38b1-4c10-8ad0-d03bc3769fe1 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:45.515974 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3f604-38b1-4c10-8ad0-d03bc3769fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:45.534977 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-1cf3f604-38b1-4c10-8ad0-d03bc3769fe1 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:07:45.536150 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-1cf3f604-38b1-4c10-8ad0-d03bc3769fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:45.592363 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1358/2709] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:07:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:07:45.602203 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d4498-bd94-4401-aa3a-f569695b0332 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:45.603796 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-533d4498-bd94-4401-aa3a-f569695b0332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:45.661993 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d4498-bd94-4401-aa3a-f569695b0332 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:45.665711 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4969505e-eea7-4568-8ba4-dddb4ef40b3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:45.666310 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4969505e-eea7-4568-8ba4-dddb4ef40b3e service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:45.666586 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4969505e-eea7-4568-8ba4-dddb4ef40b3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:45.666851 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4969505e-eea7-4568-8ba4-dddb4ef40b3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:45.675982 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4969505e-eea7-4568-8ba4-dddb4ef40b3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:45.677482 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4969505e-eea7-4568-8ba4-dddb4ef40b3e service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:45.686846 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1352/2710] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:07:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:07:45.947844 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf3f604-38b1-4c10-8ad0-d03bc3769fe1 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:45.949380 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-1cf3f604-38b1-4c10-8ad0-d03bc3769fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:45.961925 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf3f604-38b1-4c10-8ad0-d03bc3769fe1 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:45.966778 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d721e32-57a5-41b5-9cc7-802d75b00c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:45.967412 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d721e32-57a5-41b5-9cc7-802d75b00c50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:45.967691 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d721e32-57a5-41b5-9cc7-802d75b00c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:45.967962 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d721e32-57a5-41b5-9cc7-802d75b00c50 admin admin] PATH_INFO: `/v3/projects/075e7a3d86784c7294b6142aa362000b` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:45.969093 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d721e32-57a5-41b5-9cc7-802d75b00c50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=075e7a3d86784c7294b6142aa362000b)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:45.971737 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d721e32-57a5-41b5-9cc7-802d75b00c50 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:46.014903 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:46.020037 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-8d721e32-57a5-41b5-9cc7-802d75b00c50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '075e7a3d86784c7294b6142aa362000b', 'request_id': 'req-8d721e32-57a5-41b5-9cc7-802d75b00c50'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:46.026535 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-8d721e32-57a5-41b5-9cc7-802d75b00c50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '075e7a3d86784c7294b6142aa362000b', 'request_id': 'req-8d721e32-57a5-41b5-9cc7-802d75b00c50'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:46.034406 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-8d721e32-57a5-41b5-9cc7-802d75b00c50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '075e7a3d86784c7294b6142aa362000b', 'request_id': 'req-8d721e32-57a5-41b5-9cc7-802d75b00c50'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:46.045682 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-8d721e32-57a5-41b5-9cc7-802d75b00c50 admin admin] The token cache is being invalidate because project 075e7a3d86784c7294b6142aa362000b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:07:46.045991 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-8d721e32-57a5-41b5-9cc7-802d75b00c50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:46.046653 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-8d721e32-57a5-41b5-9cc7-802d75b00c50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:46.048187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1359/2711] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:07:45 2022] DELETE /identity/v3/projects/075e7a3d86784c7294b6142aa362000b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:07:46.052415 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4969505e-eea7-4568-8ba4-dddb4ef40b3e service neutron] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:46.062272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4969505e-eea7-4568-8ba4-dddb4ef40b3e service neutron] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:46.088784 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:46.121897 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57928452-5731-4851-a82f-fa7aceff674a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:46.122524 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57928452-5731-4851-a82f-fa7aceff674a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:46.122805 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57928452-5731-4851-a82f-fa7aceff674a admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:46.123108 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57928452-5731-4851-a82f-fa7aceff674a admin admin] PATH_INFO: `/v3/users/709a1e7519644473b17a97fafe7a64d8` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:46.124234 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57928452-5731-4851-a82f-fa7aceff674a admin admin] RBAC: Authorizing `identity:delete_user(user_id=709a1e7519644473b17a97fafe7a64d8)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:46.126716 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57928452-5731-4851-a82f-fa7aceff674a admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:46.174320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-57928452-5731-4851-a82f-fa7aceff674a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '709a1e7519644473b17a97fafe7a64d8'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:46.174970 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-57928452-5731-4851-a82f-fa7aceff674a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '709a1e7519644473b17a97fafe7a64d8'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:46.175641 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-57928452-5731-4851-a82f-fa7aceff674a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '709a1e7519644473b17a97fafe7a64d8'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:46.182604 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-57928452-5731-4851-a82f-fa7aceff674a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '709a1e7519644473b17a97fafe7a64d8'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:46.190476 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-57928452-5731-4851-a82f-fa7aceff674a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '709a1e7519644473b17a97fafe7a64d8'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:46.207968 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1353/2712] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 18:07:46 2022] DELETE /identity/v3/users/709a1e7519644473b17a97fafe7a64d8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:07:46.482640 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d721e32-57a5-41b5-9cc7-802d75b00c50 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:46.484114 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-8d721e32-57a5-41b5-9cc7-802d75b00c50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:46.498721 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d721e32-57a5-41b5-9cc7-802d75b00c50 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:46.556261 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9cb01-f253-42fa-9e52-c5b5273f434d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:46.556900 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9cb01-f253-42fa-9e52-c5b5273f434d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:46.557112 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9cb01-f253-42fa-9e52-c5b5273f434d admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:46.557388 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9cb01-f253-42fa-9e52-c5b5273f434d admin admin] PATH_INFO: `/v3/projects/fe931e6641f048f4bb22ddf1f52c972e` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:46.558502 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a9cb01-f253-42fa-9e52-c5b5273f434d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe931e6641f048f4bb22ddf1f52c972e)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:46.560400 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a9cb01-f253-42fa-9e52-c5b5273f434d admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:46.606051 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-52a9cb01-f253-42fa-9e52-c5b5273f434d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe931e6641f048f4bb22ddf1f52c972e', 'request_id': 'req-52a9cb01-f253-42fa-9e52-c5b5273f434d'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:46.612159 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-52a9cb01-f253-42fa-9e52-c5b5273f434d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe931e6641f048f4bb22ddf1f52c972e', 'request_id': 'req-52a9cb01-f253-42fa-9e52-c5b5273f434d'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:46.619524 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-52a9cb01-f253-42fa-9e52-c5b5273f434d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe931e6641f048f4bb22ddf1f52c972e', 'request_id': 'req-52a9cb01-f253-42fa-9e52-c5b5273f434d'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:46.631025 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-52a9cb01-f253-42fa-9e52-c5b5273f434d admin admin] The token cache is being invalidate because project fe931e6641f048f4bb22ddf1f52c972e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:07:46.631309 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-52a9cb01-f253-42fa-9e52-c5b5273f434d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:46.631991 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-52a9cb01-f253-42fa-9e52-c5b5273f434d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:46.633486 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1360/2713] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:07:46 2022] DELETE /identity/v3/projects/fe931e6641f048f4bb22ddf1f52c972e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:07:46.638406 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ab91d-a535-4fe8-984a-f1fc56bb3867 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:46.638695 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ab91d-a535-4fe8-984a-f1fc56bb3867 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:46.638971 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ab91d-a535-4fe8-984a-f1fc56bb3867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:46.658609 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-a35ab91d-a535-4fe8-984a-f1fc56bb3867 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:07:46.659807 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-a35ab91d-a535-4fe8-984a-f1fc56bb3867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:46.718232 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1354/2714] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:07:46.728259 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abc14b-5ff4-4e1e-87ef-7dafcdc95257 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:46.728543 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abc14b-5ff4-4e1e-87ef-7dafcdc95257 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:46.728818 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abc14b-5ff4-4e1e-87ef-7dafcdc95257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:46.748210 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-d1abc14b-5ff4-4e1e-87ef-7dafcdc95257 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:07:46.749456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-d1abc14b-5ff4-4e1e-87ef-7dafcdc95257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:46.757790 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1361/2715] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:07:46.762402 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ab91d-a535-4fe8-984a-f1fc56bb3867 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:46.772453 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ab91d-a535-4fe8-984a-f1fc56bb3867 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:46.776908 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087d3a0-2178-47af-a62c-546cae0ad281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:46.777527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087d3a0-2178-47af-a62c-546cae0ad281 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:46.777805 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087d3a0-2178-47af-a62c-546cae0ad281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:46.778073 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087d3a0-2178-47af-a62c-546cae0ad281 admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:46.778709 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4087d3a0-2178-47af-a62c-546cae0ad281 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 18:07:46.779007 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4087d3a0-2178-47af-a62c-546cae0ad281 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:46.780597 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4087d3a0-2178-47af-a62c-546cae0ad281 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:46.792570 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1355/2716] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 18:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 18:07:46.796886 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1abc14b-5ff4-4e1e-87ef-7dafcdc95257 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:46.806473 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1abc14b-5ff4-4e1e-87ef-7dafcdc95257 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:46.811065 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f8129-0418-4978-86cf-4e62484fbcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:46.811659 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f8129-0418-4978-86cf-4e62484fbcc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:46.811944 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f8129-0418-4978-86cf-4e62484fbcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:46.812233 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f8129-0418-4978-86cf-4e62484fbcc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:46.812841 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f8129-0418-4978-86cf-4e62484fbcc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:46.814789 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f8129-0418-4978-86cf-4e62484fbcc3 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:46.843204 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1362/2717] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 18:07:46 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:07:46.847895 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087d3a0-2178-47af-a62c-546cae0ad281 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:46.857976 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087d3a0-2178-47af-a62c-546cae0ad281 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:46.891332 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:46.917309 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615d6ba-6fca-40f3-a521-ed386ca598e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:46.917911 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615d6ba-6fca-40f3-a521-ed386ca598e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:46.918191 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615d6ba-6fca-40f3-a521-ed386ca598e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:46.918463 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615d6ba-6fca-40f3-a521-ed386ca598e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:46.919101 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615d6ba-6fca-40f3-a521-ed386ca598e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:46.921038 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615d6ba-6fca-40f3-a521-ed386ca598e0 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:46.942995 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1356/2718] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 18:07:46 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 18:07:46.947092 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f8129-0418-4978-86cf-4e62484fbcc3 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:46.958042 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f8129-0418-4978-86cf-4e62484fbcc3 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:46.962683 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343458a-19b0-4507-a388-f10e964c2caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:46.963280 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343458a-19b0-4507-a388-f10e964c2caf admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:46.963563 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343458a-19b0-4507-a388-f10e964c2caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:46.963838 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343458a-19b0-4507-a388-f10e964c2caf admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:46.964479 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5343458a-19b0-4507-a388-f10e964c2caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:46.966362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5343458a-19b0-4507-a388-f10e964c2caf admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:46.976111 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1363/2719] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:07:46.979944 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615d6ba-6fca-40f3-a521-ed386ca598e0 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:46.990076 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615d6ba-6fca-40f3-a521-ed386ca598e0 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:46.994817 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee140ed9-9386-44ff-9f7a-d16ded432cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:46.995409 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee140ed9-9386-44ff-9f7a-d16ded432cda admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:46.995695 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee140ed9-9386-44ff-9f7a-d16ded432cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:46.995961 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee140ed9-9386-44ff-9f7a-d16ded432cda admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:46.996628 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee140ed9-9386-44ff-9f7a-d16ded432cda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:46.998349 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee140ed9-9386-44ff-9f7a-d16ded432cda admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:47.009879 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1357/2720] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:07:47.014189 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343458a-19b0-4507-a388-f10e964c2caf admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:47.024317 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343458a-19b0-4507-a388-f10e964c2caf admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:47.029071 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd112d6d-29e0-467c-9638-3cfbd0516c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:47.029727 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd112d6d-29e0-467c-9638-3cfbd0516c51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:47.030007 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd112d6d-29e0-467c-9638-3cfbd0516c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:47.030280 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd112d6d-29e0-467c-9638-3cfbd0516c51 admin admin] PATH_INFO: `/v3/projects/cbdbb601527d4827b1877c902472dbda/users/fd466460c25548569e3eb9344c0db275/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:47.045999 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd112d6d-29e0-467c-9638-3cfbd0516c51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbdbb601527d4827b1877c902472dbda, user_id=fd466460c25548569e3eb9344c0db275, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:47.048752 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd112d6d-29e0-467c-9638-3cfbd0516c51 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:47.057532 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:47.064269 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1364/2721] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:07:47 2022] PUT /identity/v3/projects/cbdbb601527d4827b1877c902472dbda/users/fd466460c25548569e3eb9344c0db275/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:07:47.074917 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9069f-9e99-4623-987c-385948d76fdf None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:47.075378 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9069f-9e99-4623-987c-385948d76fdf None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:47.075541 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9069f-9e99-4623-987c-385948d76fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:47.104507 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-4db9069f-9e99-4623-987c-385948d76fdf None None] MFA Rules not processed for user `fd466460c25548569e3eb9344c0db275`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:07:47.105758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-4db9069f-9e99-4623-987c-385948d76fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:47.169955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1358/2722] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:07:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 18:07:47.174409 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd112d6d-29e0-467c-9638-3cfbd0516c51 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:47.234339 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd112d6d-29e0-467c-9638-3cfbd0516c51 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:47.239391 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a391c5-68e1-41d0-8ac6-05727255e6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:47.239984 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a391c5-68e1-41d0-8ac6-05727255e6e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:47.240261 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a391c5-68e1-41d0-8ac6-05727255e6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:47.240529 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a391c5-68e1-41d0-8ac6-05727255e6e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:47.241193 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a391c5-68e1-41d0-8ac6-05727255e6e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:47.243073 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a391c5-68e1-41d0-8ac6-05727255e6e0 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:47.269578 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1365/2723] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 18:07:47 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:07:47.273658 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9069f-9e99-4623-987c-385948d76fdf None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:47.284317 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9069f-9e99-4623-987c-385948d76fdf None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:47.344195 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812b0a4-80b1-4eef-9b0c-965b80dd5414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:47.344829 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812b0a4-80b1-4eef-9b0c-965b80dd5414 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:47.345121 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812b0a4-80b1-4eef-9b0c-965b80dd5414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:47.345395 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812b0a4-80b1-4eef-9b0c-965b80dd5414 admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:47.346029 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812b0a4-80b1-4eef-9b0c-965b80dd5414 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:47.347959 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812b0a4-80b1-4eef-9b0c-965b80dd5414 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:47.369556 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1359/2724] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 18:07:47 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:07:47.373482 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a391c5-68e1-41d0-8ac6-05727255e6e0 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:47.384138 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a391c5-68e1-41d0-8ac6-05727255e6e0 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:47.389212 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e7bb41-885d-471e-b6a2-c69973870fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:47.389821 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7bb41-885d-471e-b6a2-c69973870fda admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:47.390106 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7bb41-885d-471e-b6a2-c69973870fda admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:47.390380 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7bb41-885d-471e-b6a2-c69973870fda admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:47.391021 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e7bb41-885d-471e-b6a2-c69973870fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:47.393133 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e7bb41-885d-471e-b6a2-c69973870fda admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:47.404077 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1366/2725] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:07:47.409463 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812b0a4-80b1-4eef-9b0c-965b80dd5414 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:47.419669 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812b0a4-80b1-4eef-9b0c-965b80dd5414 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:47.424373 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f015717-097a-46c5-a67c-470043624750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:47.425042 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f015717-097a-46c5-a67c-470043624750 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:47.425329 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f015717-097a-46c5-a67c-470043624750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:47.425604 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f015717-097a-46c5-a67c-470043624750 admin admin] PATH_INFO: `/v3/projects/3871df7c47f446b8959bb5ca3946fce0/users/df1082a648764edea102b76fe6f17d08/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:47.440462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f015717-097a-46c5-a67c-470043624750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3871df7c47f446b8959bb5ca3946fce0, user_id=df1082a648764edea102b76fe6f17d08, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:47.443239 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f015717-097a-46c5-a67c-470043624750 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:47.456151 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1360/2726] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:07:47 2022] PUT /identity/v3/projects/3871df7c47f446b8959bb5ca3946fce0/users/df1082a648764edea102b76fe6f17d08/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:07:47.460161 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e7bb41-885d-471e-b6a2-c69973870fda admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:47.470925 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e7bb41-885d-471e-b6a2-c69973870fda admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:47.527037 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91960d57-b472-44db-be9c-1232a29e675f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:47.527643 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91960d57-b472-44db-be9c-1232a29e675f admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:47.527922 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91960d57-b472-44db-be9c-1232a29e675f admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:47.528195 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91960d57-b472-44db-be9c-1232a29e675f admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:47.528828 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91960d57-b472-44db-be9c-1232a29e675f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:47.530443 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91960d57-b472-44db-be9c-1232a29e675f admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:47.541060 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1367/2727] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:07:47.545239 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f015717-097a-46c5-a67c-470043624750 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:47.555938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f015717-097a-46c5-a67c-470043624750 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:47.560557 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477f0f6-70e0-4115-b616-89d3ecfb60d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:47.561240 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477f0f6-70e0-4115-b616-89d3ecfb60d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:47.561523 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477f0f6-70e0-4115-b616-89d3ecfb60d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:47.561796 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477f0f6-70e0-4115-b616-89d3ecfb60d8 admin admin] PATH_INFO: `/v3/projects/3871df7c47f446b8959bb5ca3946fce0/users/df1082a648764edea102b76fe6f17d08/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:47.563710 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477f0f6-70e0-4115-b616-89d3ecfb60d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3871df7c47f446b8959bb5ca3946fce0, user_id=df1082a648764edea102b76fe6f17d08, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:47.566521 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477f0f6-70e0-4115-b616-89d3ecfb60d8 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:47.569571 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:47.578059 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1361/2728] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:07:47 2022] PUT /identity/v3/projects/3871df7c47f446b8959bb5ca3946fce0/users/df1082a648764edea102b76fe6f17d08/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:07:47.588662 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055b704-71e9-44ff-95e6-775e3d1b9498 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:47.589172 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055b704-71e9-44ff-95e6-775e3d1b9498 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:47.589281 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055b704-71e9-44ff-95e6-775e3d1b9498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:47.617858 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-b055b704-71e9-44ff-95e6-775e3d1b9498 None None] MFA Rules not processed for user `df1082a648764edea102b76fe6f17d08`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:07:47.619081 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-b055b704-71e9-44ff-95e6-775e3d1b9498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:47.676810 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:47.687803 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1368/2729] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:07:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:07:47.699091 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477f0f6-70e0-4115-b616-89d3ecfb60d8 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:47.700805 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-b477f0f6-70e0-4115-b616-89d3ecfb60d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:47.760093 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477f0f6-70e0-4115-b616-89d3ecfb60d8 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:47.763781 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d0c8a-cde6-4f1b-9851-b5e6c624625d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:47.764388 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d0c8a-cde6-4f1b-9851-b5e6c624625d service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:47.764691 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d0c8a-cde6-4f1b-9851-b5e6c624625d service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:47.764966 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d0c8a-cde6-4f1b-9851-b5e6c624625d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:47.775203 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d0c8a-cde6-4f1b-9851-b5e6c624625d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:47.776792 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d0c8a-cde6-4f1b-9851-b5e6c624625d service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:47.786675 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1362/2730] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:07:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:07:48.155129 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055b704-71e9-44ff-95e6-775e3d1b9498 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:48.218936 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055b704-71e9-44ff-95e6-775e3d1b9498 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:48.223543 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabe875-eb7c-492e-ac94-7514bce1a837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:48.224168 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabe875-eb7c-492e-ac94-7514bce1a837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:48.224440 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabe875-eb7c-492e-ac94-7514bce1a837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:48.224823 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabe875-eb7c-492e-ac94-7514bce1a837 admin admin] PATH_INFO: `/v3/users/fd466460c25548569e3eb9344c0db275` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:48.225972 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cabe875-eb7c-492e-ac94-7514bce1a837 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd466460c25548569e3eb9344c0db275)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:48.227900 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cabe875-eb7c-492e-ac94-7514bce1a837 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:48.272760 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-2cabe875-eb7c-492e-ac94-7514bce1a837 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd466460c25548569e3eb9344c0db275'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:48.279933 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-2cabe875-eb7c-492e-ac94-7514bce1a837 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd466460c25548569e3eb9344c0db275'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:48.280578 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-2cabe875-eb7c-492e-ac94-7514bce1a837 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd466460c25548569e3eb9344c0db275'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:48.281225 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-2cabe875-eb7c-492e-ac94-7514bce1a837 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd466460c25548569e3eb9344c0db275'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:48.288917 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-2cabe875-eb7c-492e-ac94-7514bce1a837 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd466460c25548569e3eb9344c0db275'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:48.305955 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1369/2731] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 18:07:48 2022] DELETE /identity/v3/users/fd466460c25548569e3eb9344c0db275 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:07:48.310479 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5caf8c-44e9-4eb6-b5b7-b78608d39bb0 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:48.310957 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5caf8c-44e9-4eb6-b5b7-b78608d39bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:48.311057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5caf8c-44e9-4eb6-b5b7-b78608d39bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:48.330222 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-7b5caf8c-44e9-4eb6-b5b7-b78608d39bb0 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:07:48.331415 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-7b5caf8c-44e9-4eb6-b5b7-b78608d39bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:48.391280 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1363/2732] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:07:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:07:48.401520 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabe875-eb7c-492e-ac94-7514bce1a837 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:48.402931 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-2cabe875-eb7c-492e-ac94-7514bce1a837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:48.460812 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabe875-eb7c-492e-ac94-7514bce1a837 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:48.464476 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d9dd5-c8e8-4d9e-b861-6ce585d76d17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:48.465362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d9dd5-c8e8-4d9e-b861-6ce585d76d17 service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:48.465654 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d9dd5-c8e8-4d9e-b861-6ce585d76d17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:48.465928 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d9dd5-c8e8-4d9e-b861-6ce585d76d17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:48.474818 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d9dd5-c8e8-4d9e-b861-6ce585d76d17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:48.476242 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d9dd5-c8e8-4d9e-b861-6ce585d76d17 service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:48.485579 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1370/2733] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:07:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:07:48.754136 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5caf8c-44e9-4eb6-b5b7-b78608d39bb0 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:48.755630 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-7b5caf8c-44e9-4eb6-b5b7-b78608d39bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:48.768074 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5caf8c-44e9-4eb6-b5b7-b78608d39bb0 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:48.773079 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0537a-2b23-4ea0-a6a2-c0da4a7d1fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:48.773721 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0537a-2b23-4ea0-a6a2-c0da4a7d1fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:48.773997 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0537a-2b23-4ea0-a6a2-c0da4a7d1fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:48.774264 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0537a-2b23-4ea0-a6a2-c0da4a7d1fcb admin admin] PATH_INFO: `/v3/projects/cbdbb601527d4827b1877c902472dbda` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:48.775395 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d0537a-2b23-4ea0-a6a2-c0da4a7d1fcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbdbb601527d4827b1877c902472dbda)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:48.777377 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d0537a-2b23-4ea0-a6a2-c0da4a7d1fcb admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:48.824630 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b5d0537a-2b23-4ea0-a6a2-c0da4a7d1fcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbdbb601527d4827b1877c902472dbda', 'request_id': 'req-b5d0537a-2b23-4ea0-a6a2-c0da4a7d1fcb'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:48.831339 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b5d0537a-2b23-4ea0-a6a2-c0da4a7d1fcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbdbb601527d4827b1877c902472dbda', 'request_id': 'req-b5d0537a-2b23-4ea0-a6a2-c0da4a7d1fcb'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:48.838907 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b5d0537a-2b23-4ea0-a6a2-c0da4a7d1fcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbdbb601527d4827b1877c902472dbda', 'request_id': 'req-b5d0537a-2b23-4ea0-a6a2-c0da4a7d1fcb'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:48.850741 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b5d0537a-2b23-4ea0-a6a2-c0da4a7d1fcb admin admin] The token cache is being invalidate because project cbdbb601527d4827b1877c902472dbda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:07:48.851029 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b5d0537a-2b23-4ea0-a6a2-c0da4a7d1fcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:48.851676 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b5d0537a-2b23-4ea0-a6a2-c0da4a7d1fcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:48.853184 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1364/2734] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:07:48 2022] DELETE /identity/v3/projects/cbdbb601527d4827b1877c902472dbda => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:07:48.857053 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d9dd5-c8e8-4d9e-b861-6ce585d76d17 service neutron] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:48.866698 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d9dd5-c8e8-4d9e-b861-6ce585d76d17 service neutron] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:48.878075 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:48.925822 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b3808-01b7-480f-8f97-4218a626783d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:48.926538 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b3808-01b7-480f-8f97-4218a626783d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:48.926817 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b3808-01b7-480f-8f97-4218a626783d admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:48.927086 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b3808-01b7-480f-8f97-4218a626783d admin admin] PATH_INFO: `/v3/users/df1082a648764edea102b76fe6f17d08` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:48.928204 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b3808-01b7-480f-8f97-4218a626783d admin admin] RBAC: Authorizing `identity:delete_user(user_id=df1082a648764edea102b76fe6f17d08)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:48.930131 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b3808-01b7-480f-8f97-4218a626783d admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:48.976224 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-556b3808-01b7-480f-8f97-4218a626783d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df1082a648764edea102b76fe6f17d08'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:48.983377 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-556b3808-01b7-480f-8f97-4218a626783d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df1082a648764edea102b76fe6f17d08'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:48.983989 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-556b3808-01b7-480f-8f97-4218a626783d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df1082a648764edea102b76fe6f17d08'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:48.984584 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-556b3808-01b7-480f-8f97-4218a626783d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df1082a648764edea102b76fe6f17d08'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:48.993892 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-556b3808-01b7-480f-8f97-4218a626783d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df1082a648764edea102b76fe6f17d08'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:49.011818 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1371/2735] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 18:07:48 2022] DELETE /identity/v3/users/df1082a648764edea102b76fe6f17d08 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:07:49.281406 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0537a-2b23-4ea0-a6a2-c0da4a7d1fcb admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:49.282842 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-b5d0537a-2b23-4ea0-a6a2-c0da4a7d1fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:49.297125 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0537a-2b23-4ea0-a6a2-c0da4a7d1fcb admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:49.317618 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:49.357782 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f316dd8-0579-4f7d-89e7-6a0e97da41a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:49.358402 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f316dd8-0579-4f7d-89e7-6a0e97da41a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:49.358677 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f316dd8-0579-4f7d-89e7-6a0e97da41a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:49.358946 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f316dd8-0579-4f7d-89e7-6a0e97da41a6 admin admin] PATH_INFO: `/v3/projects/3871df7c47f446b8959bb5ca3946fce0` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:49.360042 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f316dd8-0579-4f7d-89e7-6a0e97da41a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3871df7c47f446b8959bb5ca3946fce0)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:49.362000 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f316dd8-0579-4f7d-89e7-6a0e97da41a6 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:49.411529 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-0f316dd8-0579-4f7d-89e7-6a0e97da41a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3871df7c47f446b8959bb5ca3946fce0', 'request_id': 'req-0f316dd8-0579-4f7d-89e7-6a0e97da41a6'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:49.417165 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-0f316dd8-0579-4f7d-89e7-6a0e97da41a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3871df7c47f446b8959bb5ca3946fce0', 'request_id': 'req-0f316dd8-0579-4f7d-89e7-6a0e97da41a6'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:49.424459 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-0f316dd8-0579-4f7d-89e7-6a0e97da41a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3871df7c47f446b8959bb5ca3946fce0', 'request_id': 'req-0f316dd8-0579-4f7d-89e7-6a0e97da41a6'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:49.435693 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-0f316dd8-0579-4f7d-89e7-6a0e97da41a6 admin admin] The token cache is being invalidate because project 3871df7c47f446b8959bb5ca3946fce0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:07:49.435984 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-0f316dd8-0579-4f7d-89e7-6a0e97da41a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:49.436614 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-0f316dd8-0579-4f7d-89e7-6a0e97da41a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:49.438193 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1365/2736] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:07:49 2022] DELETE /identity/v3/projects/3871df7c47f446b8959bb5ca3946fce0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:07:49.443703 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe0ade-7452-4ed5-bcec-93c7a1868c14 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:49.443986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe0ade-7452-4ed5-bcec-93c7a1868c14 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:49.444257 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe0ade-7452-4ed5-bcec-93c7a1868c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:49.463767 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-92fe0ade-7452-4ed5-bcec-93c7a1868c14 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:07:49.464942 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-92fe0ade-7452-4ed5-bcec-93c7a1868c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:49.524138 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1372/2737] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:07:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:07:49.531932 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738c95e-03fb-4ce8-a7b3-6549f9805630 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:49.532224 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738c95e-03fb-4ce8-a7b3-6549f9805630 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:49.532504 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738c95e-03fb-4ce8-a7b3-6549f9805630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:49.552703 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-9738c95e-03fb-4ce8-a7b3-6549f9805630 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:07:49.553955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-9738c95e-03fb-4ce8-a7b3-6549f9805630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:49.561784 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1366/2738] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:07:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:07:49.566653 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe0ade-7452-4ed5-bcec-93c7a1868c14 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:49.576199 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe0ade-7452-4ed5-bcec-93c7a1868c14 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:49.580948 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee72d13-6dcb-413c-a4d9-c26dcecf469a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:49.581699 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee72d13-6dcb-413c-a4d9-c26dcecf469a admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:49.582002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee72d13-6dcb-413c-a4d9-c26dcecf469a admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:49.582274 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee72d13-6dcb-413c-a4d9-c26dcecf469a admin admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:49.582919 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee72d13-6dcb-413c-a4d9-c26dcecf469a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 18:07:49.583222 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee72d13-6dcb-413c-a4d9-c26dcecf469a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:49.584840 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee72d13-6dcb-413c-a4d9-c26dcecf469a admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:49.596447 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1373/2739] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 18:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 18:07:49.600745 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738c95e-03fb-4ce8-a7b3-6549f9805630 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:49.609874 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738c95e-03fb-4ce8-a7b3-6549f9805630 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:49.614973 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c75014-228e-4340-b4db-9f04e6c945d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:49.615560 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c75014-228e-4340-b4db-9f04e6c945d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:49.615837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c75014-228e-4340-b4db-9f04e6c945d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:49.616106 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c75014-228e-4340-b4db-9f04e6c945d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:49.616796 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c75014-228e-4340-b4db-9f04e6c945d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:49.618720 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c75014-228e-4340-b4db-9f04e6c945d8 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:49.646501 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1367/2740] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 18:07:49 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:07:49.650577 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee72d13-6dcb-413c-a4d9-c26dcecf469a admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:49.660538 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee72d13-6dcb-413c-a4d9-c26dcecf469a admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:49.679372 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:49.726863 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afd18a-8041-418f-9e6d-325cf5787870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:49.727482 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afd18a-8041-418f-9e6d-325cf5787870 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:49.727819 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afd18a-8041-418f-9e6d-325cf5787870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:49.728093 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afd18a-8041-418f-9e6d-325cf5787870 admin admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:49.728730 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79afd18a-8041-418f-9e6d-325cf5787870 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:49.730692 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79afd18a-8041-418f-9e6d-325cf5787870 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:49.757452 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1374/2741] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 18:07:49 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:07:49.758837 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c75014-228e-4340-b4db-9f04e6c945d8 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:49.769269 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c75014-228e-4340-b4db-9f04e6c945d8 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:49.774016 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6183bc6-5a5f-420a-bb2e-5ac8bd73f3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:49.774595 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6183bc6-5a5f-420a-bb2e-5ac8bd73f3c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:49.774875 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6183bc6-5a5f-420a-bb2e-5ac8bd73f3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:49.775146 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6183bc6-5a5f-420a-bb2e-5ac8bd73f3c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:49.775823 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6183bc6-5a5f-420a-bb2e-5ac8bd73f3c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:49.777472 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6183bc6-5a5f-420a-bb2e-5ac8bd73f3c2 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:49.787916 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1368/2742] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:07:49.792199 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afd18a-8041-418f-9e6d-325cf5787870 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:49.802699 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afd18a-8041-418f-9e6d-325cf5787870 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:49.807671 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c73b87-1b09-46e6-9055-a924bd149256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:49.808266 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c73b87-1b09-46e6-9055-a924bd149256 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:49.808557 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c73b87-1b09-46e6-9055-a924bd149256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:49.808828 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c73b87-1b09-46e6-9055-a924bd149256 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:49.809508 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c73b87-1b09-46e6-9055-a924bd149256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:49.811095 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c73b87-1b09-46e6-9055-a924bd149256 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:49.822506 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1375/2743] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 18:07:49.826723 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6183bc6-5a5f-420a-bb2e-5ac8bd73f3c2 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:49.836658 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6183bc6-5a5f-420a-bb2e-5ac8bd73f3c2 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:49.841476 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656940f9-0a06-49c8-9dac-32465b414458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:49.842115 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656940f9-0a06-49c8-9dac-32465b414458 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:49.842392 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656940f9-0a06-49c8-9dac-32465b414458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:49.842671 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656940f9-0a06-49c8-9dac-32465b414458 admin admin] PATH_INFO: `/v3/projects/ffc17e5f458247cea9f5ecc745b16270/users/e55e56ea86494609b7344774a4009a1b/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:49.857416 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656940f9-0a06-49c8-9dac-32465b414458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffc17e5f458247cea9f5ecc745b16270, user_id=e55e56ea86494609b7344774a4009a1b, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:49.860056 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656940f9-0a06-49c8-9dac-32465b414458 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:49.873121 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1369/2744] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:07:49 2022] PUT /identity/v3/projects/ffc17e5f458247cea9f5ecc745b16270/users/e55e56ea86494609b7344774a4009a1b/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:07:49.883414 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e5ec0-f864-4f87-9fd1-63c7745c8cde None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:49.883916 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e5ec0-f864-4f87-9fd1-63c7745c8cde None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:49.884015 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e5ec0-f864-4f87-9fd1-63c7745c8cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:49.912631 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-1e6e5ec0-f864-4f87-9fd1-63c7745c8cde None None] MFA Rules not processed for user `e55e56ea86494609b7344774a4009a1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:07:49.913868 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-1e6e5ec0-f864-4f87-9fd1-63c7745c8cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:49.978643 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1376/2745] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:07:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:07:49.983044 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656940f9-0a06-49c8-9dac-32465b414458 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:50.034420 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:50.049834 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656940f9-0a06-49c8-9dac-32465b414458 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:50.055532 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cbaaf9-7e61-4f33-ab1a-65c12345e0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:50.056141 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbaaf9-7e61-4f33-ab1a-65c12345e0dc admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:50.056415 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbaaf9-7e61-4f33-ab1a-65c12345e0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:50.056684 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbaaf9-7e61-4f33-ab1a-65c12345e0dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:50.057354 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cbaaf9-7e61-4f33-ab1a-65c12345e0dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:50.059326 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cbaaf9-7e61-4f33-ab1a-65c12345e0dc admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:50.087296 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1370/2746] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 18:07:49 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:07:50.092225 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e5ec0-f864-4f87-9fd1-63c7745c8cde None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:50.104343 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e5ec0-f864-4f87-9fd1-63c7745c8cde None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:50.168799 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf1eaf-3a0a-4524-a503-05f69f09e462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:50.169476 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf1eaf-3a0a-4524-a503-05f69f09e462 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:50.169777 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf1eaf-3a0a-4524-a503-05f69f09e462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:50.170044 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf1eaf-3a0a-4524-a503-05f69f09e462 admin admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:50.170678 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf1eaf-3a0a-4524-a503-05f69f09e462 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:50.172662 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf1eaf-3a0a-4524-a503-05f69f09e462 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:50.195419 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1377/2747] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 18:07:50 2022] POST /identity/v3/users => generated 297 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:07:50.199608 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cbaaf9-7e61-4f33-ab1a-65c12345e0dc admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:50.210361 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cbaaf9-7e61-4f33-ab1a-65c12345e0dc admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:50.214925 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c346e0-35a0-4b06-b194-5a20882b54ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:50.215781 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c346e0-35a0-4b06-b194-5a20882b54ae admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:50.216060 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c346e0-35a0-4b06-b194-5a20882b54ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:50.216331 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c346e0-35a0-4b06-b194-5a20882b54ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:50.216960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c346e0-35a0-4b06-b194-5a20882b54ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:50.218587 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c346e0-35a0-4b06-b194-5a20882b54ae admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:50.229980 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1371/2748] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:07:50.234555 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf1eaf-3a0a-4524-a503-05f69f09e462 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:50.245897 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf1eaf-3a0a-4524-a503-05f69f09e462 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:50.250601 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea2a5b-043f-4d74-8132-e1770cc391b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:50.251915 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea2a5b-043f-4d74-8132-e1770cc391b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:50.252195 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea2a5b-043f-4d74-8132-e1770cc391b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:50.252469 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea2a5b-043f-4d74-8132-e1770cc391b5 admin admin] PATH_INFO: `/v3/projects/c4094a8126a641c488bcdeecc7d7d0e9/users/6ca768ffc8fb41d0aa682a3f8d83c318/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:50.267803 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea2a5b-043f-4d74-8132-e1770cc391b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4094a8126a641c488bcdeecc7d7d0e9, user_id=6ca768ffc8fb41d0aa682a3f8d83c318, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:50.270520 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea2a5b-043f-4d74-8132-e1770cc391b5 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:50.273510 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:50.285167 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1378/2749] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:07:50 2022] PUT /identity/v3/projects/c4094a8126a641c488bcdeecc7d7d0e9/users/6ca768ffc8fb41d0aa682a3f8d83c318/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:07:50.289161 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c346e0-35a0-4b06-b194-5a20882b54ae admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:50.299299 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c346e0-35a0-4b06-b194-5a20882b54ae admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:50.358700 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f5c98-ddb9-4914-b9c9-75cd56d69459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:50.359350 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f5c98-ddb9-4914-b9c9-75cd56d69459 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:50.359630 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f5c98-ddb9-4914-b9c9-75cd56d69459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:50.359908 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f5c98-ddb9-4914-b9c9-75cd56d69459 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:50.361139 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f5c98-ddb9-4914-b9c9-75cd56d69459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:50.362744 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f5c98-ddb9-4914-b9c9-75cd56d69459 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:50.372647 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1372/2750] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:07:50.376935 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea2a5b-043f-4d74-8132-e1770cc391b5 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:50.387625 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea2a5b-043f-4d74-8132-e1770cc391b5 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:50.395289 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d004ed8-2d0b-4e09-8a73-4219a3bae516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:50.395950 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d004ed8-2d0b-4e09-8a73-4219a3bae516 admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:50.396232 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d004ed8-2d0b-4e09-8a73-4219a3bae516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:50.396503 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d004ed8-2d0b-4e09-8a73-4219a3bae516 admin admin] PATH_INFO: `/v3/projects/c4094a8126a641c488bcdeecc7d7d0e9/users/6ca768ffc8fb41d0aa682a3f8d83c318/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:50.398508 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d004ed8-2d0b-4e09-8a73-4219a3bae516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4094a8126a641c488bcdeecc7d7d0e9, user_id=6ca768ffc8fb41d0aa682a3f8d83c318, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:50.401517 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d004ed8-2d0b-4e09-8a73-4219a3bae516 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:50.413580 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1379/2751] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:07:50 2022] PUT /identity/v3/projects/c4094a8126a641c488bcdeecc7d7d0e9/users/6ca768ffc8fb41d0aa682a3f8d83c318/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 18:07:50.481749 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165a427-1d6f-4a0a-80b9-1bc2c5308288 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:50.481969 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165a427-1d6f-4a0a-80b9-1bc2c5308288 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:50.482211 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165a427-1d6f-4a0a-80b9-1bc2c5308288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:50.511668 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-6165a427-1d6f-4a0a-80b9-1bc2c5308288 None None] MFA Rules not processed for user `6ca768ffc8fb41d0aa682a3f8d83c318`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:07:50.512864 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-6165a427-1d6f-4a0a-80b9-1bc2c5308288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:50.702235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1373/2752] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:07:50 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:07:50.714334 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d004ed8-2d0b-4e09-8a73-4219a3bae516 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:50.716571 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-8d004ed8-2d0b-4e09-8a73-4219a3bae516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:50.778063 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d004ed8-2d0b-4e09-8a73-4219a3bae516 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:50.784366 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9899d4-5c30-4666-8dd9-377d3d09bbc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:50.785003 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9899d4-5c30-4666-8dd9-377d3d09bbc9 service cinder] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:50.785366 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9899d4-5c30-4666-8dd9-377d3d09bbc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:50.785637 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9899d4-5c30-4666-8dd9-377d3d09bbc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:50.795363 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9899d4-5c30-4666-8dd9-377d3d09bbc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:50.796805 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9899d4-5c30-4666-8dd9-377d3d09bbc9 service cinder] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:50.807080 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1380/2753] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:07:50 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:07:50.883079 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165a427-1d6f-4a0a-80b9-1bc2c5308288 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:50.892566 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165a427-1d6f-4a0a-80b9-1bc2c5308288 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:50.896167 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a1c45-a8e1-4f21-b168-4d129bee9277 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:50.896757 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a1c45-a8e1-4f21-b168-4d129bee9277 service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:50.897062 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a1c45-a8e1-4f21-b168-4d129bee9277 service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:50.897331 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a1c45-a8e1-4f21-b168-4d129bee9277 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:50.939431 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:50.955060 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a1c45-a8e1-4f21-b168-4d129bee9277 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:50.956477 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a1c45-a8e1-4f21-b168-4d129bee9277 service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:50.965425 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1374/2754] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:07:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 18:07:51.230089 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9899d4-5c30-4666-8dd9-377d3d09bbc9 service cinder] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:51.290995 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9899d4-5c30-4666-8dd9-377d3d09bbc9 service cinder] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:51.295412 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471564a-68e5-499f-bbf4-a820ab0a2461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:51.296034 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471564a-68e5-499f-bbf4-a820ab0a2461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:51.296314 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471564a-68e5-499f-bbf4-a820ab0a2461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:51.296586 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471564a-68e5-499f-bbf4-a820ab0a2461 admin admin] PATH_INFO: `/v3/users/e55e56ea86494609b7344774a4009a1b` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:51.297722 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471564a-68e5-499f-bbf4-a820ab0a2461 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e55e56ea86494609b7344774a4009a1b)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:51.299640 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471564a-68e5-499f-bbf4-a820ab0a2461 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:51.344745 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-8471564a-68e5-499f-bbf4-a820ab0a2461 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e55e56ea86494609b7344774a4009a1b'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:51.352311 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-8471564a-68e5-499f-bbf4-a820ab0a2461 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e55e56ea86494609b7344774a4009a1b'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:51.352926 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-8471564a-68e5-499f-bbf4-a820ab0a2461 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e55e56ea86494609b7344774a4009a1b'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:51.353557 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-8471564a-68e5-499f-bbf4-a820ab0a2461 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e55e56ea86494609b7344774a4009a1b'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:51.360661 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-8471564a-68e5-499f-bbf4-a820ab0a2461 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e55e56ea86494609b7344774a4009a1b'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:51.379599 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1381/2755] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 18:07:51 2022] DELETE /identity/v3/users/e55e56ea86494609b7344774a4009a1b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:07:51.383857 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20851ed-5939-48c1-b455-6d247a5d4191 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:51.384244 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20851ed-5939-48c1-b455-6d247a5d4191 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:51.384393 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20851ed-5939-48c1-b455-6d247a5d4191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:51.403273 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-f20851ed-5939-48c1-b455-6d247a5d4191 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:07:51.404489 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-f20851ed-5939-48c1-b455-6d247a5d4191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:51.461607 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1375/2756] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:07:51.472068 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471564a-68e5-499f-bbf4-a820ab0a2461 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:51.473487 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-8471564a-68e5-499f-bbf4-a820ab0a2461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:51.479946 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:51.533101 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471564a-68e5-499f-bbf4-a820ab0a2461 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:51.536686 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480c77c-c02d-4efa-b4c6-8566a9f6f261 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:51.537316 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480c77c-c02d-4efa-b4c6-8566a9f6f261 service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:51.537591 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480c77c-c02d-4efa-b4c6-8566a9f6f261 service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:51.537859 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480c77c-c02d-4efa-b4c6-8566a9f6f261 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:51.546851 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480c77c-c02d-4efa-b4c6-8566a9f6f261 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:51.548294 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480c77c-c02d-4efa-b4c6-8566a9f6f261 service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:51.557787 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1382/2757] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:07:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:07:51.824762 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20851ed-5939-48c1-b455-6d247a5d4191 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:51.826215 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-f20851ed-5939-48c1-b455-6d247a5d4191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:51.838745 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20851ed-5939-48c1-b455-6d247a5d4191 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:51.843683 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de60945-ecd0-44d5-9911-1a1d047f7c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:51.844337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de60945-ecd0-44d5-9911-1a1d047f7c53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:51.844615 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de60945-ecd0-44d5-9911-1a1d047f7c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:51.845577 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de60945-ecd0-44d5-9911-1a1d047f7c53 admin admin] PATH_INFO: `/v3/projects/ffc17e5f458247cea9f5ecc745b16270` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:51.846848 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de60945-ecd0-44d5-9911-1a1d047f7c53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffc17e5f458247cea9f5ecc745b16270)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:51.848642 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de60945-ecd0-44d5-9911-1a1d047f7c53 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:51.894263 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-5de60945-ecd0-44d5-9911-1a1d047f7c53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffc17e5f458247cea9f5ecc745b16270', 'request_id': 'req-5de60945-ecd0-44d5-9911-1a1d047f7c53'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:51.899872 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-5de60945-ecd0-44d5-9911-1a1d047f7c53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffc17e5f458247cea9f5ecc745b16270', 'request_id': 'req-5de60945-ecd0-44d5-9911-1a1d047f7c53'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:51.907664 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-5de60945-ecd0-44d5-9911-1a1d047f7c53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffc17e5f458247cea9f5ecc745b16270', 'request_id': 'req-5de60945-ecd0-44d5-9911-1a1d047f7c53'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:51.919447 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-5de60945-ecd0-44d5-9911-1a1d047f7c53 admin admin] The token cache is being invalidate because project ffc17e5f458247cea9f5ecc745b16270 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:07:51.919731 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-5de60945-ecd0-44d5-9911-1a1d047f7c53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:51.920388 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-5de60945-ecd0-44d5-9911-1a1d047f7c53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:51.921909 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1376/2758] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:07:51 2022] DELETE /identity/v3/projects/ffc17e5f458247cea9f5ecc745b16270 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 18:07:51.926472 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480c77c-c02d-4efa-b4c6-8566a9f6f261 service neutron] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:51.936110 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480c77c-c02d-4efa-b4c6-8566a9f6f261 service neutron] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:51.991922 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e122d-cbef-4979-b5b7-41addd9742f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:51.992545 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e122d-cbef-4979-b5b7-41addd9742f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:51.992824 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e122d-cbef-4979-b5b7-41addd9742f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:51.993129 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e122d-cbef-4979-b5b7-41addd9742f4 admin admin] PATH_INFO: `/v3/users/6ca768ffc8fb41d0aa682a3f8d83c318` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:51.994240 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e122d-cbef-4979-b5b7-41addd9742f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ca768ffc8fb41d0aa682a3f8d83c318)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:51.996153 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e122d-cbef-4979-b5b7-41addd9742f4 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:52.041300 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-650e122d-cbef-4979-b5b7-41addd9742f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ca768ffc8fb41d0aa682a3f8d83c318'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:52.048954 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-650e122d-cbef-4979-b5b7-41addd9742f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ca768ffc8fb41d0aa682a3f8d83c318'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:52.049610 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-650e122d-cbef-4979-b5b7-41addd9742f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ca768ffc8fb41d0aa682a3f8d83c318'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:52.050229 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-650e122d-cbef-4979-b5b7-41addd9742f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ca768ffc8fb41d0aa682a3f8d83c318'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:52.057362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-650e122d-cbef-4979-b5b7-41addd9742f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ca768ffc8fb41d0aa682a3f8d83c318'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:52.075377 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1383/2759] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 18:07:51 2022] DELETE /identity/v3/users/6ca768ffc8fb41d0aa682a3f8d83c318 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:07:52.350750 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de60945-ecd0-44d5-9911-1a1d047f7c53 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:52.352296 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-5de60945-ecd0-44d5-9911-1a1d047f7c53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:52.365648 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de60945-ecd0-44d5-9911-1a1d047f7c53 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:52.428140 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d72f6-0327-48ea-a7b6-495f7f96db72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:52.428820 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d72f6-0327-48ea-a7b6-495f7f96db72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:52.429037 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d72f6-0327-48ea-a7b6-495f7f96db72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:52.429323 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d72f6-0327-48ea-a7b6-495f7f96db72 admin admin] PATH_INFO: `/v3/projects/c4094a8126a641c488bcdeecc7d7d0e9` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:52.430412 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d72f6-0327-48ea-a7b6-495f7f96db72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4094a8126a641c488bcdeecc7d7d0e9)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:52.432356 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d72f6-0327-48ea-a7b6-495f7f96db72 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:52.440638 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:52.480128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b73d72f6-0327-48ea-a7b6-495f7f96db72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4094a8126a641c488bcdeecc7d7d0e9', 'request_id': 'req-b73d72f6-0327-48ea-a7b6-495f7f96db72'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:52.486158 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b73d72f6-0327-48ea-a7b6-495f7f96db72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4094a8126a641c488bcdeecc7d7d0e9', 'request_id': 'req-b73d72f6-0327-48ea-a7b6-495f7f96db72'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:52.493506 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b73d72f6-0327-48ea-a7b6-495f7f96db72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4094a8126a641c488bcdeecc7d7d0e9', 'request_id': 'req-b73d72f6-0327-48ea-a7b6-495f7f96db72'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:52.504712 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b73d72f6-0327-48ea-a7b6-495f7f96db72 admin admin] The token cache is being invalidate because project c4094a8126a641c488bcdeecc7d7d0e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:07:52.504996 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b73d72f6-0327-48ea-a7b6-495f7f96db72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:52.505654 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b73d72f6-0327-48ea-a7b6-495f7f96db72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:07:52.507108 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1377/2760] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:07:52 2022] DELETE /identity/v3/projects/c4094a8126a641c488bcdeecc7d7d0e9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:07:52.513262 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bb258-8551-4d37-82b5-ce2b70391e14 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:52.513774 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bb258-8551-4d37-82b5-ce2b70391e14 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:52.513932 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bb258-8551-4d37-82b5-ce2b70391e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:52.535372 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-9e2bb258-8551-4d37-82b5-ce2b70391e14 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:07:52.536586 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-9e2bb258-8551-4d37-82b5-ce2b70391e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:52.557658 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:52.603645 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1384/2761] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:07:52.611832 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46606d67-9e30-4edf-9377-ba47785c572e None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:52.612138 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46606d67-9e30-4edf-9377-ba47785c572e None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:52.612582 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46606d67-9e30-4edf-9377-ba47785c572e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:52.632699 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-46606d67-9e30-4edf-9377-ba47785c572e None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:07:52.633946 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-46606d67-9e30-4edf-9377-ba47785c572e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:52.642564 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1378/2762] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:07:52.646422 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2bb258-8551-4d37-82b5-ce2b70391e14 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:52.656045 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2bb258-8551-4d37-82b5-ce2b70391e14 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:52.661245 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea085fd-b5e7-4fdc-a5b2-3b918400ebc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:52.661838 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea085fd-b5e7-4fdc-a5b2-3b918400ebc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:52.662118 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea085fd-b5e7-4fdc-a5b2-3b918400ebc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:52.662413 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea085fd-b5e7-4fdc-a5b2-3b918400ebc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:52.663053 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea085fd-b5e7-4fdc-a5b2-3b918400ebc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 18:07:52.663360 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea085fd-b5e7-4fdc-a5b2-3b918400ebc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:52.664930 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea085fd-b5e7-4fdc-a5b2-3b918400ebc3 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:52.676273 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1385/2763] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 18:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 18:07:52.680428 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46606d67-9e30-4edf-9377-ba47785c572e None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:52.690832 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46606d67-9e30-4edf-9377-ba47785c572e None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:52.695646 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef0030-bf06-44bc-808a-2ab99ff3867d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:52.696247 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef0030-bf06-44bc-808a-2ab99ff3867d admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:52.696522 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef0030-bf06-44bc-808a-2ab99ff3867d admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:52.696787 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef0030-bf06-44bc-808a-2ab99ff3867d admin admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:52.697462 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef0030-bf06-44bc-808a-2ab99ff3867d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:52.699357 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef0030-bf06-44bc-808a-2ab99ff3867d admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:52.729777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1379/2764] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 18:07:52 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 18:07:52.734016 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea085fd-b5e7-4fdc-a5b2-3b918400ebc3 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:52.743935 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea085fd-b5e7-4fdc-a5b2-3b918400ebc3 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:52.801345 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef411a-d85a-44e5-82b0-e254040b7e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:52.801974 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef411a-d85a-44e5-82b0-e254040b7e7d admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:52.802276 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef411a-d85a-44e5-82b0-e254040b7e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:52.802645 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef411a-d85a-44e5-82b0-e254040b7e7d admin admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:52.803274 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef411a-d85a-44e5-82b0-e254040b7e7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:52.805219 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef411a-d85a-44e5-82b0-e254040b7e7d admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:52.829759 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1386/2765] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 18:07:52 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 18:07:52.833900 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef0030-bf06-44bc-808a-2ab99ff3867d admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:52.844377 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef0030-bf06-44bc-808a-2ab99ff3867d admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:52.848993 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f41f5-6c39-49e8-bb5b-d08081f6dcc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:52.849602 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f41f5-6c39-49e8-bb5b-d08081f6dcc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:52.849877 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f41f5-6c39-49e8-bb5b-d08081f6dcc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:52.850140 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f41f5-6c39-49e8-bb5b-d08081f6dcc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:52.850769 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f41f5-6c39-49e8-bb5b-d08081f6dcc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:52.852348 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f41f5-6c39-49e8-bb5b-d08081f6dcc4 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:52.862190 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1380/2766] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:07:52.866009 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef411a-d85a-44e5-82b0-e254040b7e7d admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:52.878013 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef411a-d85a-44e5-82b0-e254040b7e7d admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:52.883146 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ea48c-831e-4de5-884a-b7d36485bc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:52.884160 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ea48c-831e-4de5-884a-b7d36485bc71 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:52.884652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ea48c-831e-4de5-884a-b7d36485bc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:52.885173 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ea48c-831e-4de5-884a-b7d36485bc71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:52.886444 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ea48c-831e-4de5-884a-b7d36485bc71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:52.889441 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ea48c-831e-4de5-884a-b7d36485bc71 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:52.902797 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1387/2767] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:07:52.906996 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f41f5-6c39-49e8-bb5b-d08081f6dcc4 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:52.917140 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f41f5-6c39-49e8-bb5b-d08081f6dcc4 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:52.921808 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5a605-2f5b-4096-af41-2afd5ae11a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:52.922449 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5a605-2f5b-4096-af41-2afd5ae11a9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:52.922774 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5a605-2f5b-4096-af41-2afd5ae11a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:52.923067 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5a605-2f5b-4096-af41-2afd5ae11a9b admin admin] PATH_INFO: `/v3/projects/f2d4445cc0eb418784bea0cdecb46fb3/users/bd85c465e7c24c1281122e2bebb8f643/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:52.938871 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5a605-2f5b-4096-af41-2afd5ae11a9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2d4445cc0eb418784bea0cdecb46fb3, user_id=bd85c465e7c24c1281122e2bebb8f643, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:52.941675 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5a605-2f5b-4096-af41-2afd5ae11a9b admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:52.956786 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1381/2768] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:07:52 2022] PUT /identity/v3/projects/f2d4445cc0eb418784bea0cdecb46fb3/users/bd85c465e7c24c1281122e2bebb8f643/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:07:52.967525 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f664ff5-c919-4ce0-87cd-5fa918b3ee8f None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:52.967814 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f664ff5-c919-4ce0-87cd-5fa918b3ee8f None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:52.968087 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f664ff5-c919-4ce0-87cd-5fa918b3ee8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:52.996370 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-2f664ff5-c919-4ce0-87cd-5fa918b3ee8f None None] MFA Rules not processed for user `bd85c465e7c24c1281122e2bebb8f643`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:07:52.997600 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-2f664ff5-c919-4ce0-87cd-5fa918b3ee8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:53.061030 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1388/2769] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:07:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:07:53.072017 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5a605-2f5b-4096-af41-2afd5ae11a9b admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:53.073693 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-caa5a605-2f5b-4096-af41-2afd5ae11a9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:53.129643 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5a605-2f5b-4096-af41-2afd5ae11a9b admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:53.133255 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbafe5-8637-454f-a4fc-83e518c1ca3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:53.133853 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbafe5-8637-454f-a4fc-83e518c1ca3d service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:53.134131 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbafe5-8637-454f-a4fc-83e518c1ca3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:53.134404 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbafe5-8637-454f-a4fc-83e518c1ca3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:53.143354 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bbafe5-8637-454f-a4fc-83e518c1ca3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:53.144866 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bbafe5-8637-454f-a4fc-83e518c1ca3d service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:53.153910 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1382/2770] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:07:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:07:54.510107 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37f35f-6f8f-450a-925d-174aa44e770c None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:54.510634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37f35f-6f8f-450a-925d-174aa44e770c None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:54.510634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37f35f-6f8f-450a-925d-174aa44e770c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:54.529248 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-9e37f35f-6f8f-450a-925d-174aa44e770c None None] MFA Rules not processed for user `bd85c465e7c24c1281122e2bebb8f643`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:07:54.530430 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-9e37f35f-6f8f-450a-925d-174aa44e770c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:54.537672 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1389/2771] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:07:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:07:54.999691 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbafe5-8637-454f-a4fc-83e518c1ca3d service cinder] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:07:55.001533 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-28bbafe5-8637-454f-a4fc-83e518c1ca3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:55.044610 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:07:55.076888 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbafe5-8637-454f-a4fc-83e518c1ca3d service cinder] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:07:55.082391 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9b21c-a92a-4606-bd1f-5b95e89f2593 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5043d835c08458c9f3911a4741bdaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:07:55.082989 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9b21c-a92a-4606-bd1f-5b95e89f2593 service placement] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:07:55.083270 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9b21c-a92a-4606-bd1f-5b95e89f2593 service placement] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:07:55.083544 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9b21c-a92a-4606-bd1f-5b95e89f2593 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:07:55.085347 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-e8f9b21c-a92a-4606-bd1f-5b95e89f2593 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:07:55.097542 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9b21c-a92a-4606-bd1f-5b95e89f2593 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:07:55.099099 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9b21c-a92a-4606-bd1f-5b95e89f2593 service placement] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:07:55.108799 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1383/2772] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:07:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:08:04.025226 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37f35f-6f8f-450a-925d-174aa44e770c None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:08:04.026628 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-9e37f35f-6f8f-450a-925d-174aa44e770c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:08:04.047043 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:08:04.115935 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37f35f-6f8f-450a-925d-174aa44e770c None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:08:04.121264 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8bbec-5ca1-4eab-8505-e1b03b3602eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:08:04.121870 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8bbec-5ca1-4eab-8505-e1b03b3602eb service nova] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:08:04.122143 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8bbec-5ca1-4eab-8505-e1b03b3602eb service nova] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:08:04.122411 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8bbec-5ca1-4eab-8505-e1b03b3602eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:08:04.124450 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-82f8bbec-5ca1-4eab-8505-e1b03b3602eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:08:04.137213 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f8bbec-5ca1-4eab-8505-e1b03b3602eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:08:04.138785 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f8bbec-5ca1-4eab-8505-e1b03b3602eb service nova] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:08:04.149590 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1390/2773] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:08:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:08:05.104669 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=16 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:08:10.954465 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cadc03-3e6a-4f37-ac1d-5b9d43126cd2 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:08:10.955044 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cadc03-3e6a-4f37-ac1d-5b9d43126cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:08:10.955044 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cadc03-3e6a-4f37-ac1d-5b9d43126cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:08:11.004884 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-e3cadc03-3e6a-4f37-ac1d-5b9d43126cd2 None None] MFA Rules not processed for user `8475122232ef4d8893f2a9b98768396e`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:08:11.006193 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-e3cadc03-3e6a-4f37-ac1d-5b9d43126cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:08:11.071237 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1384/2774] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Sep 26 18:08:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:08:11.118645 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8bbec-5ca1-4eab-8505-e1b03b3602eb service nova] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:08:11.120069 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-82f8bbec-5ca1-4eab-8505-e1b03b3602eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:08:11.210869 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8bbec-5ca1-4eab-8505-e1b03b3602eb service nova] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:08:11.216135 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7ec36-3e68-4322-9ac4-21329d437687 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea49cd9839474232a0cbe66ccffbf082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:08:11.216731 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7ec36-3e68-4322-9ac4-21329d437687 service swift] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:08:11.217036 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7ec36-3e68-4322-9ac4-21329d437687 service swift] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:08:11.217304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7ec36-3e68-4322-9ac4-21329d437687 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:08:11.225275 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7ec36-3e68-4322-9ac4-21329d437687 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:08:11.227316 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7ec36-3e68-4322-9ac4-21329d437687 service swift] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:08:11.236666 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1391/2775] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Sep 26 18:08:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 26 18:08:11.758975 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1409309-5c07-4c51-acb1-186b081350cd None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:08:11.759254 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1409309-5c07-4c51-acb1-186b081350cd None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:08:11.759544 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1409309-5c07-4c51-acb1-186b081350cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:08:11.778691 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-c1409309-5c07-4c51-acb1-186b081350cd None None] MFA Rules not processed for user `8475122232ef4d8893f2a9b98768396e`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:08:11.779862 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-c1409309-5c07-4c51-acb1-186b081350cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:08:11.786783 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1385/2776] 10.222.0.62 () {58 vars in 967 bytes} [Mon Sep 26 18:08:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:08:11.798734 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7ec36-3e68-4322-9ac4-21329d437687 service swift] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:08:11.809325 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7ec36-3e68-4322-9ac4-21329d437687 service swift] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:08:11.814844 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa94de-6cc7-4998-8451-574ca6850142 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea49cd9839474232a0cbe66ccffbf082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:08:11.815437 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa94de-6cc7-4998-8451-574ca6850142 service swift] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:08:11.815718 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa94de-6cc7-4998-8451-574ca6850142 service swift] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:08:11.815988 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa94de-6cc7-4998-8451-574ca6850142 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:08:11.823906 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa94de-6cc7-4998-8451-574ca6850142 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:08:11.825530 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa94de-6cc7-4998-8451-574ca6850142 service swift] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:08:11.834137 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1392/2777] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Sep 26 18:08:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 18:08:12.061607 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031e40d-e4b0-498d-bd00-37a99921fcaa None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:08:12.062062 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031e40d-e4b0-498d-bd00-37a99921fcaa None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:08:12.062154 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031e40d-e4b0-498d-bd00-37a99921fcaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:08:12.081537 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-5031e40d-e4b0-498d-bd00-37a99921fcaa None None] MFA Rules not processed for user `8475122232ef4d8893f2a9b98768396e`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:08:12.082726 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-5031e40d-e4b0-498d-bd00-37a99921fcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:08:12.090072 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1386/2778] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Sep 26 18:08:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:08:12.101795 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa94de-6cc7-4998-8451-574ca6850142 service swift] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:08:12.112604 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa94de-6cc7-4998-8451-574ca6850142 service swift] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:08:12.117584 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c924247-b82a-44e4-904b-887fe33f2e2e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea49cd9839474232a0cbe66ccffbf082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:08:12.118223 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c924247-b82a-44e4-904b-887fe33f2e2e service swift] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:08:12.118496 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c924247-b82a-44e4-904b-887fe33f2e2e service swift] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:08:12.118763 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c924247-b82a-44e4-904b-887fe33f2e2e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:08:12.127421 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c924247-b82a-44e4-904b-887fe33f2e2e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:08:12.128974 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c924247-b82a-44e4-904b-887fe33f2e2e service swift] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:08:12.137323 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1393/2779] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Sep 26 18:08:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 18:08:12.472155 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a4243-0646-467d-abf6-a70e20af878c None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:08:12.472430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a4243-0646-467d-abf6-a70e20af878c None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:08:12.472700 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a4243-0646-467d-abf6-a70e20af878c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:08:12.492388 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-cc3a4243-0646-467d-abf6-a70e20af878c None None] MFA Rules not processed for user `8475122232ef4d8893f2a9b98768396e`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:08:12.493613 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-cc3a4243-0646-467d-abf6-a70e20af878c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:08:12.500552 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1387/2780] 10.222.0.62 () {58 vars in 967 bytes} [Mon Sep 26 18:08:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 18:08:12.512863 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c924247-b82a-44e4-904b-887fe33f2e2e service swift] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:08:12.526050 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c924247-b82a-44e4-904b-887fe33f2e2e service swift] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:08:12.532196 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b7d58-606b-4a29-897e-07afedf853ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea49cd9839474232a0cbe66ccffbf082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:08:12.532881 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b7d58-606b-4a29-897e-07afedf853ca service swift] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:08:12.533199 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b7d58-606b-4a29-897e-07afedf853ca service swift] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:08:12.533470 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b7d58-606b-4a29-897e-07afedf853ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:08:12.541941 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b7d58-606b-4a29-897e-07afedf853ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:08:12.543517 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b7d58-606b-4a29-897e-07afedf853ca service swift] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:08:12.552224 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1394/2781] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Sep 26 18:08:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 18:08:13.183829 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a4243-0646-467d-abf6-a70e20af878c None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:08:13.186301 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-cc3a4243-0646-467d-abf6-a70e20af878c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:08:13.214140 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a4243-0646-467d-abf6-a70e20af878c None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:08:13.226585 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c3f15-78c0-4705-aa47-a09c477bbf6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:08:13.227229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c3f15-78c0-4705-aa47-a09c477bbf6f service nova] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:08:13.227502 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c3f15-78c0-4705-aa47-a09c477bbf6f service nova] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:08:13.227877 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c3f15-78c0-4705-aa47-a09c477bbf6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:08:13.232432 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-fe6c3f15-78c0-4705-aa47-a09c477bbf6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:08:13.247360 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c3f15-78c0-4705-aa47-a09c477bbf6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:08:13.249091 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c3f15-78c0-4705-aa47-a09c477bbf6f service nova] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:08:13.264254 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1388/2782] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:08:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:08:14.831468 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b7d58-606b-4a29-897e-07afedf853ca service swift] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:08:14.878081 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:08:14.920812 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b7d58-606b-4a29-897e-07afedf853ca service swift] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:08:14.926565 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc837c6a-34a8-4e5f-9487-8b3260cfb393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:08:14.927201 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc837c6a-34a8-4e5f-9487-8b3260cfb393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:08:14.927483 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc837c6a-34a8-4e5f-9487-8b3260cfb393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:08:14.927750 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc837c6a-34a8-4e5f-9487-8b3260cfb393 admin admin] PATH_INFO: `/v3/users/bd85c465e7c24c1281122e2bebb8f643` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:08:14.928900 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc837c6a-34a8-4e5f-9487-8b3260cfb393 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd85c465e7c24c1281122e2bebb8f643)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:08:14.930865 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc837c6a-34a8-4e5f-9487-8b3260cfb393 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:08:14.981798 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-dc837c6a-34a8-4e5f-9487-8b3260cfb393 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd85c465e7c24c1281122e2bebb8f643'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:08:14.990825 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-dc837c6a-34a8-4e5f-9487-8b3260cfb393 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd85c465e7c24c1281122e2bebb8f643'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:08:14.991741 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-dc837c6a-34a8-4e5f-9487-8b3260cfb393 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd85c465e7c24c1281122e2bebb8f643'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:08:14.992409 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-dc837c6a-34a8-4e5f-9487-8b3260cfb393 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd85c465e7c24c1281122e2bebb8f643'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:08:15.005437 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-dc837c6a-34a8-4e5f-9487-8b3260cfb393 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd85c465e7c24c1281122e2bebb8f643'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:08:15.023994 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1395/2783] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 18:08:14 2022] DELETE /identity/v3/users/bd85c465e7c24c1281122e2bebb8f643 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:08:15.028608 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7aa32c-c23f-4164-b234-6bd8459bd339 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:08:15.029118 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7aa32c-c23f-4164-b234-6bd8459bd339 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:08:15.029213 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7aa32c-c23f-4164-b234-6bd8459bd339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:08:15.049790 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-5d7aa32c-c23f-4164-b234-6bd8459bd339 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:08:15.050994 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-5d7aa32c-c23f-4164-b234-6bd8459bd339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:08:15.113996 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1389/2784] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:08:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:08:15.123880 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc837c6a-34a8-4e5f-9487-8b3260cfb393 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:08:15.125472 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-dc837c6a-34a8-4e5f-9487-8b3260cfb393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:08:15.210114 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc837c6a-34a8-4e5f-9487-8b3260cfb393 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:08:15.216605 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf9789-b9e1-4c64-b38a-3e9392e47658 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:08:15.217262 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf9789-b9e1-4c64-b38a-3e9392e47658 service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:08:15.217548 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf9789-b9e1-4c64-b38a-3e9392e47658 service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:08:15.217841 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf9789-b9e1-4c64-b38a-3e9392e47658 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:08:15.229154 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf9789-b9e1-4c64-b38a-3e9392e47658 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:08:15.231652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf9789-b9e1-4c64-b38a-3e9392e47658 service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:08:15.243943 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1396/2785] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:08:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:08:15.423223 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7aa32c-c23f-4164-b234-6bd8459bd339 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:08:15.424786 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-5d7aa32c-c23f-4164-b234-6bd8459bd339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:08:15.440914 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7aa32c-c23f-4164-b234-6bd8459bd339 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:08:15.446528 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578b9a4-6d1b-4eea-b259-71fce23083eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:08:15.447552 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578b9a4-6d1b-4eea-b259-71fce23083eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:08:15.447832 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578b9a4-6d1b-4eea-b259-71fce23083eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:08:15.448104 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578b9a4-6d1b-4eea-b259-71fce23083eb admin admin] PATH_INFO: `/v3/projects/f2d4445cc0eb418784bea0cdecb46fb3` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:08:15.449391 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2578b9a4-6d1b-4eea-b259-71fce23083eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2d4445cc0eb418784bea0cdecb46fb3)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:08:15.451155 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2578b9a4-6d1b-4eea-b259-71fce23083eb admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:08:15.490375 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:08:15.502171 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-2578b9a4-6d1b-4eea-b259-71fce23083eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2d4445cc0eb418784bea0cdecb46fb3', 'request_id': 'req-2578b9a4-6d1b-4eea-b259-71fce23083eb'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:08:15.508553 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-2578b9a4-6d1b-4eea-b259-71fce23083eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2d4445cc0eb418784bea0cdecb46fb3', 'request_id': 'req-2578b9a4-6d1b-4eea-b259-71fce23083eb'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:08:15.517268 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-2578b9a4-6d1b-4eea-b259-71fce23083eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2d4445cc0eb418784bea0cdecb46fb3', 'request_id': 'req-2578b9a4-6d1b-4eea-b259-71fce23083eb'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:08:15.530709 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-2578b9a4-6d1b-4eea-b259-71fce23083eb admin admin] The token cache is being invalidate because project f2d4445cc0eb418784bea0cdecb46fb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:08:15.531791 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-2578b9a4-6d1b-4eea-b259-71fce23083eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:08:15.532450 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-2578b9a4-6d1b-4eea-b259-71fce23083eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:08:15.534091 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1390/2786] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:08:15 2022] DELETE /identity/v3/projects/f2d4445cc0eb418784bea0cdecb46fb3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:08:15.538993 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc79be-15ac-4a80-83d7-570285eb3046 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:08:15.539291 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc79be-15ac-4a80-83d7-570285eb3046 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:08:15.539605 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc79be-15ac-4a80-83d7-570285eb3046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:08:15.559789 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-0cdc79be-15ac-4a80-83d7-570285eb3046 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:08:15.561065 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-0cdc79be-15ac-4a80-83d7-570285eb3046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:08:15.615899 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:08:15.631405 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1397/2787] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:08:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 18:08:15.638908 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ab6ad-95ae-4ba6-9f64-f27ec8a63e76 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:08:15.639191 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ab6ad-95ae-4ba6-9f64-f27ec8a63e76 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:08:15.639466 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ab6ad-95ae-4ba6-9f64-f27ec8a63e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:08:15.660581 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-1e1ab6ad-95ae-4ba6-9f64-f27ec8a63e76 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:08:15.661723 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-1e1ab6ad-95ae-4ba6-9f64-f27ec8a63e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:08:15.671214 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1391/2788] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:08:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:08:15.676096 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc79be-15ac-4a80-83d7-570285eb3046 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:08:15.685722 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc79be-15ac-4a80-83d7-570285eb3046 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:08:15.690385 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24826d45-fceb-4812-9d50-bbc46a46abd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:08:15.690994 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24826d45-fceb-4812-9d50-bbc46a46abd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:08:15.691270 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24826d45-fceb-4812-9d50-bbc46a46abd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:08:15.691543 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24826d45-fceb-4812-9d50-bbc46a46abd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:08:15.692188 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24826d45-fceb-4812-9d50-bbc46a46abd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 18:08:15.692494 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24826d45-fceb-4812-9d50-bbc46a46abd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:08:15.694121 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24826d45-fceb-4812-9d50-bbc46a46abd5 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:08:15.710047 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1398/2789] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 18:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 18:08:15.711128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ab6ad-95ae-4ba6-9f64-f27ec8a63e76 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:08:15.722257 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ab6ad-95ae-4ba6-9f64-f27ec8a63e76 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:08:15.727044 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f6063-e740-41b7-ae26-6f6272265a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:08:15.727729 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f6063-e740-41b7-ae26-6f6272265a1f admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:08:15.728004 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f6063-e740-41b7-ae26-6f6272265a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:08:15.728272 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f6063-e740-41b7-ae26-6f6272265a1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:08:15.728906 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f6063-e740-41b7-ae26-6f6272265a1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:08:15.730842 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f6063-e740-41b7-ae26-6f6272265a1f admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:08:15.758381 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1392/2790] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 18:08:15 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 18:08:15.762634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24826d45-fceb-4812-9d50-bbc46a46abd5 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:08:15.773258 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24826d45-fceb-4812-9d50-bbc46a46abd5 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:08:15.831533 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9eb932-6a25-4758-9eab-5e6738d2efa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:08:15.832242 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9eb932-6a25-4758-9eab-5e6738d2efa3 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:08:15.832407 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9eb932-6a25-4758-9eab-5e6738d2efa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:08:15.832681 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9eb932-6a25-4758-9eab-5e6738d2efa3 admin admin] PATH_INFO: `/v3/users` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:08:15.833361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9eb932-6a25-4758-9eab-5e6738d2efa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:08:15.835277 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9eb932-6a25-4758-9eab-5e6738d2efa3 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:08:15.857386 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1399/2791] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 18:08:15 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:08:15.862144 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f6063-e740-41b7-ae26-6f6272265a1f admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:08:15.872713 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f6063-e740-41b7-ae26-6f6272265a1f admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:08:15.877662 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee205e-e9c7-4c58-8266-bfa2b9624d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:08:15.878269 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee205e-e9c7-4c58-8266-bfa2b9624d91 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:08:15.878540 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee205e-e9c7-4c58-8266-bfa2b9624d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:08:15.878801 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee205e-e9c7-4c58-8266-bfa2b9624d91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:08:15.879437 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee205e-e9c7-4c58-8266-bfa2b9624d91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:08:15.881639 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee205e-e9c7-4c58-8266-bfa2b9624d91 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:08:15.892630 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1393/2792] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:08:15.896892 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9eb932-6a25-4758-9eab-5e6738d2efa3 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:08:15.907556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9eb932-6a25-4758-9eab-5e6738d2efa3 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:08:15.912424 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf64d22-4c4f-4e81-9dec-30fc60657de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:08:15.913099 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf64d22-4c4f-4e81-9dec-30fc60657de4 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:08:15.913377 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf64d22-4c4f-4e81-9dec-30fc60657de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:08:15.913649 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf64d22-4c4f-4e81-9dec-30fc60657de4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:08:15.914284 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf64d22-4c4f-4e81-9dec-30fc60657de4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:08:15.915861 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf64d22-4c4f-4e81-9dec-30fc60657de4 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:08:15.926889 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1400/2793] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:08:15.930817 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee205e-e9c7-4c58-8266-bfa2b9624d91 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:08:15.941395 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee205e-e9c7-4c58-8266-bfa2b9624d91 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:08:15.947565 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36e6b1-7e5f-4da5-addf-3e1eaec634c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:08:15.948231 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36e6b1-7e5f-4da5-addf-3e1eaec634c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:08:15.948531 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36e6b1-7e5f-4da5-addf-3e1eaec634c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:08:15.948794 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36e6b1-7e5f-4da5-addf-3e1eaec634c2 admin admin] PATH_INFO: `/v3/projects/31c180c2c2f44d3883654763a587039e/users/2c1764c16db04f74a353d55e13faefd2/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:08:15.962884 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f68e1-dd4f-4f21-bc47-975cbacb4727 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:08:15.963499 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f68e1-dd4f-4f21-bc47-975cbacb4727 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:08:15.963967 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f68e1-dd4f-4f21-bc47-975cbacb4727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:08:15.965517 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf36e6b1-7e5f-4da5-addf-3e1eaec634c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31c180c2c2f44d3883654763a587039e, user_id=2c1764c16db04f74a353d55e13faefd2, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:08:15.968170 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf36e6b1-7e5f-4da5-addf-3e1eaec634c2 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:08:15.985782 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-f14f68e1-dd4f-4f21-bc47-975cbacb4727 None None] MFA Rules not processed for user `1d22386e24cb4c079bfe8a2e9a153034`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:08:15.996037 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1394/2794] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:08:15 2022] PUT /identity/v3/projects/31c180c2c2f44d3883654763a587039e/users/2c1764c16db04f74a353d55e13faefd2/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:08:15.996190 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-f14f68e1-dd4f-4f21-bc47-975cbacb4727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:08:15.997626 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be92c0-67f6-47f8-8259-ee3f0786d757 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:08:15.997914 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be92c0-67f6-47f8-8259-ee3f0786d757 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:08:15.998183 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be92c0-67f6-47f8-8259-ee3f0786d757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:08:16.026324 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-14be92c0-67f6-47f8-8259-ee3f0786d757 None None] MFA Rules not processed for user `2c1764c16db04f74a353d55e13faefd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:08:16.027456 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-14be92c0-67f6-47f8-8259-ee3f0786d757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:08:16.046137 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1401/2795] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:08:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 18:08:16.093051 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1395/2796] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:08:15 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 18:08:16.104435 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f68e1-dd4f-4f21-bc47-975cbacb4727 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:08:16.105844 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-f14f68e1-dd4f-4f21-bc47-975cbacb4727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:08:16.164613 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f68e1-dd4f-4f21-bc47-975cbacb4727 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:08:16.168253 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d0e1c-3cf2-4b1a-9e4d-7f0df73e80ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:08:16.168858 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d0e1c-3cf2-4b1a-9e4d-7f0df73e80ba service cinder] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:08:16.169175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d0e1c-3cf2-4b1a-9e4d-7f0df73e80ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:08:16.170083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d0e1c-3cf2-4b1a-9e4d-7f0df73e80ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:08:16.179305 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d0e1c-3cf2-4b1a-9e4d-7f0df73e80ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:08:16.180749 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d0e1c-3cf2-4b1a-9e4d-7f0df73e80ba service cinder] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:08:16.190509 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1402/2797] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:08:16 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:08:16.387671 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be92c0-67f6-47f8-8259-ee3f0786d757 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:08:16.390356 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-14be92c0-67f6-47f8-8259-ee3f0786d757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:08:16.453822 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:08:16.460414 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be92c0-67f6-47f8-8259-ee3f0786d757 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:08:16.465629 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df12b18-c354-40f7-981b-0b7f36500762 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:08:16.466371 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df12b18-c354-40f7-981b-0b7f36500762 service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:08:16.466601 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df12b18-c354-40f7-981b-0b7f36500762 service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:08:16.467033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df12b18-c354-40f7-981b-0b7f36500762 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:08:16.469343 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-0df12b18-c354-40f7-981b-0b7f36500762 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:08:16.480547 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df12b18-c354-40f7-981b-0b7f36500762 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:08:16.482408 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df12b18-c354-40f7-981b-0b7f36500762 service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:08:16.492946 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1396/2798] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:08:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:08:20.070201 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d0e1c-3cf2-4b1a-9e4d-7f0df73e80ba service cinder] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:08:20.080690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d0e1c-3cf2-4b1a-9e4d-7f0df73e80ba service cinder] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:08:20.084294 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ee6f9-7da5-437a-96d3-7e4bcc4d8bab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:08:20.084888 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ee6f9-7da5-437a-96d3-7e4bcc4d8bab service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:08:20.085198 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ee6f9-7da5-437a-96d3-7e4bcc4d8bab service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:08:20.085469 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ee6f9-7da5-437a-96d3-7e4bcc4d8bab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:08:20.087185 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-582ee6f9-7da5-437a-96d3-7e4bcc4d8bab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:08:20.092723 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:08:20.168920 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ee6f9-7da5-437a-96d3-7e4bcc4d8bab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:08:20.170792 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ee6f9-7da5-437a-96d3-7e4bcc4d8bab service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:08:20.181345 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1403/2799] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:08:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:08:21.037144 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df12b18-c354-40f7-981b-0b7f36500762 service neutron] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:08:21.038544 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-0df12b18-c354-40f7-981b-0b7f36500762 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:08:21.122854 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df12b18-c354-40f7-981b-0b7f36500762 service neutron] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:08:21.129474 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8978c1a-5f50-4902-8ee4-c90daf89d7a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:08:21.130306 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8978c1a-5f50-4902-8ee4-c90daf89d7a8 service nova] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:08:21.130756 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8978c1a-5f50-4902-8ee4-c90daf89d7a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:08:21.131210 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8978c1a-5f50-4902-8ee4-c90daf89d7a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:08:21.132986 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-e8978c1a-5f50-4902-8ee4-c90daf89d7a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:08:21.149047 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8978c1a-5f50-4902-8ee4-c90daf89d7a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:08:21.150893 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8978c1a-5f50-4902-8ee4-c90daf89d7a8 service nova] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:08:21.176600 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1397/2800] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:08:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:08:26.152977 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ee6f9-7da5-437a-96d3-7e4bcc4d8bab service neutron] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:08:26.154650 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-582ee6f9-7da5-437a-96d3-7e4bcc4d8bab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:08:26.167321 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ee6f9-7da5-437a-96d3-7e4bcc4d8bab service neutron] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:08:26.171305 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c79307a-56c2-4ea6-ad53-2db4eb44829e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:08:26.171859 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79307a-56c2-4ea6-ad53-2db4eb44829e service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:08:26.172137 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79307a-56c2-4ea6-ad53-2db4eb44829e service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:08:26.172411 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79307a-56c2-4ea6-ad53-2db4eb44829e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:08:26.174362 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-8c79307a-56c2-4ea6-ad53-2db4eb44829e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:08:26.254154 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c79307a-56c2-4ea6-ad53-2db4eb44829e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:08:26.255766 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c79307a-56c2-4ea6-ad53-2db4eb44829e service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:08:26.267927 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1404/2801] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:08:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:08:26.443260 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8978c1a-5f50-4902-8ee4-c90daf89d7a8 service nova] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:08:26.454955 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8978c1a-5f50-4902-8ee4-c90daf89d7a8 service nova] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:08:26.460027 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f871983-478d-4d46-a66d-9d15ac991455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:08:26.460655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f871983-478d-4d46-a66d-9d15ac991455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:08:26.460928 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f871983-478d-4d46-a66d-9d15ac991455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:08:26.461242 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f871983-478d-4d46-a66d-9d15ac991455 admin admin] PATH_INFO: `/v3/users/2c1764c16db04f74a353d55e13faefd2` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:08:26.462369 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f871983-478d-4d46-a66d-9d15ac991455 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c1764c16db04f74a353d55e13faefd2)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:08:26.464313 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f871983-478d-4d46-a66d-9d15ac991455 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:08:26.514675 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-1f871983-478d-4d46-a66d-9d15ac991455 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c1764c16db04f74a353d55e13faefd2'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:08:26.515351 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-1f871983-478d-4d46-a66d-9d15ac991455 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c1764c16db04f74a353d55e13faefd2'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:08:26.516506 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-1f871983-478d-4d46-a66d-9d15ac991455 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c1764c16db04f74a353d55e13faefd2'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:08:26.523728 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-1f871983-478d-4d46-a66d-9d15ac991455 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c1764c16db04f74a353d55e13faefd2'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:08:26.531207 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-1f871983-478d-4d46-a66d-9d15ac991455 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c1764c16db04f74a353d55e13faefd2'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:08:26.550327 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1398/2802] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 18:08:26 2022] DELETE /identity/v3/users/2c1764c16db04f74a353d55e13faefd2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:08:26.554708 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ce3c4-ed04-47b0-a03d-2bb7826cd8f0 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:08:26.554995 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ce3c4-ed04-47b0-a03d-2bb7826cd8f0 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:08:26.555269 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ce3c4-ed04-47b0-a03d-2bb7826cd8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:08:26.574669 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-fb6ce3c4-ed04-47b0-a03d-2bb7826cd8f0 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:08:26.575864 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-fb6ce3c4-ed04-47b0-a03d-2bb7826cd8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:08:26.635638 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1405/2803] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:08:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:08:26.646006 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f871983-478d-4d46-a66d-9d15ac991455 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:08:26.647442 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-1f871983-478d-4d46-a66d-9d15ac991455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:08:26.700732 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:08:26.705959 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f871983-478d-4d46-a66d-9d15ac991455 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:08:26.711216 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa74a0-970b-4e3d-8ba5-13494aa7af9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:08:26.711926 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa74a0-970b-4e3d-8ba5-13494aa7af9b service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:08:26.712418 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa74a0-970b-4e3d-8ba5-13494aa7af9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:08:26.712852 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa74a0-970b-4e3d-8ba5-13494aa7af9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:08:26.723657 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa74a0-970b-4e3d-8ba5-13494aa7af9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:08:26.725575 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa74a0-970b-4e3d-8ba5-13494aa7af9b service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:08:26.740692 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1399/2804] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:08:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:08:27.021537 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ce3c4-ed04-47b0-a03d-2bb7826cd8f0 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:08:27.023078 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-fb6ce3c4-ed04-47b0-a03d-2bb7826cd8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:08:27.047951 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ce3c4-ed04-47b0-a03d-2bb7826cd8f0 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:08:27.057618 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442ec31-52c8-414f-82bb-177418f98dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:08:27.058574 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442ec31-52c8-414f-82bb-177418f98dfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:08:27.058717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442ec31-52c8-414f-82bb-177418f98dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:08:27.059059 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442ec31-52c8-414f-82bb-177418f98dfe admin admin] PATH_INFO: `/v3/projects/31c180c2c2f44d3883654763a587039e` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:08:27.060222 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d442ec31-52c8-414f-82bb-177418f98dfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=31c180c2c2f44d3883654763a587039e)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:08:27.062985 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d442ec31-52c8-414f-82bb-177418f98dfe admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:08:27.102217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:08:27.114689 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-d442ec31-52c8-414f-82bb-177418f98dfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31c180c2c2f44d3883654763a587039e', 'request_id': 'req-d442ec31-52c8-414f-82bb-177418f98dfe'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:08:27.122711 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-d442ec31-52c8-414f-82bb-177418f98dfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31c180c2c2f44d3883654763a587039e', 'request_id': 'req-d442ec31-52c8-414f-82bb-177418f98dfe'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:08:27.131140 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-d442ec31-52c8-414f-82bb-177418f98dfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31c180c2c2f44d3883654763a587039e', 'request_id': 'req-d442ec31-52c8-414f-82bb-177418f98dfe'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:08:27.144771 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-d442ec31-52c8-414f-82bb-177418f98dfe admin admin] The token cache is being invalidate because project 31c180c2c2f44d3883654763a587039e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:08:27.145096 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-d442ec31-52c8-414f-82bb-177418f98dfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:08:27.145755 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-d442ec31-52c8-414f-82bb-177418f98dfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:08:27.148095 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1406/2805] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:08:27 2022] DELETE /identity/v3/projects/31c180c2c2f44d3883654763a587039e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:08:29.727948 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa74a0-970b-4e3d-8ba5-13494aa7af9b service neutron] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:08:29.729950 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-cfaa74a0-970b-4e3d-8ba5-13494aa7af9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:08:29.812906 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa74a0-970b-4e3d-8ba5-13494aa7af9b service neutron] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:08:29.878820 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a69695-f1f8-4a77-bbdb-da0946a8075c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5043d835c08458c9f3911a4741bdaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:08:29.879471 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a69695-f1f8-4a77-bbdb-da0946a8075c service placement] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:08:29.879776 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a69695-f1f8-4a77-bbdb-da0946a8075c service placement] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:08:29.880072 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a69695-f1f8-4a77-bbdb-da0946a8075c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:08:29.881921 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-c3a69695-f1f8-4a77-bbdb-da0946a8075c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:08:29.894441 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a69695-f1f8-4a77-bbdb-da0946a8075c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:08:29.896060 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a69695-f1f8-4a77-bbdb-da0946a8075c service placement] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:08:29.907434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1400/2806] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:08:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:08:33.266199 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442ec31-52c8-414f-82bb-177418f98dfe admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:08:33.267698 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-d442ec31-52c8-414f-82bb-177418f98dfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:08:33.332545 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442ec31-52c8-414f-82bb-177418f98dfe admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:08:33.337132 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13d116-e821-4fdd-8c17-5c0c1db6dcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:08:33.337763 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13d116-e821-4fdd-8c17-5c0c1db6dcdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:08:33.338036 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13d116-e821-4fdd-8c17-5c0c1db6dcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:08:33.338313 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13d116-e821-4fdd-8c17-5c0c1db6dcdb admin admin] PATH_INFO: `/v3/users/12475a22706b4ef3bdeae16267703057` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:08:33.339730 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e13d116-e821-4fdd-8c17-5c0c1db6dcdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=12475a22706b4ef3bdeae16267703057)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:08:33.341778 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e13d116-e821-4fdd-8c17-5c0c1db6dcdb admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:08:33.389598 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-2e13d116-e821-4fdd-8c17-5c0c1db6dcdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12475a22706b4ef3bdeae16267703057'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:08:33.398116 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-2e13d116-e821-4fdd-8c17-5c0c1db6dcdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12475a22706b4ef3bdeae16267703057'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:08:33.399072 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-2e13d116-e821-4fdd-8c17-5c0c1db6dcdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12475a22706b4ef3bdeae16267703057'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:08:33.399692 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-2e13d116-e821-4fdd-8c17-5c0c1db6dcdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12475a22706b4ef3bdeae16267703057'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:08:33.407518 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-2e13d116-e821-4fdd-8c17-5c0c1db6dcdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12475a22706b4ef3bdeae16267703057'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:08:33.426110 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1407/2807] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 18:08:33 2022] DELETE /identity/v3/users/12475a22706b4ef3bdeae16267703057 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:08:33.598453 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a69695-f1f8-4a77-bbdb-da0946a8075c service placement] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:08:33.610191 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a69695-f1f8-4a77-bbdb-da0946a8075c service placement] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:08:33.673531 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74f54e-6a6c-4434-832f-fcd759000bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:08:33.674153 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74f54e-6a6c-4434-832f-fcd759000bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:08:33.674428 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74f54e-6a6c-4434-832f-fcd759000bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:08:33.674694 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74f54e-6a6c-4434-832f-fcd759000bda admin admin] PATH_INFO: `/v3/projects/c048cea6a5524d0b8f5821ebe22fce2b` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:08:33.675801 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd74f54e-6a6c-4434-832f-fcd759000bda admin admin] RBAC: Authorizing `identity:delete_project(project_id=c048cea6a5524d0b8f5821ebe22fce2b)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:08:33.677716 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd74f54e-6a6c-4434-832f-fcd759000bda admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:08:33.711693 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:08:33.729310 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-dd74f54e-6a6c-4434-832f-fcd759000bda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c048cea6a5524d0b8f5821ebe22fce2b', 'request_id': 'req-dd74f54e-6a6c-4434-832f-fcd759000bda'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:08:33.734698 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-dd74f54e-6a6c-4434-832f-fcd759000bda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c048cea6a5524d0b8f5821ebe22fce2b', 'request_id': 'req-dd74f54e-6a6c-4434-832f-fcd759000bda'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:08:33.741795 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-dd74f54e-6a6c-4434-832f-fcd759000bda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c048cea6a5524d0b8f5821ebe22fce2b', 'request_id': 'req-dd74f54e-6a6c-4434-832f-fcd759000bda'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:08:33.752704 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-dd74f54e-6a6c-4434-832f-fcd759000bda admin admin] The token cache is being invalidate because project c048cea6a5524d0b8f5821ebe22fce2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:08:33.752990 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-dd74f54e-6a6c-4434-832f-fcd759000bda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:08:33.753698 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-dd74f54e-6a6c-4434-832f-fcd759000bda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:08:33.755176 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1401/2808] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:08:33 2022] DELETE /identity/v3/projects/c048cea6a5524d0b8f5821ebe22fce2b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:08:33.759197 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13d116-e821-4fdd-8c17-5c0c1db6dcdb admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:08:33.760591 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-2e13d116-e821-4fdd-8c17-5c0c1db6dcdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:08:33.773803 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13d116-e821-4fdd-8c17-5c0c1db6dcdb admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:08:33.814946 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:08:33.832743 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb6165-aeae-4a78-8836-6d6b0125ee8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:08:33.833406 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb6165-aeae-4a78-8836-6d6b0125ee8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:08:33.833684 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb6165-aeae-4a78-8836-6d6b0125ee8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:08:33.833956 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb6165-aeae-4a78-8836-6d6b0125ee8d admin admin] PATH_INFO: `/v3/users/907718a21b584704b4e0817125102faf` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:08:33.835076 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb6165-aeae-4a78-8836-6d6b0125ee8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=907718a21b584704b4e0817125102faf)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:08:33.837041 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb6165-aeae-4a78-8836-6d6b0125ee8d admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:08:33.883054 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-80cb6165-aeae-4a78-8836-6d6b0125ee8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '907718a21b584704b4e0817125102faf'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:08:33.891302 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-80cb6165-aeae-4a78-8836-6d6b0125ee8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '907718a21b584704b4e0817125102faf'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:08:33.892032 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-80cb6165-aeae-4a78-8836-6d6b0125ee8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '907718a21b584704b4e0817125102faf'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:08:33.892630 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-80cb6165-aeae-4a78-8836-6d6b0125ee8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '907718a21b584704b4e0817125102faf'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:08:33.899505 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-80cb6165-aeae-4a78-8836-6d6b0125ee8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '907718a21b584704b4e0817125102faf'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:08:33.916465 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1408/2809] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 18:08:33 2022] DELETE /identity/v3/users/907718a21b584704b4e0817125102faf => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 18:08:34.088664 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74f54e-6a6c-4434-832f-fcd759000bda admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:08:34.090486 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-dd74f54e-6a6c-4434-832f-fcd759000bda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:08:34.104126 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74f54e-6a6c-4434-832f-fcd759000bda admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:08:34.163845 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca283ad8-62ad-490c-947c-d88075bb666c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:08:34.164468 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca283ad8-62ad-490c-947c-d88075bb666c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:08:34.164736 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca283ad8-62ad-490c-947c-d88075bb666c admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:08:34.164997 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca283ad8-62ad-490c-947c-d88075bb666c admin admin] PATH_INFO: `/v3/projects/a2a3ae1130874754bdad9c1458aa3abb` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:08:34.166124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca283ad8-62ad-490c-947c-d88075bb666c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2a3ae1130874754bdad9c1458aa3abb)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:08:34.168019 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca283ad8-62ad-490c-947c-d88075bb666c admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:08:34.218072 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-ca283ad8-62ad-490c-947c-d88075bb666c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2a3ae1130874754bdad9c1458aa3abb', 'request_id': 'req-ca283ad8-62ad-490c-947c-d88075bb666c'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:08:34.223882 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-ca283ad8-62ad-490c-947c-d88075bb666c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2a3ae1130874754bdad9c1458aa3abb', 'request_id': 'req-ca283ad8-62ad-490c-947c-d88075bb666c'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:08:34.233911 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-ca283ad8-62ad-490c-947c-d88075bb666c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2a3ae1130874754bdad9c1458aa3abb', 'request_id': 'req-ca283ad8-62ad-490c-947c-d88075bb666c'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:08:34.245915 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-ca283ad8-62ad-490c-947c-d88075bb666c admin admin] The token cache is being invalidate because project a2a3ae1130874754bdad9c1458aa3abb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:08:34.246278 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-ca283ad8-62ad-490c-947c-d88075bb666c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:08:34.247299 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-ca283ad8-62ad-490c-947c-d88075bb666c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:08:34.249328 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1402/2810] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:08:34 2022] DELETE /identity/v3/projects/a2a3ae1130874754bdad9c1458aa3abb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:08:43.913214 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=34,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:08:44.242741 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:DELETE=13,keystone:SELECT=65,keystone:INSERT=2 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:09:44.638816 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb6165-aeae-4a78-8836-6d6b0125ee8d admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:09:44.640285 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-80cb6165-aeae-4a78-8836-6d6b0125ee8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:09:44.713204 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb6165-aeae-4a78-8836-6d6b0125ee8d admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:09:44.775248 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616fd7f-28c4-495c-9c9d-94916ae9e3bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1792e79b9c9a47e1923f19bfd2cd495b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:09:44.775848 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616fd7f-28c4-495c-9c9d-94916ae9e3bf service nova] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:09:44.776128 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616fd7f-28c4-495c-9c9d-94916ae9e3bf service nova] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:09:44.776917 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616fd7f-28c4-495c-9c9d-94916ae9e3bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:09:44.778747 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-3616fd7f-28c4-495c-9c9d-94916ae9e3bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:09:44.835795 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616fd7f-28c4-495c-9c9d-94916ae9e3bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:09:44.838528 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616fd7f-28c4-495c-9c9d-94916ae9e3bf service nova] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:09:44.848050 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1409/2811] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:09:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:09:53.029205 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca283ad8-62ad-490c-947c-d88075bb666c admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:09:53.030762 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-ca283ad8-62ad-490c-947c-d88075bb666c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:09:53.111556 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca283ad8-62ad-490c-947c-d88075bb666c admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:09:53.116590 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399ab04-2ad0-4f93-a1be-8fabaedcaeaf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5043d835c08458c9f3911a4741bdaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:09:53.117229 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399ab04-2ad0-4f93-a1be-8fabaedcaeaf service placement] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:09:53.117512 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399ab04-2ad0-4f93-a1be-8fabaedcaeaf service placement] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:09:53.117787 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399ab04-2ad0-4f93-a1be-8fabaedcaeaf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:09:53.119512 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-7399ab04-2ad0-4f93-a1be-8fabaedcaeaf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:09:53.133560 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7399ab04-2ad0-4f93-a1be-8fabaedcaeaf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:09:53.135086 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7399ab04-2ad0-4f93-a1be-8fabaedcaeaf service placement] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:09:53.146997 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1403/2812] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:09:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:09:54.843761 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=84 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:09:56.915938 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31339393-d14f-4b9e-8612-408a7abf2fd6 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:09:56.917305 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31339393-d14f-4b9e-8612-408a7abf2fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:09:56.917305 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31339393-d14f-4b9e-8612-408a7abf2fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:09:56.935909 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-31339393-d14f-4b9e-8612-408a7abf2fd6 None None] MFA Rules not processed for user `1d22386e24cb4c079bfe8a2e9a153034`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:09:56.937126 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-31339393-d14f-4b9e-8612-408a7abf2fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:09:56.944237 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1410/2813] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:09:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:10:03.141532 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=32 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:10:06.930467 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:11:27.244406 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399ab04-2ad0-4f93-a1be-8fabaedcaeaf service placement] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:11:27.246399 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-7399ab04-2ad0-4f93-a1be-8fabaedcaeaf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:11:27.301928 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399ab04-2ad0-4f93-a1be-8fabaedcaeaf service placement] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:11:27.308706 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d075940-68f3-49c0-b371-fd36245e5e4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:11:27.309352 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d075940-68f3-49c0-b371-fd36245e5e4f service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:11:27.309636 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d075940-68f3-49c0-b371-fd36245e5e4f service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:11:27.309911 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d075940-68f3-49c0-b371-fd36245e5e4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:11:27.311707 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-6d075940-68f3-49c0-b371-fd36245e5e4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:11:27.325937 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d075940-68f3-49c0-b371-fd36245e5e4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:11:27.327394 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d075940-68f3-49c0-b371-fd36245e5e4f service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:11:27.340184 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1404/2814] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:11:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 18:11:29.943937 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31339393-d14f-4b9e-8612-408a7abf2fd6 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:11:29.953720 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31339393-d14f-4b9e-8612-408a7abf2fd6 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:11:29.957478 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe69d8-0128-4ece-af06-28b695894546 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:11:29.958073 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe69d8-0128-4ece-af06-28b695894546 service cinder] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:11:29.958352 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe69d8-0128-4ece-af06-28b695894546 service cinder] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:11:29.959326 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe69d8-0128-4ece-af06-28b695894546 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:11:29.961285 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-eebe69d8-0128-4ece-af06-28b695894546 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:11:29.974626 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe69d8-0128-4ece-af06-28b695894546 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:11:29.976030 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe69d8-0128-4ece-af06-28b695894546 service cinder] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:11:29.986897 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1411/2815] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:11:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:11:37.334910 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=26 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:11:39.981996 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=6 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:11:40.386984 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d075940-68f3-49c0-b371-fd36245e5e4f service cinder] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:11:40.388460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-6d075940-68f3-49c0-b371-fd36245e5e4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:11:40.443625 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d075940-68f3-49c0-b371-fd36245e5e4f service cinder] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:11:40.447384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928ec51-e40e-4e3a-9319-09dfd4e6f143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:11:40.447994 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928ec51-e40e-4e3a-9319-09dfd4e6f143 service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:11:40.448271 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928ec51-e40e-4e3a-9319-09dfd4e6f143 service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:11:40.448539 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928ec51-e40e-4e3a-9319-09dfd4e6f143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:11:40.450306 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-7928ec51-e40e-4e3a-9319-09dfd4e6f143 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:11:40.512214 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928ec51-e40e-4e3a-9319-09dfd4e6f143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:11:40.513671 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928ec51-e40e-4e3a-9319-09dfd4e6f143 service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:11:40.523103 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1405/2816] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:11:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:11:43.608098 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe69d8-0128-4ece-af06-28b695894546 service cinder] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:11:43.619641 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe69d8-0128-4ece-af06-28b695894546 service cinder] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:11:43.624553 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd7aca-0ce6-43f9-8284-0600fd754bee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5043d835c08458c9f3911a4741bdaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:11:43.625178 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd7aca-0ce6-43f9-8284-0600fd754bee service placement] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:11:43.625456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd7aca-0ce6-43f9-8284-0600fd754bee service placement] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:11:43.625720 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd7aca-0ce6-43f9-8284-0600fd754bee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:11:43.627624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-75dd7aca-0ce6-43f9-8284-0600fd754bee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:11:43.642251 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd7aca-0ce6-43f9-8284-0600fd754bee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:11:43.643827 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd7aca-0ce6-43f9-8284-0600fd754bee service placement] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:11:43.654356 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1412/2817] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:11:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:11:43.687437 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928ec51-e40e-4e3a-9319-09dfd4e6f143 service neutron] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:11:43.688919 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-7928ec51-e40e-4e3a-9319-09dfd4e6f143 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:11:43.701744 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928ec51-e40e-4e3a-9319-09dfd4e6f143 service neutron] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:11:43.706338 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdabf23-fbb0-4726-a2e7-3233d2b86c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:11:43.706962 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdabf23-fbb0-4726-a2e7-3233d2b86c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:11:43.707243 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdabf23-fbb0-4726-a2e7-3233d2b86c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:11:43.707517 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdabf23-fbb0-4726-a2e7-3233d2b86c74 admin admin] PATH_INFO: `/v3/users/1d22386e24cb4c079bfe8a2e9a153034` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:11:43.708677 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdabf23-fbb0-4726-a2e7-3233d2b86c74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d22386e24cb4c079bfe8a2e9a153034)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:11:43.710970 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdabf23-fbb0-4726-a2e7-3233d2b86c74 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:11:43.762176 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-2cdabf23-fbb0-4726-a2e7-3233d2b86c74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d22386e24cb4c079bfe8a2e9a153034'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:11:43.762759 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-2cdabf23-fbb0-4726-a2e7-3233d2b86c74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d22386e24cb4c079bfe8a2e9a153034'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:11:43.763356 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-2cdabf23-fbb0-4726-a2e7-3233d2b86c74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d22386e24cb4c079bfe8a2e9a153034'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:11:43.770199 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-2cdabf23-fbb0-4726-a2e7-3233d2b86c74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d22386e24cb4c079bfe8a2e9a153034'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:11:43.779818 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-2cdabf23-fbb0-4726-a2e7-3233d2b86c74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d22386e24cb4c079bfe8a2e9a153034'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:11:43.798110 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1406/2818] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 18:11:43 2022] DELETE /identity/v3/users/1d22386e24cb4c079bfe8a2e9a153034 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:11:43.976461 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd7aca-0ce6-43f9-8284-0600fd754bee service placement] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:11:43.988751 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd7aca-0ce6-43f9-8284-0600fd754bee service placement] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:11:44.046346 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa01a3f-375a-48fd-9f2a-9ebda74dd675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:11:44.046977 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa01a3f-375a-48fd-9f2a-9ebda74dd675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:11:44.047264 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa01a3f-375a-48fd-9f2a-9ebda74dd675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:11:44.047539 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa01a3f-375a-48fd-9f2a-9ebda74dd675 admin admin] PATH_INFO: `/v3/projects/19d70949231d4af397ba40dc4484e202` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:11:44.048667 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa01a3f-375a-48fd-9f2a-9ebda74dd675 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19d70949231d4af397ba40dc4484e202)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:11:44.050601 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa01a3f-375a-48fd-9f2a-9ebda74dd675 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:11:44.099094 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-9fa01a3f-375a-48fd-9f2a-9ebda74dd675 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19d70949231d4af397ba40dc4484e202', 'request_id': 'req-9fa01a3f-375a-48fd-9f2a-9ebda74dd675'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:11:44.104995 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-9fa01a3f-375a-48fd-9f2a-9ebda74dd675 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19d70949231d4af397ba40dc4484e202', 'request_id': 'req-9fa01a3f-375a-48fd-9f2a-9ebda74dd675'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:11:44.112872 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-9fa01a3f-375a-48fd-9f2a-9ebda74dd675 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19d70949231d4af397ba40dc4484e202', 'request_id': 'req-9fa01a3f-375a-48fd-9f2a-9ebda74dd675'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:11:44.124180 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-9fa01a3f-375a-48fd-9f2a-9ebda74dd675 admin admin] The token cache is being invalidate because project 19d70949231d4af397ba40dc4484e202 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:11:44.124469 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-9fa01a3f-375a-48fd-9f2a-9ebda74dd675 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:11:44.125200 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-9fa01a3f-375a-48fd-9f2a-9ebda74dd675 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:11:44.126699 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1413/2819] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:11:43 2022] DELETE /identity/v3/projects/19d70949231d4af397ba40dc4484e202 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:11:44.132407 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cb78b-4275-485a-b48f-7e6082922115 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:11:44.132407 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cb78b-4275-485a-b48f-7e6082922115 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:11:44.132654 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cb78b-4275-485a-b48f-7e6082922115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:11:44.152313 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-0d3cb78b-4275-485a-b48f-7e6082922115 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:11:44.153541 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-0d3cb78b-4275-485a-b48f-7e6082922115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:11:44.172251 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:11:44.216673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1407/2820] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:11:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:11:44.224772 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988d949-f207-4970-bba6-f9d77db05a11 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:11:44.224996 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988d949-f207-4970-bba6-f9d77db05a11 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:11:44.225333 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988d949-f207-4970-bba6-f9d77db05a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:11:44.244955 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-a988d949-f207-4970-bba6-f9d77db05a11 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:11:44.246312 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-a988d949-f207-4970-bba6-f9d77db05a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:11:44.254417 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1414/2821] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:11:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:11:44.259437 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cb78b-4275-485a-b48f-7e6082922115 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:11:44.268944 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cb78b-4275-485a-b48f-7e6082922115 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:11:44.274379 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f469070-8bf6-49c2-ad96-0445e82a1bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:11:44.274980 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f469070-8bf6-49c2-ad96-0445e82a1bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:11:44.275253 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f469070-8bf6-49c2-ad96-0445e82a1bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:11:44.275518 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f469070-8bf6-49c2-ad96-0445e82a1bd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:11:44.276163 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f469070-8bf6-49c2-ad96-0445e82a1bd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 18:11:44.276459 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f469070-8bf6-49c2-ad96-0445e82a1bd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:11:44.278090 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f469070-8bf6-49c2-ad96-0445e82a1bd5 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:11:44.291527 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1408/2822] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 18:11:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 18:11:44.295664 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988d949-f207-4970-bba6-f9d77db05a11 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:11:44.305290 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988d949-f207-4970-bba6-f9d77db05a11 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:11:44.309976 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241aa20e-ea53-4140-bd9b-23b1b9d8b7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:11:44.310575 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241aa20e-ea53-4140-bd9b-23b1b9d8b7f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:11:44.310852 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241aa20e-ea53-4140-bd9b-23b1b9d8b7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:11:44.311122 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241aa20e-ea53-4140-bd9b-23b1b9d8b7f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:11:44.311890 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241aa20e-ea53-4140-bd9b-23b1b9d8b7f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:11:44.313829 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241aa20e-ea53-4140-bd9b-23b1b9d8b7f6 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:11:44.345618 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1415/2823] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 18:11:44 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:11:44.349998 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f469070-8bf6-49c2-ad96-0445e82a1bd5 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:11:44.360587 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f469070-8bf6-49c2-ad96-0445e82a1bd5 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:11:44.423879 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f4fac-899f-4783-b393-2bfae10ab831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:11:44.424487 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f4fac-899f-4783-b393-2bfae10ab831 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:11:44.424768 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f4fac-899f-4783-b393-2bfae10ab831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:11:44.425081 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f4fac-899f-4783-b393-2bfae10ab831 admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:11:44.425712 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f4fac-899f-4783-b393-2bfae10ab831 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:11:44.428275 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f4fac-899f-4783-b393-2bfae10ab831 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:11:44.450215 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1409/2824] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 18:11:44 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 18:11:44.454581 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241aa20e-ea53-4140-bd9b-23b1b9d8b7f6 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:11:44.466486 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241aa20e-ea53-4140-bd9b-23b1b9d8b7f6 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:11:44.471149 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb89c1-455a-4f83-8192-cf6c0235e2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:11:44.471751 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb89c1-455a-4f83-8192-cf6c0235e2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:11:44.472027 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb89c1-455a-4f83-8192-cf6c0235e2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:11:44.472299 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb89c1-455a-4f83-8192-cf6c0235e2f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:11:44.472935 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb89c1-455a-4f83-8192-cf6c0235e2f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:11:44.474586 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb89c1-455a-4f83-8192-cf6c0235e2f9 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:11:44.484389 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1416/2825] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:11:44.488337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f4fac-899f-4783-b393-2bfae10ab831 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:11:44.498327 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f4fac-899f-4783-b393-2bfae10ab831 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:11:44.503162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab333b2-7dcd-4f21-b433-59298de4d111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:11:44.503795 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab333b2-7dcd-4f21-b433-59298de4d111 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:11:44.504097 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab333b2-7dcd-4f21-b433-59298de4d111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:11:44.504365 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab333b2-7dcd-4f21-b433-59298de4d111 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:11:44.505560 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab333b2-7dcd-4f21-b433-59298de4d111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:11:44.507141 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab333b2-7dcd-4f21-b433-59298de4d111 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:11:44.517798 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1410/2826] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:11:44.522625 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb89c1-455a-4f83-8192-cf6c0235e2f9 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:11:44.532602 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb89c1-455a-4f83-8192-cf6c0235e2f9 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:11:44.537464 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a24759-e994-4130-bfce-7a680c6b51da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:11:44.538116 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a24759-e994-4130-bfce-7a680c6b51da admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:11:44.538396 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a24759-e994-4130-bfce-7a680c6b51da admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:11:44.538671 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a24759-e994-4130-bfce-7a680c6b51da admin admin] PATH_INFO: `/v3/projects/b23c26107d864d228962b8b71aa31ee1/users/cebc059b80e14770a0dfa788c742fb9f/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:11:44.553141 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a24759-e994-4130-bfce-7a680c6b51da admin admin] RBAC: Authorizing `identity:create_grant(project_id=b23c26107d864d228962b8b71aa31ee1, user_id=cebc059b80e14770a0dfa788c742fb9f, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:11:44.555804 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a24759-e994-4130-bfce-7a680c6b51da admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:11:44.568771 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1417/2827] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:11:44 2022] PUT /identity/v3/projects/b23c26107d864d228962b8b71aa31ee1/users/cebc059b80e14770a0dfa788c742fb9f/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 18:11:44.579867 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246bf25-b480-4bcb-a78b-49973f3e31b8 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:11:44.580156 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246bf25-b480-4bcb-a78b-49973f3e31b8 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:11:44.580432 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246bf25-b480-4bcb-a78b-49973f3e31b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:11:44.609873 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-e246bf25-b480-4bcb-a78b-49973f3e31b8 None None] MFA Rules not processed for user `cebc059b80e14770a0dfa788c742fb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:11:44.611070 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-e246bf25-b480-4bcb-a78b-49973f3e31b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:11:44.674567 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1411/2828] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:11:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:11:44.679688 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a24759-e994-4130-bfce-7a680c6b51da admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:11:44.693816 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:11:44.743153 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a24759-e994-4130-bfce-7a680c6b51da admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:11:44.747784 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c92fb-5fcf-42af-8e2f-98f9220ba246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:11:44.748382 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c92fb-5fcf-42af-8e2f-98f9220ba246 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:11:44.748666 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c92fb-5fcf-42af-8e2f-98f9220ba246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:11:44.748938 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c92fb-5fcf-42af-8e2f-98f9220ba246 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:11:44.749597 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c92fb-5fcf-42af-8e2f-98f9220ba246 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:11:44.751491 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c92fb-5fcf-42af-8e2f-98f9220ba246 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:11:44.777538 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1418/2829] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 18:11:44 2022] POST /identity/v3/projects => generated 371 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:11:44.781600 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246bf25-b480-4bcb-a78b-49973f3e31b8 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:11:44.792414 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246bf25-b480-4bcb-a78b-49973f3e31b8 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:11:44.805254 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:11:44.849772 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd72a8-7253-4684-8751-20663d1eb8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:11:44.850671 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd72a8-7253-4684-8751-20663d1eb8ac admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:11:44.850808 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd72a8-7253-4684-8751-20663d1eb8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:11:44.850966 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd72a8-7253-4684-8751-20663d1eb8ac admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:11:44.851611 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dd72a8-7253-4684-8751-20663d1eb8ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:11:44.854063 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dd72a8-7253-4684-8751-20663d1eb8ac admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:11:44.879050 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1412/2830] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 18:11:44 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 18:11:44.880304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c92fb-5fcf-42af-8e2f-98f9220ba246 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:11:44.890721 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c92fb-5fcf-42af-8e2f-98f9220ba246 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:11:44.896028 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6c5bc-3e15-4fc1-ad00-1556ab20fe11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:11:44.896633 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6c5bc-3e15-4fc1-ad00-1556ab20fe11 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:11:44.896912 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6c5bc-3e15-4fc1-ad00-1556ab20fe11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:11:44.897197 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6c5bc-3e15-4fc1-ad00-1556ab20fe11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:11:44.897842 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd6c5bc-3e15-4fc1-ad00-1556ab20fe11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:11:44.899440 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd6c5bc-3e15-4fc1-ad00-1556ab20fe11 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:11:44.910252 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1419/2831] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:11:44.915219 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd72a8-7253-4684-8751-20663d1eb8ac admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:11:44.925114 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd72a8-7253-4684-8751-20663d1eb8ac admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:11:44.929753 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab26b73-b9ff-42ee-8e76-770809e98dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:11:44.930392 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab26b73-b9ff-42ee-8e76-770809e98dac admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:11:44.930670 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab26b73-b9ff-42ee-8e76-770809e98dac admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:11:44.930941 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab26b73-b9ff-42ee-8e76-770809e98dac admin admin] PATH_INFO: `/v3/projects/251f1aa6cbde45c794c673edb792c559/users/1164d77503a44a3d950b22e951fdf9e8/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:11:44.946379 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab26b73-b9ff-42ee-8e76-770809e98dac admin admin] RBAC: Authorizing `identity:create_grant(project_id=251f1aa6cbde45c794c673edb792c559, user_id=1164d77503a44a3d950b22e951fdf9e8, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:11:44.949040 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab26b73-b9ff-42ee-8e76-770809e98dac admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:11:44.963316 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1413/2832] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:11:44 2022] PUT /identity/v3/projects/251f1aa6cbde45c794c673edb792c559/users/1164d77503a44a3d950b22e951fdf9e8/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:11:44.967302 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6c5bc-3e15-4fc1-ad00-1556ab20fe11 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:11:44.977082 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6c5bc-3e15-4fc1-ad00-1556ab20fe11 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:11:45.032272 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baea0fd-0ea3-4c6b-91ce-0bd4cf455208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:11:45.032799 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baea0fd-0ea3-4c6b-91ce-0bd4cf455208 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:11:45.033109 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baea0fd-0ea3-4c6b-91ce-0bd4cf455208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:11:45.033381 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baea0fd-0ea3-4c6b-91ce-0bd4cf455208 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:11:45.034010 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baea0fd-0ea3-4c6b-91ce-0bd4cf455208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:11:45.035598 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baea0fd-0ea3-4c6b-91ce-0bd4cf455208 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:11:45.045941 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1420/2833] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:11:45.050191 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab26b73-b9ff-42ee-8e76-770809e98dac admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:11:45.060283 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab26b73-b9ff-42ee-8e76-770809e98dac admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:11:45.064976 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f598a4-fb1e-4366-91b9-9d0f0381d36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:11:45.065680 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f598a4-fb1e-4366-91b9-9d0f0381d36e admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:11:45.065987 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f598a4-fb1e-4366-91b9-9d0f0381d36e admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:11:45.066258 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f598a4-fb1e-4366-91b9-9d0f0381d36e admin admin] PATH_INFO: `/v3/projects/251f1aa6cbde45c794c673edb792c559/users/1164d77503a44a3d950b22e951fdf9e8/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:11:45.068746 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f598a4-fb1e-4366-91b9-9d0f0381d36e admin admin] RBAC: Authorizing `identity:create_grant(project_id=251f1aa6cbde45c794c673edb792c559, user_id=1164d77503a44a3d950b22e951fdf9e8, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:11:45.071422 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f598a4-fb1e-4366-91b9-9d0f0381d36e admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:11:45.081621 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1414/2834] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:11:45 2022] PUT /identity/v3/projects/251f1aa6cbde45c794c673edb792c559/users/1164d77503a44a3d950b22e951fdf9e8/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:11:45.092771 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291a8de-e887-4e80-b3d0-69c13a502001 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:11:45.093083 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291a8de-e887-4e80-b3d0-69c13a502001 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:11:45.093361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291a8de-e887-4e80-b3d0-69c13a502001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:11:45.120389 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-4291a8de-e887-4e80-b3d0-69c13a502001 None None] MFA Rules not processed for user `1164d77503a44a3d950b22e951fdf9e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:11:45.121717 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-4291a8de-e887-4e80-b3d0-69c13a502001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:11:45.189748 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1421/2835] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:11:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:11:45.201905 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f598a4-fb1e-4366-91b9-9d0f0381d36e admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:11:45.203592 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-69f598a4-fb1e-4366-91b9-9d0f0381d36e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:11:45.260631 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f598a4-fb1e-4366-91b9-9d0f0381d36e admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:11:45.264190 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e767f-b657-48a7-a01d-9095a4606c8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:11:45.264775 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e767f-b657-48a7-a01d-9095a4606c8b service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:11:45.265078 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e767f-b657-48a7-a01d-9095a4606c8b service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:11:45.265347 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e767f-b657-48a7-a01d-9095a4606c8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:11:45.274698 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e767f-b657-48a7-a01d-9095a4606c8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:11:45.276178 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e767f-b657-48a7-a01d-9095a4606c8b service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:11:45.285452 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1415/2836] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:11:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:11:45.361919 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291a8de-e887-4e80-b3d0-69c13a502001 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:11:45.372079 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291a8de-e887-4e80-b3d0-69c13a502001 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:11:45.375697 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd86d66-3bdf-4cf2-b4f4-2f6daf2cd8a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:11:45.376293 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd86d66-3bdf-4cf2-b4f4-2f6daf2cd8a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:11:45.376573 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd86d66-3bdf-4cf2-b4f4-2f6daf2cd8a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:11:45.376847 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd86d66-3bdf-4cf2-b4f4-2f6daf2cd8a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:11:45.382736 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:11:45.435371 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd86d66-3bdf-4cf2-b4f4-2f6daf2cd8a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:11:45.436811 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd86d66-3bdf-4cf2-b4f4-2f6daf2cd8a7 service cinder] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:11:45.446844 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1422/2837] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:11:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:11:55.281289 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=62,keystone:INSERT=5 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:11:55.442261 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=24 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:14.597850 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e767f-b657-48a7-a01d-9095a4606c8b service cinder] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:14.658758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e767f-b657-48a7-a01d-9095a4606c8b service cinder] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:14.663343 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39491086-027f-495f-8939-493ec4bd370c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:14.663956 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39491086-027f-495f-8939-493ec4bd370c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:14.664227 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39491086-027f-495f-8939-493ec4bd370c admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:14.664492 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39491086-027f-495f-8939-493ec4bd370c admin admin] PATH_INFO: `/v3/users/cebc059b80e14770a0dfa788c742fb9f` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:14.665605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39491086-027f-495f-8939-493ec4bd370c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cebc059b80e14770a0dfa788c742fb9f)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:14.667496 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39491086-027f-495f-8939-493ec4bd370c admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:14.714481 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-39491086-027f-495f-8939-493ec4bd370c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cebc059b80e14770a0dfa788c742fb9f'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:14.715127 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-39491086-027f-495f-8939-493ec4bd370c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cebc059b80e14770a0dfa788c742fb9f'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:14.715728 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-39491086-027f-495f-8939-493ec4bd370c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cebc059b80e14770a0dfa788c742fb9f'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:14.722585 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-39491086-027f-495f-8939-493ec4bd370c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cebc059b80e14770a0dfa788c742fb9f'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:14.729944 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-39491086-027f-495f-8939-493ec4bd370c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cebc059b80e14770a0dfa788c742fb9f'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:14.747355 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1416/2838] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 18:12:14 2022] DELETE /identity/v3/users/cebc059b80e14770a0dfa788c742fb9f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:12:14.751859 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b518bab-445e-43e5-aa66-b3e9b609a05c None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:14.752348 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b518bab-445e-43e5-aa66-b3e9b609a05c None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:14.752460 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b518bab-445e-43e5-aa66-b3e9b609a05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:14.773152 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-4b518bab-445e-43e5-aa66-b3e9b609a05c None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:12:14.774355 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-4b518bab-445e-43e5-aa66-b3e9b609a05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:14.837479 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1423/2839] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:12:14.847470 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39491086-027f-495f-8939-493ec4bd370c admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:14.848889 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-39491086-027f-495f-8939-493ec4bd370c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:14.908480 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39491086-027f-495f-8939-493ec4bd370c admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:14.912125 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5eae7-4619-4d1b-980e-a648b4f12816 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:14.912723 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5eae7-4619-4d1b-980e-a648b4f12816 service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:14.912995 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5eae7-4619-4d1b-980e-a648b4f12816 service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:14.913296 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5eae7-4619-4d1b-980e-a648b4f12816 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:14.922551 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5eae7-4619-4d1b-980e-a648b4f12816 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:14.923959 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5eae7-4619-4d1b-980e-a648b4f12816 service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:14.933646 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1417/2840] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:12:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:12:15.205824 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b518bab-445e-43e5-aa66-b3e9b609a05c None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:15.207326 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-4b518bab-445e-43e5-aa66-b3e9b609a05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:15.219620 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b518bab-445e-43e5-aa66-b3e9b609a05c None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:15.224989 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66db3e3-4db0-42ce-85ef-5212a1de4d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:15.225662 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66db3e3-4db0-42ce-85ef-5212a1de4d12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:15.225947 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66db3e3-4db0-42ce-85ef-5212a1de4d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:15.226221 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66db3e3-4db0-42ce-85ef-5212a1de4d12 admin admin] PATH_INFO: `/v3/projects/b23c26107d864d228962b8b71aa31ee1` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:15.227348 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66db3e3-4db0-42ce-85ef-5212a1de4d12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b23c26107d864d228962b8b71aa31ee1)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:15.229446 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66db3e3-4db0-42ce-85ef-5212a1de4d12 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:15.278415 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-a66db3e3-4db0-42ce-85ef-5212a1de4d12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b23c26107d864d228962b8b71aa31ee1', 'request_id': 'req-a66db3e3-4db0-42ce-85ef-5212a1de4d12'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:15.283941 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-a66db3e3-4db0-42ce-85ef-5212a1de4d12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b23c26107d864d228962b8b71aa31ee1', 'request_id': 'req-a66db3e3-4db0-42ce-85ef-5212a1de4d12'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:15.291473 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-a66db3e3-4db0-42ce-85ef-5212a1de4d12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b23c26107d864d228962b8b71aa31ee1', 'request_id': 'req-a66db3e3-4db0-42ce-85ef-5212a1de4d12'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:15.303504 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-a66db3e3-4db0-42ce-85ef-5212a1de4d12 admin admin] The token cache is being invalidate because project b23c26107d864d228962b8b71aa31ee1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:12:15.303792 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-a66db3e3-4db0-42ce-85ef-5212a1de4d12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:15.304428 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-a66db3e3-4db0-42ce-85ef-5212a1de4d12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:15.305949 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1424/2841] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:12:15 2022] DELETE /identity/v3/projects/b23c26107d864d228962b8b71aa31ee1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:12:15.309900 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5eae7-4619-4d1b-980e-a648b4f12816 service neutron] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:15.319354 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5eae7-4619-4d1b-980e-a648b4f12816 service neutron] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:15.338220 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:15.379560 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8303b-994c-4174-8789-a7161fc05ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:15.380190 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8303b-994c-4174-8789-a7161fc05ccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:15.380471 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8303b-994c-4174-8789-a7161fc05ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:15.380741 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8303b-994c-4174-8789-a7161fc05ccb admin admin] PATH_INFO: `/v3/users/1164d77503a44a3d950b22e951fdf9e8` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:15.381981 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8303b-994c-4174-8789-a7161fc05ccb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1164d77503a44a3d950b22e951fdf9e8)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:15.383901 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8303b-994c-4174-8789-a7161fc05ccb admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:15.431346 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-13f8303b-994c-4174-8789-a7161fc05ccb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1164d77503a44a3d950b22e951fdf9e8'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:15.431998 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-13f8303b-994c-4174-8789-a7161fc05ccb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1164d77503a44a3d950b22e951fdf9e8'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:15.432605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-13f8303b-994c-4174-8789-a7161fc05ccb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1164d77503a44a3d950b22e951fdf9e8'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:15.439404 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-13f8303b-994c-4174-8789-a7161fc05ccb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1164d77503a44a3d950b22e951fdf9e8'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:15.446906 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-13f8303b-994c-4174-8789-a7161fc05ccb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1164d77503a44a3d950b22e951fdf9e8'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:15.465714 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1418/2842] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 18:12:15 2022] DELETE /identity/v3/users/1164d77503a44a3d950b22e951fdf9e8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:12:15.738225 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66db3e3-4db0-42ce-85ef-5212a1de4d12 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:15.739685 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-a66db3e3-4db0-42ce-85ef-5212a1de4d12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:15.753458 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66db3e3-4db0-42ce-85ef-5212a1de4d12 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:15.811270 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99a0b9-b9dc-44a6-a7d2-3011d80105d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:15.811905 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99a0b9-b9dc-44a6-a7d2-3011d80105d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:15.812184 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99a0b9-b9dc-44a6-a7d2-3011d80105d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:15.812452 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99a0b9-b9dc-44a6-a7d2-3011d80105d9 admin admin] PATH_INFO: `/v3/projects/251f1aa6cbde45c794c673edb792c559` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:15.813648 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99a0b9-b9dc-44a6-a7d2-3011d80105d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=251f1aa6cbde45c794c673edb792c559)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:15.815583 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99a0b9-b9dc-44a6-a7d2-3011d80105d9 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:15.847267 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:15.866044 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-1c99a0b9-b9dc-44a6-a7d2-3011d80105d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '251f1aa6cbde45c794c673edb792c559', 'request_id': 'req-1c99a0b9-b9dc-44a6-a7d2-3011d80105d9'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:15.871553 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-1c99a0b9-b9dc-44a6-a7d2-3011d80105d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '251f1aa6cbde45c794c673edb792c559', 'request_id': 'req-1c99a0b9-b9dc-44a6-a7d2-3011d80105d9'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:15.878940 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-1c99a0b9-b9dc-44a6-a7d2-3011d80105d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '251f1aa6cbde45c794c673edb792c559', 'request_id': 'req-1c99a0b9-b9dc-44a6-a7d2-3011d80105d9'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:15.889997 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-1c99a0b9-b9dc-44a6-a7d2-3011d80105d9 admin admin] The token cache is being invalidate because project 251f1aa6cbde45c794c673edb792c559 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:12:15.890283 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-1c99a0b9-b9dc-44a6-a7d2-3011d80105d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:15.890911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-1c99a0b9-b9dc-44a6-a7d2-3011d80105d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:15.892407 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1425/2843] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:12:15 2022] DELETE /identity/v3/projects/251f1aa6cbde45c794c673edb792c559 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:12:15.897424 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7b026-f123-405a-9099-2e8b46ea83e4 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:15.897923 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7b026-f123-405a-9099-2e8b46ea83e4 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:15.898032 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7b026-f123-405a-9099-2e8b46ea83e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:15.917713 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-f7b7b026-f123-405a-9099-2e8b46ea83e4 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:12:15.918889 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-f7b7b026-f123-405a-9099-2e8b46ea83e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:15.979567 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1419/2844] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:12:15.988203 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92132eb-c179-4021-bd25-ef31b4b1e1f6 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:15.988545 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92132eb-c179-4021-bd25-ef31b4b1e1f6 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:15.988820 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92132eb-c179-4021-bd25-ef31b4b1e1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:16.008724 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-b92132eb-c179-4021-bd25-ef31b4b1e1f6 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:12:16.009962 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-b92132eb-c179-4021-bd25-ef31b4b1e1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:16.017819 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1426/2845] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:12:16.022128 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7b026-f123-405a-9099-2e8b46ea83e4 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:16.032072 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7b026-f123-405a-9099-2e8b46ea83e4 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:16.037619 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab8036-18b8-46e2-9802-cec51a725154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:16.038220 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab8036-18b8-46e2-9802-cec51a725154 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:16.038494 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab8036-18b8-46e2-9802-cec51a725154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:16.038760 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab8036-18b8-46e2-9802-cec51a725154 admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:16.039429 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab8036-18b8-46e2-9802-cec51a725154 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 18:12:16.039727 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab8036-18b8-46e2-9802-cec51a725154 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:16.041342 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab8036-18b8-46e2-9802-cec51a725154 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:16.053434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1420/2846] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 18:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 18:12:16.057726 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92132eb-c179-4021-bd25-ef31b4b1e1f6 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:16.066964 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92132eb-c179-4021-bd25-ef31b4b1e1f6 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:16.071613 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20306880-d077-448b-a613-3b1ddfd01d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:16.072200 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20306880-d077-448b-a613-3b1ddfd01d04 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:16.072478 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20306880-d077-448b-a613-3b1ddfd01d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:16.072789 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20306880-d077-448b-a613-3b1ddfd01d04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:16.073453 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20306880-d077-448b-a613-3b1ddfd01d04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:16.075326 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20306880-d077-448b-a613-3b1ddfd01d04 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:16.105866 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1427/2847] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 18:12:16 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:12:16.109928 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab8036-18b8-46e2-9802-cec51a725154 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:16.119777 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab8036-18b8-46e2-9802-cec51a725154 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:16.146241 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:16.178113 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c457d-1285-4ad1-be72-0703374a5b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:16.178711 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c457d-1285-4ad1-be72-0703374a5b19 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:16.178988 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c457d-1285-4ad1-be72-0703374a5b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:16.179256 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c457d-1285-4ad1-be72-0703374a5b19 admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:16.179935 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c457d-1285-4ad1-be72-0703374a5b19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:16.181881 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c457d-1285-4ad1-be72-0703374a5b19 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:16.202475 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1421/2848] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 18:12:16 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:12:16.207332 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20306880-d077-448b-a613-3b1ddfd01d04 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:16.218224 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20306880-d077-448b-a613-3b1ddfd01d04 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:16.223532 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c0925-63a4-44fa-8889-c5bcc3a92680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:16.224457 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c0925-63a4-44fa-8889-c5bcc3a92680 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:16.224948 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c0925-63a4-44fa-8889-c5bcc3a92680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:16.225400 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c0925-63a4-44fa-8889-c5bcc3a92680 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:16.226039 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c0925-63a4-44fa-8889-c5bcc3a92680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:16.227615 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c0925-63a4-44fa-8889-c5bcc3a92680 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:16.238005 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1428/2849] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:12:16.242148 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c457d-1285-4ad1-be72-0703374a5b19 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:16.252754 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c457d-1285-4ad1-be72-0703374a5b19 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:16.257404 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbec3f-d49e-41bd-a5e6-38d4750e83c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:16.258021 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbec3f-d49e-41bd-a5e6-38d4750e83c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:16.258305 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbec3f-d49e-41bd-a5e6-38d4750e83c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:16.258580 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbec3f-d49e-41bd-a5e6-38d4750e83c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:16.259218 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbec3f-d49e-41bd-a5e6-38d4750e83c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:16.260858 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbec3f-d49e-41bd-a5e6-38d4750e83c0 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:16.271977 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1422/2850] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:12:16.276392 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c0925-63a4-44fa-8889-c5bcc3a92680 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:16.286818 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c0925-63a4-44fa-8889-c5bcc3a92680 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:16.291383 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d6ff6-ede6-4445-948a-cebe3de90e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:16.292020 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d6ff6-ede6-4445-948a-cebe3de90e77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:16.292297 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d6ff6-ede6-4445-948a-cebe3de90e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:16.292563 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d6ff6-ede6-4445-948a-cebe3de90e77 admin admin] PATH_INFO: `/v3/projects/b957dee021994d5eaca707d05a41d20f/users/48d04743b6c34e16af8e6bd3eb65d186/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:16.307508 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d6ff6-ede6-4445-948a-cebe3de90e77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b957dee021994d5eaca707d05a41d20f, user_id=48d04743b6c34e16af8e6bd3eb65d186, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:16.310194 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d6ff6-ede6-4445-948a-cebe3de90e77 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:16.323568 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1429/2851] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:12:16 2022] PUT /identity/v3/projects/b957dee021994d5eaca707d05a41d20f/users/48d04743b6c34e16af8e6bd3eb65d186/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:12:16.334041 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9bf07-5ad8-4cf2-87b0-c4ee13df9374 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:16.334595 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9bf07-5ad8-4cf2-87b0-c4ee13df9374 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:16.334868 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9bf07-5ad8-4cf2-87b0-c4ee13df9374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:16.361838 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-81b9bf07-5ad8-4cf2-87b0-c4ee13df9374 None None] MFA Rules not processed for user `48d04743b6c34e16af8e6bd3eb65d186`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:12:16.363890 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-81b9bf07-5ad8-4cf2-87b0-c4ee13df9374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:16.428490 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1423/2852] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:12:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:12:16.433192 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d6ff6-ede6-4445-948a-cebe3de90e77 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:16.496467 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d6ff6-ede6-4445-948a-cebe3de90e77 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:16.501148 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce8da4-b5e0-40c9-90ec-671a88e3a3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:16.501755 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce8da4-b5e0-40c9-90ec-671a88e3a3f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:16.502036 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce8da4-b5e0-40c9-90ec-671a88e3a3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:16.502307 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce8da4-b5e0-40c9-90ec-671a88e3a3f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:16.502950 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce8da4-b5e0-40c9-90ec-671a88e3a3f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:16.504880 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce8da4-b5e0-40c9-90ec-671a88e3a3f8 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:16.531386 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1430/2853] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 18:12:16 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:12:16.536206 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9bf07-5ad8-4cf2-87b0-c4ee13df9374 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:16.547073 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9bf07-5ad8-4cf2-87b0-c4ee13df9374 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:16.604024 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874865c-c3d6-4f1e-afc2-f6a20668957b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:16.604542 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874865c-c3d6-4f1e-afc2-f6a20668957b admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:16.604818 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874865c-c3d6-4f1e-afc2-f6a20668957b admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:16.605114 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874865c-c3d6-4f1e-afc2-f6a20668957b admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:16.605729 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874865c-c3d6-4f1e-afc2-f6a20668957b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:16.607617 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874865c-c3d6-4f1e-afc2-f6a20668957b admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:16.628693 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1424/2854] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 18:12:16 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:12:16.632770 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce8da4-b5e0-40c9-90ec-671a88e3a3f8 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:16.643146 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce8da4-b5e0-40c9-90ec-671a88e3a3f8 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:16.647867 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8a20f-3d8e-42de-a317-129216988564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:16.648460 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8a20f-3d8e-42de-a317-129216988564 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:16.648741 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8a20f-3d8e-42de-a317-129216988564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:16.649045 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8a20f-3d8e-42de-a317-129216988564 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:16.649708 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8a20f-3d8e-42de-a317-129216988564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:16.651303 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8a20f-3d8e-42de-a317-129216988564 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:16.662306 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1431/2855] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:12:16.666335 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874865c-c3d6-4f1e-afc2-f6a20668957b admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:16.677417 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874865c-c3d6-4f1e-afc2-f6a20668957b admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:16.682030 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acab8e0-c1c0-4a3d-bada-1d27e5d7d9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:16.682671 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acab8e0-c1c0-4a3d-bada-1d27e5d7d9c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:16.682952 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acab8e0-c1c0-4a3d-bada-1d27e5d7d9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:16.683219 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acab8e0-c1c0-4a3d-bada-1d27e5d7d9c6 admin admin] PATH_INFO: `/v3/projects/0976d83799784f6594ff0322b189c532/users/050a93c5e21d4fb698fba48f2f2c111e/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:16.697689 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acab8e0-c1c0-4a3d-bada-1d27e5d7d9c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0976d83799784f6594ff0322b189c532, user_id=050a93c5e21d4fb698fba48f2f2c111e, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:16.700357 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acab8e0-c1c0-4a3d-bada-1d27e5d7d9c6 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:16.714284 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1425/2856] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:12:16 2022] PUT /identity/v3/projects/0976d83799784f6594ff0322b189c532/users/050a93c5e21d4fb698fba48f2f2c111e/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:12:16.718248 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8a20f-3d8e-42de-a317-129216988564 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:16.728706 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8a20f-3d8e-42de-a317-129216988564 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:16.750206 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:16.786793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d748ac-644f-4d45-8a34-f543e293a5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:16.787460 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d748ac-644f-4d45-8a34-f543e293a5cb admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:16.787649 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d748ac-644f-4d45-8a34-f543e293a5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:16.787914 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d748ac-644f-4d45-8a34-f543e293a5cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:16.788537 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d748ac-644f-4d45-8a34-f543e293a5cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:16.790175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d748ac-644f-4d45-8a34-f543e293a5cb admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:16.800330 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1432/2857] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:12:16.804522 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acab8e0-c1c0-4a3d-bada-1d27e5d7d9c6 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:16.810070 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:16.816698 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acab8e0-c1c0-4a3d-bada-1d27e5d7d9c6 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:16.821716 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0d64f-f2d2-4069-b719-771cb80988b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:16.822388 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0d64f-f2d2-4069-b719-771cb80988b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:16.822660 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0d64f-f2d2-4069-b719-771cb80988b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:16.822924 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0d64f-f2d2-4069-b719-771cb80988b1 admin admin] PATH_INFO: `/v3/projects/0976d83799784f6594ff0322b189c532/users/050a93c5e21d4fb698fba48f2f2c111e/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:16.824829 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd0d64f-f2d2-4069-b719-771cb80988b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0976d83799784f6594ff0322b189c532, user_id=050a93c5e21d4fb698fba48f2f2c111e, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:16.827470 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd0d64f-f2d2-4069-b719-771cb80988b1 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:16.838490 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1426/2858] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:12:16 2022] PUT /identity/v3/projects/0976d83799784f6594ff0322b189c532/users/050a93c5e21d4fb698fba48f2f2c111e/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:12:16.901569 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbda3c-2711-4347-ad0a-c2251ecedc65 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:16.901793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbda3c-2711-4347-ad0a-c2251ecedc65 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:16.902029 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbda3c-2711-4347-ad0a-c2251ecedc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:16.930733 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-d2bbda3c-2711-4347-ad0a-c2251ecedc65 None None] MFA Rules not processed for user `050a93c5e21d4fb698fba48f2f2c111e`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:12:16.931963 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-d2bbda3c-2711-4347-ad0a-c2251ecedc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:16.999455 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1433/2859] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:12:16 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:12:17.010696 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0d64f-f2d2-4069-b719-771cb80988b1 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:17.012503 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-7fd0d64f-f2d2-4069-b719-771cb80988b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:17.069683 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0d64f-f2d2-4069-b719-771cb80988b1 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:17.073337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186fe6e5-cd2d-48a4-8291-05239a3f0add service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:17.073952 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fe6e5-cd2d-48a4-8291-05239a3f0add service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:17.074228 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fe6e5-cd2d-48a4-8291-05239a3f0add service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:17.075009 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fe6e5-cd2d-48a4-8291-05239a3f0add service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:17.084047 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186fe6e5-cd2d-48a4-8291-05239a3f0add service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:17.085767 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186fe6e5-cd2d-48a4-8291-05239a3f0add service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:17.095062 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1427/2860] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:12:17 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:12:17.170522 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbda3c-2711-4347-ad0a-c2251ecedc65 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:17.180230 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbda3c-2711-4347-ad0a-c2251ecedc65 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:17.183894 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95455f-5da2-4121-805e-978f31f206ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:17.184483 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95455f-5da2-4121-805e-978f31f206ec service cinder] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:17.184771 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95455f-5da2-4121-805e-978f31f206ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:17.185069 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95455f-5da2-4121-805e-978f31f206ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:17.240715 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95455f-5da2-4121-805e-978f31f206ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:17.242181 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95455f-5da2-4121-805e-978f31f206ec service cinder] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:17.253256 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1434/2861] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:12:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:12:24.066349 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186fe6e5-cd2d-48a4-8291-05239a3f0add service cinder] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:24.128379 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186fe6e5-cd2d-48a4-8291-05239a3f0add service cinder] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:24.132885 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f84617-c3c6-4b2e-8ec4-dbe755fc7c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:24.133536 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f84617-c3c6-4b2e-8ec4-dbe755fc7c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:24.133820 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f84617-c3c6-4b2e-8ec4-dbe755fc7c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:24.134087 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f84617-c3c6-4b2e-8ec4-dbe755fc7c21 admin admin] PATH_INFO: `/v3/users/48d04743b6c34e16af8e6bd3eb65d186` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:24.135200 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f84617-c3c6-4b2e-8ec4-dbe755fc7c21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48d04743b6c34e16af8e6bd3eb65d186)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:24.137153 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f84617-c3c6-4b2e-8ec4-dbe755fc7c21 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:24.186986 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b9f84617-c3c6-4b2e-8ec4-dbe755fc7c21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48d04743b6c34e16af8e6bd3eb65d186'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:24.187669 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b9f84617-c3c6-4b2e-8ec4-dbe755fc7c21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48d04743b6c34e16af8e6bd3eb65d186'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:24.188291 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b9f84617-c3c6-4b2e-8ec4-dbe755fc7c21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48d04743b6c34e16af8e6bd3eb65d186'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:24.197220 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b9f84617-c3c6-4b2e-8ec4-dbe755fc7c21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48d04743b6c34e16af8e6bd3eb65d186'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:24.204844 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-b9f84617-c3c6-4b2e-8ec4-dbe755fc7c21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48d04743b6c34e16af8e6bd3eb65d186'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:24.222559 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1428/2862] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 18:12:24 2022] DELETE /identity/v3/users/48d04743b6c34e16af8e6bd3eb65d186 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:12:24.227135 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5223285-0c69-488b-b2df-dbe568c905fb None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:24.227657 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5223285-0c69-488b-b2df-dbe568c905fb None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:24.227657 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5223285-0c69-488b-b2df-dbe568c905fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:24.246414 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-e5223285-0c69-488b-b2df-dbe568c905fb None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:12:24.247577 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-e5223285-0c69-488b-b2df-dbe568c905fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:24.287482 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=100 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:24.306974 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1435/2863] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:12:24.317417 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f84617-c3c6-4b2e-8ec4-dbe755fc7c21 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:24.319200 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-b9f84617-c3c6-4b2e-8ec4-dbe755fc7c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:24.332783 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:24.380497 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f84617-c3c6-4b2e-8ec4-dbe755fc7c21 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:24.384384 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e1550-aab8-43f1-9110-73261c53aedd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:24.384990 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e1550-aab8-43f1-9110-73261c53aedd service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:24.385298 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e1550-aab8-43f1-9110-73261c53aedd service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:24.385575 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e1550-aab8-43f1-9110-73261c53aedd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:24.395118 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2e1550-aab8-43f1-9110-73261c53aedd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:24.396555 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2e1550-aab8-43f1-9110-73261c53aedd service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:24.406258 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1429/2864] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:12:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:12:24.674610 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5223285-0c69-488b-b2df-dbe568c905fb None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:24.676427 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-e5223285-0c69-488b-b2df-dbe568c905fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:24.692318 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5223285-0c69-488b-b2df-dbe568c905fb None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:24.698215 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b92b8e-be01-4230-95f0-2c9d44740c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:24.698875 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b92b8e-be01-4230-95f0-2c9d44740c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:24.699114 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b92b8e-be01-4230-95f0-2c9d44740c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:24.699425 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b92b8e-be01-4230-95f0-2c9d44740c08 admin admin] PATH_INFO: `/v3/projects/b957dee021994d5eaca707d05a41d20f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:24.700502 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b92b8e-be01-4230-95f0-2c9d44740c08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b957dee021994d5eaca707d05a41d20f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:24.702452 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b92b8e-be01-4230-95f0-2c9d44740c08 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:24.750184 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-f3b92b8e-be01-4230-95f0-2c9d44740c08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b957dee021994d5eaca707d05a41d20f', 'request_id': 'req-f3b92b8e-be01-4230-95f0-2c9d44740c08'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:24.755801 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-f3b92b8e-be01-4230-95f0-2c9d44740c08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b957dee021994d5eaca707d05a41d20f', 'request_id': 'req-f3b92b8e-be01-4230-95f0-2c9d44740c08'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:24.763135 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-f3b92b8e-be01-4230-95f0-2c9d44740c08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b957dee021994d5eaca707d05a41d20f', 'request_id': 'req-f3b92b8e-be01-4230-95f0-2c9d44740c08'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:24.774751 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-f3b92b8e-be01-4230-95f0-2c9d44740c08 admin admin] The token cache is being invalidate because project b957dee021994d5eaca707d05a41d20f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:12:24.775042 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-f3b92b8e-be01-4230-95f0-2c9d44740c08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:24.775671 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-f3b92b8e-be01-4230-95f0-2c9d44740c08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:24.777175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1436/2865] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:12:24 2022] DELETE /identity/v3/projects/b957dee021994d5eaca707d05a41d20f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:12:24.781239 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e1550-aab8-43f1-9110-73261c53aedd service neutron] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:24.791359 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e1550-aab8-43f1-9110-73261c53aedd service neutron] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:24.848020 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299b162-b43f-45af-b8fe-2377da1c6997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:24.848644 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299b162-b43f-45af-b8fe-2377da1c6997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:24.848913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299b162-b43f-45af-b8fe-2377da1c6997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:24.849215 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299b162-b43f-45af-b8fe-2377da1c6997 admin admin] PATH_INFO: `/v3/users/050a93c5e21d4fb698fba48f2f2c111e` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:24.850326 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2299b162-b43f-45af-b8fe-2377da1c6997 admin admin] RBAC: Authorizing `identity:delete_user(user_id=050a93c5e21d4fb698fba48f2f2c111e)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:24.852230 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2299b162-b43f-45af-b8fe-2377da1c6997 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:24.897154 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-2299b162-b43f-45af-b8fe-2377da1c6997 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '050a93c5e21d4fb698fba48f2f2c111e'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:24.897806 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-2299b162-b43f-45af-b8fe-2377da1c6997 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '050a93c5e21d4fb698fba48f2f2c111e'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:24.898403 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-2299b162-b43f-45af-b8fe-2377da1c6997 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '050a93c5e21d4fb698fba48f2f2c111e'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:24.905210 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-2299b162-b43f-45af-b8fe-2377da1c6997 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '050a93c5e21d4fb698fba48f2f2c111e'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:24.913222 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-2299b162-b43f-45af-b8fe-2377da1c6997 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '050a93c5e21d4fb698fba48f2f2c111e'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:24.931015 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1430/2866] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 18:12:24 2022] DELETE /identity/v3/users/050a93c5e21d4fb698fba48f2f2c111e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:12:25.203924 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b92b8e-be01-4230-95f0-2c9d44740c08 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:25.205978 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-f3b92b8e-be01-4230-95f0-2c9d44740c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:25.220248 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b92b8e-be01-4230-95f0-2c9d44740c08 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:25.277882 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf364870-75a8-4db1-a7fc-e6c16b28e3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:25.278588 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf364870-75a8-4db1-a7fc-e6c16b28e3b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:25.278800 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf364870-75a8-4db1-a7fc-e6c16b28e3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:25.279073 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf364870-75a8-4db1-a7fc-e6c16b28e3b1 admin admin] PATH_INFO: `/v3/projects/0976d83799784f6594ff0322b189c532` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:25.280196 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf364870-75a8-4db1-a7fc-e6c16b28e3b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0976d83799784f6594ff0322b189c532)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:25.282206 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf364870-75a8-4db1-a7fc-e6c16b28e3b1 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:25.329666 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-cf364870-75a8-4db1-a7fc-e6c16b28e3b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0976d83799784f6594ff0322b189c532', 'request_id': 'req-cf364870-75a8-4db1-a7fc-e6c16b28e3b1'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:25.335859 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-cf364870-75a8-4db1-a7fc-e6c16b28e3b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0976d83799784f6594ff0322b189c532', 'request_id': 'req-cf364870-75a8-4db1-a7fc-e6c16b28e3b1'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:25.343217 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-cf364870-75a8-4db1-a7fc-e6c16b28e3b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0976d83799784f6594ff0322b189c532', 'request_id': 'req-cf364870-75a8-4db1-a7fc-e6c16b28e3b1'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:25.350919 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:25.356664 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-cf364870-75a8-4db1-a7fc-e6c16b28e3b1 admin admin] The token cache is being invalidate because project 0976d83799784f6594ff0322b189c532 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:12:25.357231 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-cf364870-75a8-4db1-a7fc-e6c16b28e3b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:25.358010 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-cf364870-75a8-4db1-a7fc-e6c16b28e3b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:25.359981 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1437/2867] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:12:25 2022] DELETE /identity/v3/projects/0976d83799784f6594ff0322b189c532 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:12:25.364880 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241cc55-ab09-4f9b-94c1-77c21ef00d0a None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:25.365402 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241cc55-ab09-4f9b-94c1-77c21ef00d0a None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:25.365520 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241cc55-ab09-4f9b-94c1-77c21ef00d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:25.385674 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-b241cc55-ab09-4f9b-94c1-77c21ef00d0a None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:12:25.386882 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-b241cc55-ab09-4f9b-94c1-77c21ef00d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:25.417972 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:25.450421 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1431/2868] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 18:12:25.458956 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ee79b-1841-476f-aa8e-0d3dbd8f9e7d None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:25.459529 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ee79b-1841-476f-aa8e-0d3dbd8f9e7d None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:25.459836 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ee79b-1841-476f-aa8e-0d3dbd8f9e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:25.480113 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-6c6ee79b-1841-476f-aa8e-0d3dbd8f9e7d None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:12:25.481379 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-6c6ee79b-1841-476f-aa8e-0d3dbd8f9e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:25.489535 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1438/2869] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 18:12:25.493700 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241cc55-ab09-4f9b-94c1-77c21ef00d0a None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:25.503752 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241cc55-ab09-4f9b-94c1-77c21ef00d0a None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:25.508431 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a53c86-d714-4cd6-81ea-34ca842e0d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:25.509031 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a53c86-d714-4cd6-81ea-34ca842e0d46 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:25.509319 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a53c86-d714-4cd6-81ea-34ca842e0d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:25.509591 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a53c86-d714-4cd6-81ea-34ca842e0d46 admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:25.510235 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a53c86-d714-4cd6-81ea-34ca842e0d46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 18:12:25.510535 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a53c86-d714-4cd6-81ea-34ca842e0d46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:25.512118 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a53c86-d714-4cd6-81ea-34ca842e0d46 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:25.524413 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1432/2870] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 18:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 18:12:25.528822 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ee79b-1841-476f-aa8e-0d3dbd8f9e7d None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:25.538814 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ee79b-1841-476f-aa8e-0d3dbd8f9e7d None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:25.543637 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee2779-6820-427d-8666-c15f0b709fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:25.544293 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee2779-6820-427d-8666-c15f0b709fed admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:25.544570 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee2779-6820-427d-8666-c15f0b709fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:25.544838 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee2779-6820-427d-8666-c15f0b709fed admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:25.545569 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee2779-6820-427d-8666-c15f0b709fed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:25.547575 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee2779-6820-427d-8666-c15f0b709fed admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:25.576864 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1439/2871] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 18:12:25 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:12:25.581924 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a53c86-d714-4cd6-81ea-34ca842e0d46 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:25.592046 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a53c86-d714-4cd6-81ea-34ca842e0d46 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:25.648116 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c2f05-c89b-4804-876b-1ae38a8c14d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:25.648713 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c2f05-c89b-4804-876b-1ae38a8c14d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:25.649047 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c2f05-c89b-4804-876b-1ae38a8c14d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:25.649348 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c2f05-c89b-4804-876b-1ae38a8c14d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:25.650033 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c2f05-c89b-4804-876b-1ae38a8c14d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:25.651949 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c2f05-c89b-4804-876b-1ae38a8c14d0 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:25.672663 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1433/2872] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 18:12:25 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:12:25.677150 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee2779-6820-427d-8666-c15f0b709fed admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:25.687534 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee2779-6820-427d-8666-c15f0b709fed admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:25.692692 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b421b3-51ea-42ab-9d5a-307bccdc4d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:25.693321 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b421b3-51ea-42ab-9d5a-307bccdc4d21 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:25.693598 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b421b3-51ea-42ab-9d5a-307bccdc4d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:25.693862 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b421b3-51ea-42ab-9d5a-307bccdc4d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:25.694485 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b421b3-51ea-42ab-9d5a-307bccdc4d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:25.696055 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b421b3-51ea-42ab-9d5a-307bccdc4d21 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:25.706306 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1440/2873] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:12:25.710311 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c2f05-c89b-4804-876b-1ae38a8c14d0 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:25.719984 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c2f05-c89b-4804-876b-1ae38a8c14d0 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:25.724627 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e324e-ab12-418d-9179-cb89ce6d114e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:25.725242 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e324e-ab12-418d-9179-cb89ce6d114e admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:25.725518 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e324e-ab12-418d-9179-cb89ce6d114e admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:25.725785 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e324e-ab12-418d-9179-cb89ce6d114e admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:25.726413 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e324e-ab12-418d-9179-cb89ce6d114e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:25.727984 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e324e-ab12-418d-9179-cb89ce6d114e admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:25.738312 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1434/2874] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 18:12:25.742382 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b421b3-51ea-42ab-9d5a-307bccdc4d21 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:25.751970 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b421b3-51ea-42ab-9d5a-307bccdc4d21 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:25.757577 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af6c4f-d496-42c1-8b16-272520dab3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:25.758213 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af6c4f-d496-42c1-8b16-272520dab3c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:25.758487 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af6c4f-d496-42c1-8b16-272520dab3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:25.758752 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af6c4f-d496-42c1-8b16-272520dab3c8 admin admin] PATH_INFO: `/v3/projects/288f60e5b8de4e52a3b29fe63bd3c039/users/de30b56a6f8849e6b5608d43e00316ee/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:25.773649 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af6c4f-d496-42c1-8b16-272520dab3c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=288f60e5b8de4e52a3b29fe63bd3c039, user_id=de30b56a6f8849e6b5608d43e00316ee, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:25.776269 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af6c4f-d496-42c1-8b16-272520dab3c8 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:25.789444 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1441/2875] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:12:25 2022] PUT /identity/v3/projects/288f60e5b8de4e52a3b29fe63bd3c039/users/de30b56a6f8849e6b5608d43e00316ee/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 18:12:25.800608 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41f25f-7d81-45e4-8657-e7536810d6b6 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:25.800892 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41f25f-7d81-45e4-8657-e7536810d6b6 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:25.801207 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41f25f-7d81-45e4-8657-e7536810d6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:25.828029 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-8e41f25f-7d81-45e4-8657-e7536810d6b6 None None] MFA Rules not processed for user `de30b56a6f8849e6b5608d43e00316ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:12:25.829243 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-8e41f25f-7d81-45e4-8657-e7536810d6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:25.891349 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1435/2876] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:12:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:12:25.895803 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af6c4f-d496-42c1-8b16-272520dab3c8 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:25.957088 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af6c4f-d496-42c1-8b16-272520dab3c8 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:25.962033 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fb2c8-9332-408b-8d06-44e88d8689aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:25.962633 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fb2c8-9332-408b-8d06-44e88d8689aa admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:25.962913 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fb2c8-9332-408b-8d06-44e88d8689aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:25.963182 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fb2c8-9332-408b-8d06-44e88d8689aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:25.963813 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fb2c8-9332-408b-8d06-44e88d8689aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:25.965857 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fb2c8-9332-408b-8d06-44e88d8689aa admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:25.992337 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1442/2877] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 18:12:25 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:12:25.996529 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e41f25f-7d81-45e4-8657-e7536810d6b6 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:26.007629 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e41f25f-7d81-45e4-8657-e7536810d6b6 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:26.032810 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:26.064374 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35fb80e-35c3-4278-b7e7-78c1564f1991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:26.065135 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fb80e-35c3-4278-b7e7-78c1564f1991 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:26.065436 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fb80e-35c3-4278-b7e7-78c1564f1991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:26.065710 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fb80e-35c3-4278-b7e7-78c1564f1991 admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:26.066349 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35fb80e-35c3-4278-b7e7-78c1564f1991 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:26.068288 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35fb80e-35c3-4278-b7e7-78c1564f1991 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:26.090145 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1436/2878] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 18:12:25 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:12:26.094281 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fb2c8-9332-408b-8d06-44e88d8689aa admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:26.104482 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fb2c8-9332-408b-8d06-44e88d8689aa admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:26.109070 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d7122-ecb9-4e53-bec6-006128ffacd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:26.109654 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d7122-ecb9-4e53-bec6-006128ffacd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:26.109930 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d7122-ecb9-4e53-bec6-006128ffacd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:26.110194 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d7122-ecb9-4e53-bec6-006128ffacd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:26.110818 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d7122-ecb9-4e53-bec6-006128ffacd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:26.112895 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d7122-ecb9-4e53-bec6-006128ffacd6 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:26.123371 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1443/2879] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:12:26.128194 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35fb80e-35c3-4278-b7e7-78c1564f1991 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:26.139605 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35fb80e-35c3-4278-b7e7-78c1564f1991 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:26.144747 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f32538-00e5-4842-bbc5-fc33f23a3108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:26.145402 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f32538-00e5-4842-bbc5-fc33f23a3108 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:26.145685 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f32538-00e5-4842-bbc5-fc33f23a3108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:26.145985 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f32538-00e5-4842-bbc5-fc33f23a3108 admin admin] PATH_INFO: `/v3/projects/ebc9e9a244ee4b3e8493b1426e044061/users/a6153e08db034a2e8a0dfd468b2d2773/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:26.160749 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f32538-00e5-4842-bbc5-fc33f23a3108 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebc9e9a244ee4b3e8493b1426e044061, user_id=a6153e08db034a2e8a0dfd468b2d2773, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:26.163525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f32538-00e5-4842-bbc5-fc33f23a3108 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:26.176801 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1437/2880] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:12:26 2022] PUT /identity/v3/projects/ebc9e9a244ee4b3e8493b1426e044061/users/a6153e08db034a2e8a0dfd468b2d2773/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:12:26.180600 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d7122-ecb9-4e53-bec6-006128ffacd6 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:26.190461 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d7122-ecb9-4e53-bec6-006128ffacd6 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:26.245382 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c5d9c-a1d0-48d8-aa26-d90f4732928f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:26.245981 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c5d9c-a1d0-48d8-aa26-d90f4732928f admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:26.246257 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c5d9c-a1d0-48d8-aa26-d90f4732928f admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:26.246533 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c5d9c-a1d0-48d8-aa26-d90f4732928f admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:26.247157 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c5d9c-a1d0-48d8-aa26-d90f4732928f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:26.248886 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c5d9c-a1d0-48d8-aa26-d90f4732928f admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:26.258748 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1444/2881] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:12:26.262967 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f32538-00e5-4842-bbc5-fc33f23a3108 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:26.273286 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f32538-00e5-4842-bbc5-fc33f23a3108 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:26.277881 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7247ea-4e6e-42c7-b63b-2fbbc363622c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:26.278526 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7247ea-4e6e-42c7-b63b-2fbbc363622c admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:26.278810 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7247ea-4e6e-42c7-b63b-2fbbc363622c admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:26.279080 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7247ea-4e6e-42c7-b63b-2fbbc363622c admin admin] PATH_INFO: `/v3/projects/ebc9e9a244ee4b3e8493b1426e044061/users/a6153e08db034a2e8a0dfd468b2d2773/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:26.280986 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7247ea-4e6e-42c7-b63b-2fbbc363622c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebc9e9a244ee4b3e8493b1426e044061, user_id=a6153e08db034a2e8a0dfd468b2d2773, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:26.284155 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7247ea-4e6e-42c7-b63b-2fbbc363622c admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:26.294227 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1438/2882] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:12:26 2022] PUT /identity/v3/projects/ebc9e9a244ee4b3e8493b1426e044061/users/a6153e08db034a2e8a0dfd468b2d2773/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:12:26.305073 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab372e9-515b-4111-a99b-16a45934c624 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:26.305509 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab372e9-515b-4111-a99b-16a45934c624 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:26.305509 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab372e9-515b-4111-a99b-16a45934c624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:26.314191 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:26.335356 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-fab372e9-515b-4111-a99b-16a45934c624 None None] MFA Rules not processed for user `a6153e08db034a2e8a0dfd468b2d2773`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:12:26.336610 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-fab372e9-515b-4111-a99b-16a45934c624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:26.407886 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1445/2883] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:12:26 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:12:26.419344 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7247ea-4e6e-42c7-b63b-2fbbc363622c admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:26.421141 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-7d7247ea-4e6e-42c7-b63b-2fbbc363622c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:26.478656 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7247ea-4e6e-42c7-b63b-2fbbc363622c admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:26.482451 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f39d3-dd80-4ce0-b0c1-e5039c6b62fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:26.482896 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f39d3-dd80-4ce0-b0c1-e5039c6b62fa service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:26.483173 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f39d3-dd80-4ce0-b0c1-e5039c6b62fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:26.483444 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f39d3-dd80-4ce0-b0c1-e5039c6b62fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:26.542977 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1f39d3-dd80-4ce0-b0c1-e5039c6b62fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:26.544406 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1f39d3-dd80-4ce0-b0c1-e5039c6b62fa service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:26.553706 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1439/2884] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:12:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:12:27.905863 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab372e9-515b-4111-a99b-16a45934c624 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:27.907300 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-fab372e9-515b-4111-a99b-16a45934c624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:27.919711 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab372e9-515b-4111-a99b-16a45934c624 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:27.923269 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274b960-0c49-458b-b567-95fb5c2b05f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:27.923864 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274b960-0c49-458b-b567-95fb5c2b05f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:27.924165 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274b960-0c49-458b-b567-95fb5c2b05f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:27.924437 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274b960-0c49-458b-b567-95fb5c2b05f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:27.933293 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274b960-0c49-458b-b567-95fb5c2b05f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:27.934690 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274b960-0c49-458b-b567-95fb5c2b05f9 service cinder] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:27.944461 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1446/2885] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:12:27 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:12:31.711057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f39d3-dd80-4ce0-b0c1-e5039c6b62fa service cinder] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:31.749212 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:31.774381 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f39d3-dd80-4ce0-b0c1-e5039c6b62fa service cinder] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:31.778993 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd25608-6f1f-4462-b3b6-6db7bbc15043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:31.779638 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd25608-6f1f-4462-b3b6-6db7bbc15043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:31.779914 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd25608-6f1f-4462-b3b6-6db7bbc15043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:31.780184 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd25608-6f1f-4462-b3b6-6db7bbc15043 admin admin] PATH_INFO: `/v3/users/de30b56a6f8849e6b5608d43e00316ee` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:31.781325 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd25608-6f1f-4462-b3b6-6db7bbc15043 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de30b56a6f8849e6b5608d43e00316ee)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:31.783365 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd25608-6f1f-4462-b3b6-6db7bbc15043 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:31.829498 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-bdd25608-6f1f-4462-b3b6-6db7bbc15043 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de30b56a6f8849e6b5608d43e00316ee'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:31.830742 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-bdd25608-6f1f-4462-b3b6-6db7bbc15043 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de30b56a6f8849e6b5608d43e00316ee'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:31.831360 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-bdd25608-6f1f-4462-b3b6-6db7bbc15043 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de30b56a6f8849e6b5608d43e00316ee'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:31.838588 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-bdd25608-6f1f-4462-b3b6-6db7bbc15043 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de30b56a6f8849e6b5608d43e00316ee'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:31.846097 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-bdd25608-6f1f-4462-b3b6-6db7bbc15043 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de30b56a6f8849e6b5608d43e00316ee'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:31.864444 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1440/2886] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 18:12:31 2022] DELETE /identity/v3/users/de30b56a6f8849e6b5608d43e00316ee => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:12:31.868945 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e52e7f-6e24-425f-b288-9be8e88c5bd7 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:31.869445 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e52e7f-6e24-425f-b288-9be8e88c5bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:31.869549 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e52e7f-6e24-425f-b288-9be8e88c5bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:31.889276 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-26e52e7f-6e24-425f-b288-9be8e88c5bd7 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:12:31.891090 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-26e52e7f-6e24-425f-b288-9be8e88c5bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:31.949989 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1447/2887] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:12:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:12:31.960165 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd25608-6f1f-4462-b3b6-6db7bbc15043 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:31.961595 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-bdd25608-6f1f-4462-b3b6-6db7bbc15043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:32.018664 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd25608-6f1f-4462-b3b6-6db7bbc15043 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:32.022693 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0038ade-4066-4fdb-a80c-28d6d0f2f2cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:32.023336 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0038ade-4066-4fdb-a80c-28d6d0f2f2cd service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:32.023617 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0038ade-4066-4fdb-a80c-28d6d0f2f2cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:32.023896 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0038ade-4066-4fdb-a80c-28d6d0f2f2cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:32.032992 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0038ade-4066-4fdb-a80c-28d6d0f2f2cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:32.034522 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0038ade-4066-4fdb-a80c-28d6d0f2f2cd service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:32.043875 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1441/2888] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:12:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 18:12:32.313319 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e52e7f-6e24-425f-b288-9be8e88c5bd7 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:32.314838 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-26e52e7f-6e24-425f-b288-9be8e88c5bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:32.327218 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e52e7f-6e24-425f-b288-9be8e88c5bd7 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:32.331922 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5069a07-444e-48f9-9899-1d882d5fa25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:32.332640 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5069a07-444e-48f9-9899-1d882d5fa25e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:32.332921 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5069a07-444e-48f9-9899-1d882d5fa25e admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:32.333223 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5069a07-444e-48f9-9899-1d882d5fa25e admin admin] PATH_INFO: `/v3/projects/288f60e5b8de4e52a3b29fe63bd3c039` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:32.335169 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5069a07-444e-48f9-9899-1d882d5fa25e admin admin] RBAC: Authorizing `identity:delete_project(project_id=288f60e5b8de4e52a3b29fe63bd3c039)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:32.336801 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5069a07-444e-48f9-9899-1d882d5fa25e admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:32.387471 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-d5069a07-444e-48f9-9899-1d882d5fa25e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '288f60e5b8de4e52a3b29fe63bd3c039', 'request_id': 'req-d5069a07-444e-48f9-9899-1d882d5fa25e'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:32.393282 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-d5069a07-444e-48f9-9899-1d882d5fa25e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '288f60e5b8de4e52a3b29fe63bd3c039', 'request_id': 'req-d5069a07-444e-48f9-9899-1d882d5fa25e'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:32.400810 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-d5069a07-444e-48f9-9899-1d882d5fa25e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '288f60e5b8de4e52a3b29fe63bd3c039', 'request_id': 'req-d5069a07-444e-48f9-9899-1d882d5fa25e'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:32.409364 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:32.413982 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-d5069a07-444e-48f9-9899-1d882d5fa25e admin admin] The token cache is being invalidate because project 288f60e5b8de4e52a3b29fe63bd3c039 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:12:32.414473 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-d5069a07-444e-48f9-9899-1d882d5fa25e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:32.415302 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-d5069a07-444e-48f9-9899-1d882d5fa25e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:32.417569 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1448/2889] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:12:32 2022] DELETE /identity/v3/projects/288f60e5b8de4e52a3b29fe63bd3c039 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:12:32.421615 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0038ade-4066-4fdb-a80c-28d6d0f2f2cd service neutron] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:32.431735 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0038ade-4066-4fdb-a80c-28d6d0f2f2cd service neutron] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:32.481495 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:32.488543 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133183b5-3138-40e3-b166-998f51b245e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:32.489965 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133183b5-3138-40e3-b166-998f51b245e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:32.490360 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133183b5-3138-40e3-b166-998f51b245e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:32.490637 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133183b5-3138-40e3-b166-998f51b245e0 admin admin] PATH_INFO: `/v3/users/a6153e08db034a2e8a0dfd468b2d2773` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:32.492045 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133183b5-3138-40e3-b166-998f51b245e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6153e08db034a2e8a0dfd468b2d2773)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:32.494325 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133183b5-3138-40e3-b166-998f51b245e0 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:32.540520 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-133183b5-3138-40e3-b166-998f51b245e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6153e08db034a2e8a0dfd468b2d2773'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:32.541194 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-133183b5-3138-40e3-b166-998f51b245e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6153e08db034a2e8a0dfd468b2d2773'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:32.541807 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-133183b5-3138-40e3-b166-998f51b245e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6153e08db034a2e8a0dfd468b2d2773'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:32.548554 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-133183b5-3138-40e3-b166-998f51b245e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6153e08db034a2e8a0dfd468b2d2773'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:32.557318 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-133183b5-3138-40e3-b166-998f51b245e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6153e08db034a2e8a0dfd468b2d2773'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:32.574508 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1442/2890] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 18:12:32 2022] DELETE /identity/v3/users/a6153e08db034a2e8a0dfd468b2d2773 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:12:32.849359 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5069a07-444e-48f9-9899-1d882d5fa25e admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:32.850918 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-d5069a07-444e-48f9-9899-1d882d5fa25e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:32.866780 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5069a07-444e-48f9-9899-1d882d5fa25e admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:32.925932 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00435e12-e7d9-4bf9-a2c6-9abdabc5db41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:32.926749 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00435e12-e7d9-4bf9-a2c6-9abdabc5db41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:32.926867 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00435e12-e7d9-4bf9-a2c6-9abdabc5db41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:32.927087 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00435e12-e7d9-4bf9-a2c6-9abdabc5db41 admin admin] PATH_INFO: `/v3/projects/ebc9e9a244ee4b3e8493b1426e044061` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:32.928188 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00435e12-e7d9-4bf9-a2c6-9abdabc5db41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebc9e9a244ee4b3e8493b1426e044061)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:32.930114 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00435e12-e7d9-4bf9-a2c6-9abdabc5db41 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:32.979046 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-00435e12-e7d9-4bf9-a2c6-9abdabc5db41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebc9e9a244ee4b3e8493b1426e044061', 'request_id': 'req-00435e12-e7d9-4bf9-a2c6-9abdabc5db41'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:32.984556 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-00435e12-e7d9-4bf9-a2c6-9abdabc5db41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebc9e9a244ee4b3e8493b1426e044061', 'request_id': 'req-00435e12-e7d9-4bf9-a2c6-9abdabc5db41'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:32.992166 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-00435e12-e7d9-4bf9-a2c6-9abdabc5db41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebc9e9a244ee4b3e8493b1426e044061', 'request_id': 'req-00435e12-e7d9-4bf9-a2c6-9abdabc5db41'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:33.003881 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-00435e12-e7d9-4bf9-a2c6-9abdabc5db41 admin admin] The token cache is being invalidate because project ebc9e9a244ee4b3e8493b1426e044061 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:12:33.004162 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-00435e12-e7d9-4bf9-a2c6-9abdabc5db41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:33.004793 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-00435e12-e7d9-4bf9-a2c6-9abdabc5db41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:33.006288 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1449/2891] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:12:32 2022] DELETE /identity/v3/projects/ebc9e9a244ee4b3e8493b1426e044061 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:12:33.011248 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f286e-8851-4031-b40d-e36ef9cfdd5a None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:33.011747 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f286e-8851-4031-b40d-e36ef9cfdd5a None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:33.011903 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f286e-8851-4031-b40d-e36ef9cfdd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:33.032405 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-3e7f286e-8851-4031-b40d-e36ef9cfdd5a None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:12:33.033574 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-3e7f286e-8851-4031-b40d-e36ef9cfdd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:33.092803 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1443/2892] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:12:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:12:33.100617 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88582b4f-11c4-4efe-b60c-0e6f96d3b96d None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:33.100933 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88582b4f-11c4-4efe-b60c-0e6f96d3b96d None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:33.101243 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88582b4f-11c4-4efe-b60c-0e6f96d3b96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:33.120826 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-88582b4f-11c4-4efe-b60c-0e6f96d3b96d None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:12:33.122123 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-88582b4f-11c4-4efe-b60c-0e6f96d3b96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:33.130716 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1450/2893] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:12:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:12:33.134913 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f286e-8851-4031-b40d-e36ef9cfdd5a None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:33.145468 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f286e-8851-4031-b40d-e36ef9cfdd5a None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:33.150162 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869ef81-2534-479d-8161-0cb284612b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:33.150770 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869ef81-2534-479d-8161-0cb284612b8f admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:33.151023 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869ef81-2534-479d-8161-0cb284612b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:33.151288 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869ef81-2534-479d-8161-0cb284612b8f admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:33.151924 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869ef81-2534-479d-8161-0cb284612b8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 18:12:33.152223 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869ef81-2534-479d-8161-0cb284612b8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:33.153952 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869ef81-2534-479d-8161-0cb284612b8f admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:33.165434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1444/2894] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 18:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 18:12:33.169845 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88582b4f-11c4-4efe-b60c-0e6f96d3b96d None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:33.179213 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88582b4f-11c4-4efe-b60c-0e6f96d3b96d None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:33.184044 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873c1f1-7f3d-448f-bb13-411acec771b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:33.184633 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873c1f1-7f3d-448f-bb13-411acec771b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:33.184934 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873c1f1-7f3d-448f-bb13-411acec771b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:33.185253 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873c1f1-7f3d-448f-bb13-411acec771b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:33.185899 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873c1f1-7f3d-448f-bb13-411acec771b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:33.187852 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873c1f1-7f3d-448f-bb13-411acec771b9 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:33.216493 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1451/2895] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 18:12:33 2022] POST /identity/v3/projects => generated 393 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:12:33.220687 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869ef81-2534-479d-8161-0cb284612b8f admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:33.230357 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869ef81-2534-479d-8161-0cb284612b8f admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:33.287311 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f1ab1-d375-4bd3-a2ea-9c6a202a5d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:33.287885 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f1ab1-d375-4bd3-a2ea-9c6a202a5d85 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:33.288163 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f1ab1-d375-4bd3-a2ea-9c6a202a5d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:33.288434 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f1ab1-d375-4bd3-a2ea-9c6a202a5d85 admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:33.289104 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f1ab1-d375-4bd3-a2ea-9c6a202a5d85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:33.291133 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f1ab1-d375-4bd3-a2ea-9c6a202a5d85 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:33.301629 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:33.314177 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1445/2896] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 18:12:33 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:12:33.318894 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873c1f1-7f3d-448f-bb13-411acec771b9 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:33.329158 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873c1f1-7f3d-448f-bb13-411acec771b9 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:33.334676 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485ecee-506d-4c37-9488-0eda4a23ab54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:33.335267 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485ecee-506d-4c37-9488-0eda4a23ab54 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:33.335542 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485ecee-506d-4c37-9488-0eda4a23ab54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:33.335813 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485ecee-506d-4c37-9488-0eda4a23ab54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:33.336447 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3485ecee-506d-4c37-9488-0eda4a23ab54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:33.338058 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3485ecee-506d-4c37-9488-0eda4a23ab54 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:33.347749 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1452/2897] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:12:33.352681 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f1ab1-d375-4bd3-a2ea-9c6a202a5d85 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:33.363232 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f1ab1-d375-4bd3-a2ea-9c6a202a5d85 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:33.367798 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3413d-8cda-407f-a37e-069e0055e996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:33.368381 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3413d-8cda-407f-a37e-069e0055e996 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:33.368658 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3413d-8cda-407f-a37e-069e0055e996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:33.368927 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3413d-8cda-407f-a37e-069e0055e996 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:33.369595 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3413d-8cda-407f-a37e-069e0055e996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:33.371175 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3413d-8cda-407f-a37e-069e0055e996 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:33.382579 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1446/2898] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:12:33.386634 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485ecee-506d-4c37-9488-0eda4a23ab54 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:33.397062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485ecee-506d-4c37-9488-0eda4a23ab54 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:33.401664 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2028deb-35d9-49fc-9286-0ff976eb8b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:33.402313 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2028deb-35d9-49fc-9286-0ff976eb8b7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:33.402599 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2028deb-35d9-49fc-9286-0ff976eb8b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:33.402872 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2028deb-35d9-49fc-9286-0ff976eb8b7a admin admin] PATH_INFO: `/v3/projects/f85596abe5bf43afbb9be722a49cf0d0/users/ce6f357943684d07bad1f684c18c6ffa/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:33.417961 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2028deb-35d9-49fc-9286-0ff976eb8b7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f85596abe5bf43afbb9be722a49cf0d0, user_id=ce6f357943684d07bad1f684c18c6ffa, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:33.420617 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2028deb-35d9-49fc-9286-0ff976eb8b7a admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:33.432976 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1453/2899] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:12:33 2022] PUT /identity/v3/projects/f85596abe5bf43afbb9be722a49cf0d0/users/ce6f357943684d07bad1f684c18c6ffa/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:12:33.444588 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc602c-60d0-44a1-9b05-4691c8dd3578 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:33.444865 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc602c-60d0-44a1-9b05-4691c8dd3578 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:33.445165 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc602c-60d0-44a1-9b05-4691c8dd3578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:33.473586 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-5ffc602c-60d0-44a1-9b05-4691c8dd3578 None None] MFA Rules not processed for user `ce6f357943684d07bad1f684c18c6ffa`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:12:33.474793 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-5ffc602c-60d0-44a1-9b05-4691c8dd3578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:33.540199 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1447/2900] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:12:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:12:33.544616 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2028deb-35d9-49fc-9286-0ff976eb8b7a admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:33.573353 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:33.606618 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2028deb-35d9-49fc-9286-0ff976eb8b7a admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:33.611258 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b010e4f-d0dc-416f-9513-e13149f74759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:33.611858 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b010e4f-d0dc-416f-9513-e13149f74759 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:33.612156 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b010e4f-d0dc-416f-9513-e13149f74759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:33.612424 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b010e4f-d0dc-416f-9513-e13149f74759 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:33.613066 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b010e4f-d0dc-416f-9513-e13149f74759 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:33.614941 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b010e4f-d0dc-416f-9513-e13149f74759 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:33.640218 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1454/2901] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 18:12:33 2022] POST /identity/v3/projects => generated 391 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:12:33.644888 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc602c-60d0-44a1-9b05-4691c8dd3578 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:33.656057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc602c-60d0-44a1-9b05-4691c8dd3578 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:33.714318 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def904ac-3be1-4642-8f63-135a0a51a1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:33.714950 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def904ac-3be1-4642-8f63-135a0a51a1db admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:33.715230 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def904ac-3be1-4642-8f63-135a0a51a1db admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:33.715503 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def904ac-3be1-4642-8f63-135a0a51a1db admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:33.716137 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def904ac-3be1-4642-8f63-135a0a51a1db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:33.718065 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def904ac-3be1-4642-8f63-135a0a51a1db admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:33.738717 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1448/2902] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 18:12:33 2022] POST /identity/v3/users => generated 302 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:12:33.742796 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b010e4f-d0dc-416f-9513-e13149f74759 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:33.753887 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b010e4f-d0dc-416f-9513-e13149f74759 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:33.758639 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf4c01-ca8c-496e-874c-04c9304ee8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:33.760661 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf4c01-ca8c-496e-874c-04c9304ee8a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:33.761002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf4c01-ca8c-496e-874c-04c9304ee8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:33.761305 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf4c01-ca8c-496e-874c-04c9304ee8a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:33.761951 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf4c01-ca8c-496e-874c-04c9304ee8a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:33.763583 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf4c01-ca8c-496e-874c-04c9304ee8a0 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:33.774953 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1455/2903] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:12:33.779265 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def904ac-3be1-4642-8f63-135a0a51a1db admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:33.790141 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def904ac-3be1-4642-8f63-135a0a51a1db admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:33.795001 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3063d1a-5c6d-41b8-9bbb-0a7ff0d92a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:33.795582 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3063d1a-5c6d-41b8-9bbb-0a7ff0d92a79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:33.795863 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3063d1a-5c6d-41b8-9bbb-0a7ff0d92a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:33.796167 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3063d1a-5c6d-41b8-9bbb-0a7ff0d92a79 admin admin] PATH_INFO: `/v3/projects/a6c936ad1b244ac495f553b1768e29c1/users/392acb15562445b6810c6765b757a51d/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:33.811545 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3063d1a-5c6d-41b8-9bbb-0a7ff0d92a79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6c936ad1b244ac495f553b1768e29c1, user_id=392acb15562445b6810c6765b757a51d, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:33.814234 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3063d1a-5c6d-41b8-9bbb-0a7ff0d92a79 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:33.827436 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1449/2904] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:12:33 2022] PUT /identity/v3/projects/a6c936ad1b244ac495f553b1768e29c1/users/392acb15562445b6810c6765b757a51d/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:12:33.831471 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf4c01-ca8c-496e-874c-04c9304ee8a0 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:33.841934 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf4c01-ca8c-496e-874c-04c9304ee8a0 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:33.898689 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6fe9c-801e-4594-adad-3a269892d93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:33.899297 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6fe9c-801e-4594-adad-3a269892d93d admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:33.899595 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6fe9c-801e-4594-adad-3a269892d93d admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:33.899847 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6fe9c-801e-4594-adad-3a269892d93d admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:33.900482 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a6fe9c-801e-4594-adad-3a269892d93d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:33.902104 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a6fe9c-801e-4594-adad-3a269892d93d admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:33.912661 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1456/2905] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 18:12:33.916901 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3063d1a-5c6d-41b8-9bbb-0a7ff0d92a79 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:33.927468 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3063d1a-5c6d-41b8-9bbb-0a7ff0d92a79 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:33.932039 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d6b2f-b539-49d7-8ad2-67f10cc0a221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:33.932668 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d6b2f-b539-49d7-8ad2-67f10cc0a221 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:33.932940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d6b2f-b539-49d7-8ad2-67f10cc0a221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:33.933236 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d6b2f-b539-49d7-8ad2-67f10cc0a221 admin admin] PATH_INFO: `/v3/projects/a6c936ad1b244ac495f553b1768e29c1/users/392acb15562445b6810c6765b757a51d/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:33.935125 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5d6b2f-b539-49d7-8ad2-67f10cc0a221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6c936ad1b244ac495f553b1768e29c1, user_id=392acb15562445b6810c6765b757a51d, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:33.937793 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5d6b2f-b539-49d7-8ad2-67f10cc0a221 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:33.948099 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1450/2906] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:12:33 2022] PUT /identity/v3/projects/a6c936ad1b244ac495f553b1768e29c1/users/392acb15562445b6810c6765b757a51d/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:12:33.958195 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a176764-462f-497b-978c-63d935ac6eab None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:33.958747 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a176764-462f-497b-978c-63d935ac6eab None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:33.958747 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a176764-462f-497b-978c-63d935ac6eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:33.987283 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-3a176764-462f-497b-978c-63d935ac6eab None None] MFA Rules not processed for user `392acb15562445b6810c6765b757a51d`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:12:33.988520 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-3a176764-462f-497b-978c-63d935ac6eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:34.057075 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1457/2907] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:12:33 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:12:34.068253 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d6b2f-b539-49d7-8ad2-67f10cc0a221 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:34.070063 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-2a5d6b2f-b539-49d7-8ad2-67f10cc0a221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:34.098262 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:34.130574 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d6b2f-b539-49d7-8ad2-67f10cc0a221 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:34.134185 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aef56b-3f88-4a77-9519-c2bd368bf5c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:34.134801 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aef56b-3f88-4a77-9519-c2bd368bf5c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:34.135073 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aef56b-3f88-4a77-9519-c2bd368bf5c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:34.135339 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aef56b-3f88-4a77-9519-c2bd368bf5c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:34.144322 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aef56b-3f88-4a77-9519-c2bd368bf5c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:34.145880 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aef56b-3f88-4a77-9519-c2bd368bf5c5 service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:34.155237 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1451/2908] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:12:34 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:12:34.202010 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a176764-462f-497b-978c-63d935ac6eab None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:34.203410 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-3a176764-462f-497b-978c-63d935ac6eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:34.216045 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a176764-462f-497b-978c-63d935ac6eab None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:34.219680 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89829f-f22d-4c14-938a-4b3e056bae82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:34.220275 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89829f-f22d-4c14-938a-4b3e056bae82 service cinder] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:34.221215 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89829f-f22d-4c14-938a-4b3e056bae82 service cinder] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:34.221509 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89829f-f22d-4c14-938a-4b3e056bae82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:34.240802 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:34.281246 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89829f-f22d-4c14-938a-4b3e056bae82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:34.282689 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89829f-f22d-4c14-938a-4b3e056bae82 service cinder] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:34.291592 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1458/2909] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:12:34 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:12:37.569251 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aef56b-3f88-4a77-9519-c2bd368bf5c5 service cinder] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:37.632051 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aef56b-3f88-4a77-9519-c2bd368bf5c5 service cinder] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:37.636508 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f5e91-4e4f-43a8-be72-1010306a500f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:37.637183 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f5e91-4e4f-43a8-be72-1010306a500f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:37.637463 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f5e91-4e4f-43a8-be72-1010306a500f admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:37.637734 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f5e91-4e4f-43a8-be72-1010306a500f admin admin] PATH_INFO: `/v3/users/ce6f357943684d07bad1f684c18c6ffa` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:37.638849 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f5e91-4e4f-43a8-be72-1010306a500f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce6f357943684d07bad1f684c18c6ffa)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:37.640758 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f5e91-4e4f-43a8-be72-1010306a500f admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:37.684289 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-5c1f5e91-4e4f-43a8-be72-1010306a500f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce6f357943684d07bad1f684c18c6ffa'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:37.684960 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-5c1f5e91-4e4f-43a8-be72-1010306a500f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce6f357943684d07bad1f684c18c6ffa'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:37.685594 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-5c1f5e91-4e4f-43a8-be72-1010306a500f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce6f357943684d07bad1f684c18c6ffa'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:37.693321 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-5c1f5e91-4e4f-43a8-be72-1010306a500f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce6f357943684d07bad1f684c18c6ffa'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:37.700340 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-5c1f5e91-4e4f-43a8-be72-1010306a500f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce6f357943684d07bad1f684c18c6ffa'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:37.718188 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1452/2910] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 18:12:37 2022] DELETE /identity/v3/users/ce6f357943684d07bad1f684c18c6ffa => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:12:37.722707 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd4dba-41c5-48a8-a96b-5054378a08e1 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:37.723174 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd4dba-41c5-48a8-a96b-5054378a08e1 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:37.723277 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd4dba-41c5-48a8-a96b-5054378a08e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:37.742017 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-55bd4dba-41c5-48a8-a96b-5054378a08e1 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:12:37.743210 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-55bd4dba-41c5-48a8-a96b-5054378a08e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:37.810160 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1459/2911] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:12:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:12:37.821150 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f5e91-4e4f-43a8-be72-1010306a500f admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:37.822529 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-5c1f5e91-4e4f-43a8-be72-1010306a500f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:37.875832 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:37.882629 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f5e91-4e4f-43a8-be72-1010306a500f admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:37.887552 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c187b15-2520-4d02-9f49-618333f944db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:37.888136 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c187b15-2520-4d02-9f49-618333f944db service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:37.888413 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c187b15-2520-4d02-9f49-618333f944db service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:37.888680 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c187b15-2520-4d02-9f49-618333f944db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:37.897775 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c187b15-2520-4d02-9f49-618333f944db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:37.899207 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c187b15-2520-4d02-9f49-618333f944db service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:37.908796 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1453/2912] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:12:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:12:38.195239 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd4dba-41c5-48a8-a96b-5054378a08e1 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:38.196709 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-55bd4dba-41c5-48a8-a96b-5054378a08e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:38.209072 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd4dba-41c5-48a8-a96b-5054378a08e1 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:38.214894 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd725a7-d513-48bc-9310-c63b734768ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:38.215978 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd725a7-d513-48bc-9310-c63b734768ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:38.216450 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd725a7-d513-48bc-9310-c63b734768ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:38.216918 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd725a7-d513-48bc-9310-c63b734768ef admin admin] PATH_INFO: `/v3/projects/f85596abe5bf43afbb9be722a49cf0d0` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:38.219734 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd725a7-d513-48bc-9310-c63b734768ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=f85596abe5bf43afbb9be722a49cf0d0)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:38.223287 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd725a7-d513-48bc-9310-c63b734768ef admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:38.275089 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-1dd725a7-d513-48bc-9310-c63b734768ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f85596abe5bf43afbb9be722a49cf0d0', 'request_id': 'req-1dd725a7-d513-48bc-9310-c63b734768ef'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:38.280622 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-1dd725a7-d513-48bc-9310-c63b734768ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f85596abe5bf43afbb9be722a49cf0d0', 'request_id': 'req-1dd725a7-d513-48bc-9310-c63b734768ef'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:38.288998 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-1dd725a7-d513-48bc-9310-c63b734768ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f85596abe5bf43afbb9be722a49cf0d0', 'request_id': 'req-1dd725a7-d513-48bc-9310-c63b734768ef'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:38.302085 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-1dd725a7-d513-48bc-9310-c63b734768ef admin admin] The token cache is being invalidate because project f85596abe5bf43afbb9be722a49cf0d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:12:38.302370 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-1dd725a7-d513-48bc-9310-c63b734768ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:38.302991 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-1dd725a7-d513-48bc-9310-c63b734768ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:38.304453 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1460/2913] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:12:38 2022] DELETE /identity/v3/projects/f85596abe5bf43afbb9be722a49cf0d0 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 18:12:38.308702 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c187b15-2520-4d02-9f49-618333f944db service neutron] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:38.319050 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c187b15-2520-4d02-9f49-618333f944db service neutron] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:38.375124 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790666cc-d763-4780-be76-39bdee3d1694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:38.375750 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790666cc-d763-4780-be76-39bdee3d1694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:38.376048 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790666cc-d763-4780-be76-39bdee3d1694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:38.376308 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790666cc-d763-4780-be76-39bdee3d1694 admin admin] PATH_INFO: `/v3/users/392acb15562445b6810c6765b757a51d` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:38.377593 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790666cc-d763-4780-be76-39bdee3d1694 admin admin] RBAC: Authorizing `identity:delete_user(user_id=392acb15562445b6810c6765b757a51d)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:38.379545 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790666cc-d763-4780-be76-39bdee3d1694 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:38.429295 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-790666cc-d763-4780-be76-39bdee3d1694 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '392acb15562445b6810c6765b757a51d'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:38.429938 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-790666cc-d763-4780-be76-39bdee3d1694 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '392acb15562445b6810c6765b757a51d'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:38.430537 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-790666cc-d763-4780-be76-39bdee3d1694 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '392acb15562445b6810c6765b757a51d'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:38.437522 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-790666cc-d763-4780-be76-39bdee3d1694 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '392acb15562445b6810c6765b757a51d'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:38.444688 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-790666cc-d763-4780-be76-39bdee3d1694 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '392acb15562445b6810c6765b757a51d'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:38.462251 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1454/2914] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 18:12:38 2022] DELETE /identity/v3/users/392acb15562445b6810c6765b757a51d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:12:38.738601 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd725a7-d513-48bc-9310-c63b734768ef admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:38.740057 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-1dd725a7-d513-48bc-9310-c63b734768ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:38.753147 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd725a7-d513-48bc-9310-c63b734768ef admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:38.798744 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:38.814745 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc23e8c-f379-4321-8e1f-6333a2797740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:38.815368 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc23e8c-f379-4321-8e1f-6333a2797740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:38.815645 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc23e8c-f379-4321-8e1f-6333a2797740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:38.815911 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc23e8c-f379-4321-8e1f-6333a2797740 admin admin] PATH_INFO: `/v3/projects/a6c936ad1b244ac495f553b1768e29c1` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:38.817036 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc23e8c-f379-4321-8e1f-6333a2797740 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6c936ad1b244ac495f553b1768e29c1)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:38.818929 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc23e8c-f379-4321-8e1f-6333a2797740 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:38.864860 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-ccc23e8c-f379-4321-8e1f-6333a2797740 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6c936ad1b244ac495f553b1768e29c1', 'request_id': 'req-ccc23e8c-f379-4321-8e1f-6333a2797740'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:38.870324 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-ccc23e8c-f379-4321-8e1f-6333a2797740 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6c936ad1b244ac495f553b1768e29c1', 'request_id': 'req-ccc23e8c-f379-4321-8e1f-6333a2797740'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:38.877507 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-ccc23e8c-f379-4321-8e1f-6333a2797740 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6c936ad1b244ac495f553b1768e29c1', 'request_id': 'req-ccc23e8c-f379-4321-8e1f-6333a2797740'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:38.888625 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-ccc23e8c-f379-4321-8e1f-6333a2797740 admin admin] The token cache is being invalidate because project a6c936ad1b244ac495f553b1768e29c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:12:38.888915 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-ccc23e8c-f379-4321-8e1f-6333a2797740 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:38.889604 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-ccc23e8c-f379-4321-8e1f-6333a2797740 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:38.891125 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1461/2915] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:12:38 2022] DELETE /identity/v3/projects/a6c936ad1b244ac495f553b1768e29c1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:12:38.896707 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9225d-c028-4af4-a10b-9ceba586478d None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:38.897241 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9225d-c028-4af4-a10b-9ceba586478d None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:38.897360 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9225d-c028-4af4-a10b-9ceba586478d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:38.916901 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-10e9225d-c028-4af4-a10b-9ceba586478d None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:12:38.918110 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-10e9225d-c028-4af4-a10b-9ceba586478d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:38.977552 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1455/2916] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:12:38.985286 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428639e-0dc7-452a-b6af-32b5ff1de59f None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:38.985569 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428639e-0dc7-452a-b6af-32b5ff1de59f None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:38.985840 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428639e-0dc7-452a-b6af-32b5ff1de59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:39.006428 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-4428639e-0dc7-452a-b6af-32b5ff1de59f None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:12:39.007630 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-4428639e-0dc7-452a-b6af-32b5ff1de59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:39.015615 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1462/2917] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:12:39.020024 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9225d-c028-4af4-a10b-9ceba586478d None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:39.029467 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9225d-c028-4af4-a10b-9ceba586478d None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:39.034460 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72e533-8e31-49b2-a833-e76f876fa5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:39.035052 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72e533-8e31-49b2-a833-e76f876fa5db admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:39.035328 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72e533-8e31-49b2-a833-e76f876fa5db admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:39.035664 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72e533-8e31-49b2-a833-e76f876fa5db admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:39.036363 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed72e533-8e31-49b2-a833-e76f876fa5db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 18:12:39.036672 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed72e533-8e31-49b2-a833-e76f876fa5db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:39.038286 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed72e533-8e31-49b2-a833-e76f876fa5db admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:39.040630 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:39.051565 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1456/2918] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 18:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 18:12:39.055984 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428639e-0dc7-452a-b6af-32b5ff1de59f None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:39.065581 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428639e-0dc7-452a-b6af-32b5ff1de59f None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:39.070488 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ded0c-f663-40fb-bb7e-442d8c771d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:39.071084 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ded0c-f663-40fb-bb7e-442d8c771d30 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:39.071356 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ded0c-f663-40fb-bb7e-442d8c771d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:39.071620 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ded0c-f663-40fb-bb7e-442d8c771d30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:39.072263 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ded0c-f663-40fb-bb7e-442d8c771d30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:39.074192 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ded0c-f663-40fb-bb7e-442d8c771d30 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:39.101212 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1463/2919] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 18:12:39 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 18:12:39.105499 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72e533-8e31-49b2-a833-e76f876fa5db admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:39.115347 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72e533-8e31-49b2-a833-e76f876fa5db admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:39.172999 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806699b-3cfc-4d52-81a0-ad6feeafb9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:39.174370 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806699b-3cfc-4d52-81a0-ad6feeafb9a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:39.174630 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806699b-3cfc-4d52-81a0-ad6feeafb9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:39.174885 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806699b-3cfc-4d52-81a0-ad6feeafb9a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:39.175553 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8806699b-3cfc-4d52-81a0-ad6feeafb9a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:39.177467 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8806699b-3cfc-4d52-81a0-ad6feeafb9a4 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:39.198495 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1457/2920] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 18:12:39 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:12:39.202799 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ded0c-f663-40fb-bb7e-442d8c771d30 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:39.213187 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ded0c-f663-40fb-bb7e-442d8c771d30 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:39.217780 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff2016-0332-4f2d-b235-e0c4e20f5b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:39.218371 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff2016-0332-4f2d-b235-e0c4e20f5b52 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:39.218649 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff2016-0332-4f2d-b235-e0c4e20f5b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:39.218918 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff2016-0332-4f2d-b235-e0c4e20f5b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:39.219544 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff2016-0332-4f2d-b235-e0c4e20f5b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:39.221681 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff2016-0332-4f2d-b235-e0c4e20f5b52 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:39.231512 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1464/2921] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:12:39.235343 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806699b-3cfc-4d52-81a0-ad6feeafb9a4 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:39.246977 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806699b-3cfc-4d52-81a0-ad6feeafb9a4 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:39.252591 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3c863-eed7-4399-9574-1f226bc79000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:39.253227 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3c863-eed7-4399-9574-1f226bc79000 admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:39.253509 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3c863-eed7-4399-9574-1f226bc79000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:39.253779 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3c863-eed7-4399-9574-1f226bc79000 admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:39.254423 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3c863-eed7-4399-9574-1f226bc79000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:39.256016 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3c863-eed7-4399-9574-1f226bc79000 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:39.267770 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1458/2922] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:12:39.272100 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff2016-0332-4f2d-b235-e0c4e20f5b52 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:39.281981 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff2016-0332-4f2d-b235-e0c4e20f5b52 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:39.287113 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c47cb-4a91-43a9-9e07-a4a5261bac69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:39.287753 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c47cb-4a91-43a9-9e07-a4a5261bac69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:39.288032 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c47cb-4a91-43a9-9e07-a4a5261bac69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:39.288303 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c47cb-4a91-43a9-9e07-a4a5261bac69 admin admin] PATH_INFO: `/v3/projects/903fa048f9594a66b46b7beae0bcf33e/users/b9106f53fb174759a5e2d427f9e136e5/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:39.303304 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c47cb-4a91-43a9-9e07-a4a5261bac69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=903fa048f9594a66b46b7beae0bcf33e, user_id=b9106f53fb174759a5e2d427f9e136e5, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:39.306008 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c47cb-4a91-43a9-9e07-a4a5261bac69 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:39.318817 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1465/2923] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:12:39 2022] PUT /identity/v3/projects/903fa048f9594a66b46b7beae0bcf33e/users/b9106f53fb174759a5e2d427f9e136e5/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:12:39.330690 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae171c1-7e51-41b0-a133-30f42d22e96d None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:39.330979 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae171c1-7e51-41b0-a133-30f42d22e96d None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:39.331250 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae171c1-7e51-41b0-a133-30f42d22e96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:39.359544 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-1ae171c1-7e51-41b0-a133-30f42d22e96d None None] MFA Rules not processed for user `b9106f53fb174759a5e2d427f9e136e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:12:39.360751 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-1ae171c1-7e51-41b0-a133-30f42d22e96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:39.425988 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1459/2924] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:12:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:12:39.437257 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c47cb-4a91-43a9-9e07-a4a5261bac69 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:39.438955 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-f37c47cb-4a91-43a9-9e07-a4a5261bac69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:39.495198 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c47cb-4a91-43a9-9e07-a4a5261bac69 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:39.498774 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0f140-1491-453c-9fb7-895856f2136a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:39.499374 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0f140-1491-453c-9fb7-895856f2136a service cinder] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:39.499655 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0f140-1491-453c-9fb7-895856f2136a service cinder] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:39.499926 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0f140-1491-453c-9fb7-895856f2136a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:39.508202 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0f140-1491-453c-9fb7-895856f2136a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:39.509665 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0f140-1491-453c-9fb7-895856f2136a service cinder] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:39.518841 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1466/2925] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:12:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:12:39.547086 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae171c1-7e51-41b0-a133-30f42d22e96d None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:39.610437 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae171c1-7e51-41b0-a133-30f42d22e96d None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:39.615220 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f7b00-cf35-4a0d-9d6d-e893f7215508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:39.615876 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f7b00-cf35-4a0d-9d6d-e893f7215508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:39.616154 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f7b00-cf35-4a0d-9d6d-e893f7215508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:39.616440 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f7b00-cf35-4a0d-9d6d-e893f7215508 admin admin] PATH_INFO: `/v3/users/b9106f53fb174759a5e2d427f9e136e5` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:39.617608 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f7b00-cf35-4a0d-9d6d-e893f7215508 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9106f53fb174759a5e2d427f9e136e5)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:39.619525 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f7b00-cf35-4a0d-9d6d-e893f7215508 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:39.624122 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:39.668666 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-343f7b00-cf35-4a0d-9d6d-e893f7215508 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9106f53fb174759a5e2d427f9e136e5'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:39.669370 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-343f7b00-cf35-4a0d-9d6d-e893f7215508 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9106f53fb174759a5e2d427f9e136e5'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:39.669967 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-343f7b00-cf35-4a0d-9d6d-e893f7215508 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9106f53fb174759a5e2d427f9e136e5'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:39.676807 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-343f7b00-cf35-4a0d-9d6d-e893f7215508 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9106f53fb174759a5e2d427f9e136e5'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:39.684252 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-343f7b00-cf35-4a0d-9d6d-e893f7215508 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9106f53fb174759a5e2d427f9e136e5'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:39.702274 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1460/2926] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 18:12:39 2022] DELETE /identity/v3/users/b9106f53fb174759a5e2d427f9e136e5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:12:39.707336 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26379d-5905-41f9-b532-1c7d9286edac None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:39.707628 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26379d-5905-41f9-b532-1c7d9286edac None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:39.707925 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26379d-5905-41f9-b532-1c7d9286edac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:39.726698 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-cd26379d-5905-41f9-b532-1c7d9286edac None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:12:39.727904 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-cd26379d-5905-41f9-b532-1c7d9286edac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:39.736115 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:39.788977 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1467/2927] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:12:39.800397 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f7b00-cf35-4a0d-9d6d-e893f7215508 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:39.800397 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-343f7b00-cf35-4a0d-9d6d-e893f7215508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:39.859251 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f7b00-cf35-4a0d-9d6d-e893f7215508 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:39.863057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314e635-b21c-476e-98da-53a1ccf52f9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:39.863664 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314e635-b21c-476e-98da-53a1ccf52f9a service neutron] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:39.863940 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314e635-b21c-476e-98da-53a1ccf52f9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:39.864211 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314e635-b21c-476e-98da-53a1ccf52f9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:39.873280 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314e635-b21c-476e-98da-53a1ccf52f9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:39.874711 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314e635-b21c-476e-98da-53a1ccf52f9a service neutron] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:39.884463 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1461/2928] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:12:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 18:12:40.155279 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26379d-5905-41f9-b532-1c7d9286edac None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:40.156832 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-cd26379d-5905-41f9-b532-1c7d9286edac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:40.168810 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26379d-5905-41f9-b532-1c7d9286edac None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:40.173951 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e924c9-6fbe-46c8-bbbc-ffc5b397e811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:40.174628 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e924c9-6fbe-46c8-bbbc-ffc5b397e811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:40.175002 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e924c9-6fbe-46c8-bbbc-ffc5b397e811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:40.175276 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e924c9-6fbe-46c8-bbbc-ffc5b397e811 admin admin] PATH_INFO: `/v3/projects/903fa048f9594a66b46b7beae0bcf33e` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:40.176446 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e924c9-6fbe-46c8-bbbc-ffc5b397e811 admin admin] RBAC: Authorizing `identity:delete_project(project_id=903fa048f9594a66b46b7beae0bcf33e)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:40.178398 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e924c9-6fbe-46c8-bbbc-ffc5b397e811 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:40.225221 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-23e924c9-6fbe-46c8-bbbc-ffc5b397e811 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '903fa048f9594a66b46b7beae0bcf33e', 'request_id': 'req-23e924c9-6fbe-46c8-bbbc-ffc5b397e811'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:40.230599 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-23e924c9-6fbe-46c8-bbbc-ffc5b397e811 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '903fa048f9594a66b46b7beae0bcf33e', 'request_id': 'req-23e924c9-6fbe-46c8-bbbc-ffc5b397e811'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:40.238389 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-23e924c9-6fbe-46c8-bbbc-ffc5b397e811 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '903fa048f9594a66b46b7beae0bcf33e', 'request_id': 'req-23e924c9-6fbe-46c8-bbbc-ffc5b397e811'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:40.249644 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-23e924c9-6fbe-46c8-bbbc-ffc5b397e811 admin admin] The token cache is being invalidate because project 903fa048f9594a66b46b7beae0bcf33e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:12:40.249989 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-23e924c9-6fbe-46c8-bbbc-ffc5b397e811 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:40.250636 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-23e924c9-6fbe-46c8-bbbc-ffc5b397e811 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:40.252728 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1468/2929] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:12:40 2022] DELETE /identity/v3/projects/903fa048f9594a66b46b7beae0bcf33e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:12:40.257638 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571c6c3-c04d-43ee-b77b-ee331e50b953 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:40.258103 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571c6c3-c04d-43ee-b77b-ee331e50b953 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:40.258234 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571c6c3-c04d-43ee-b77b-ee331e50b953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:40.278320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-2571c6c3-c04d-43ee-b77b-ee331e50b953 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:12:40.279502 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-2571c6c3-c04d-43ee-b77b-ee331e50b953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:40.338888 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1462/2930] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:12:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:12:40.346624 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b86a6-2add-4956-8b77-d540c73fc5a5 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:40.346912 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b86a6-2add-4956-8b77-d540c73fc5a5 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:40.347188 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b86a6-2add-4956-8b77-d540c73fc5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:40.367364 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-c17b86a6-2add-4956-8b77-d540c73fc5a5 None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:12:40.368572 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-c17b86a6-2add-4956-8b77-d540c73fc5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:40.376597 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1469/2931] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:12:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:12:40.380753 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571c6c3-c04d-43ee-b77b-ee331e50b953 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:40.390717 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571c6c3-c04d-43ee-b77b-ee331e50b953 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:40.396935 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da8f45-51af-4dbd-a0e8-ac71c94fb46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:40.397568 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da8f45-51af-4dbd-a0e8-ac71c94fb46a admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:40.397842 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da8f45-51af-4dbd-a0e8-ac71c94fb46a admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:40.398109 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da8f45-51af-4dbd-a0e8-ac71c94fb46a admin admin] PATH_INFO: `/v3/domains` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:40.398751 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da8f45-51af-4dbd-a0e8-ac71c94fb46a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81278) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 18:12:40.399049 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da8f45-51af-4dbd-a0e8-ac71c94fb46a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:40.400657 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da8f45-51af-4dbd-a0e8-ac71c94fb46a admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:40.413902 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1463/2932] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Sep 26 18:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 18:12:40.417972 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b86a6-2add-4956-8b77-d540c73fc5a5 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:40.427853 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b86a6-2add-4956-8b77-d540c73fc5a5 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:40.432521 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464338dc-0614-44f7-afcc-148ef97590a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:40.433158 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464338dc-0614-44f7-afcc-148ef97590a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:40.433440 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464338dc-0614-44f7-afcc-148ef97590a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:40.433766 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464338dc-0614-44f7-afcc-148ef97590a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:40.434416 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464338dc-0614-44f7-afcc-148ef97590a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:40.436349 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464338dc-0614-44f7-afcc-148ef97590a5 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:40.466428 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1470/2933] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 18:12:40 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:12:40.470704 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da8f45-51af-4dbd-a0e8-ac71c94fb46a admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:40.480657 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da8f45-51af-4dbd-a0e8-ac71c94fb46a admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:40.489299 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:40.538536 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12699681-bbb6-4050-b52f-d3909d4b348d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:40.539137 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12699681-bbb6-4050-b52f-d3909d4b348d admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:40.539409 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12699681-bbb6-4050-b52f-d3909d4b348d admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:40.539673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12699681-bbb6-4050-b52f-d3909d4b348d admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:40.540306 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12699681-bbb6-4050-b52f-d3909d4b348d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:40.542237 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12699681-bbb6-4050-b52f-d3909d4b348d admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:40.562909 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1464/2934] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 18:12:40 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:12:40.567685 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464338dc-0614-44f7-afcc-148ef97590a5 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:40.578097 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464338dc-0614-44f7-afcc-148ef97590a5 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:40.583328 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ff05a-01c8-454e-8bd2-1822cf2d984b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:40.584188 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ff05a-01c8-454e-8bd2-1822cf2d984b admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:40.584465 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ff05a-01c8-454e-8bd2-1822cf2d984b admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:40.584736 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ff05a-01c8-454e-8bd2-1822cf2d984b admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:40.585411 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ff05a-01c8-454e-8bd2-1822cf2d984b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:40.586995 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ff05a-01c8-454e-8bd2-1822cf2d984b admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:40.596983 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1471/2935] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:12:40.600899 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12699681-bbb6-4050-b52f-d3909d4b348d admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:40.610713 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12699681-bbb6-4050-b52f-d3909d4b348d admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:40.615269 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275d3b4-cafc-4238-a400-8ddb2045657e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:40.615857 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275d3b4-cafc-4238-a400-8ddb2045657e admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:40.616161 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275d3b4-cafc-4238-a400-8ddb2045657e admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:40.616405 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275d3b4-cafc-4238-a400-8ddb2045657e admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:40.617057 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1275d3b4-cafc-4238-a400-8ddb2045657e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:40.618655 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1275d3b4-cafc-4238-a400-8ddb2045657e admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:40.630324 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1465/2936] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:12:40.634469 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ff05a-01c8-454e-8bd2-1822cf2d984b admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:40.645287 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ff05a-01c8-454e-8bd2-1822cf2d984b admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:40.650054 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11a689-9feb-41a5-b798-6688e14d2f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:40.650701 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11a689-9feb-41a5-b798-6688e14d2f63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:40.650983 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11a689-9feb-41a5-b798-6688e14d2f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:40.651280 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11a689-9feb-41a5-b798-6688e14d2f63 admin admin] PATH_INFO: `/v3/projects/22aac373bdac440e81521a6b864f3f63/users/cd8d3ddfd3c2454b9436f2630f7cf7ca/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:40.666013 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db11a689-9feb-41a5-b798-6688e14d2f63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22aac373bdac440e81521a6b864f3f63, user_id=cd8d3ddfd3c2454b9436f2630f7cf7ca, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:40.668672 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db11a689-9feb-41a5-b798-6688e14d2f63 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:40.682026 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1472/2937] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:12:40 2022] PUT /identity/v3/projects/22aac373bdac440e81521a6b864f3f63/users/cd8d3ddfd3c2454b9436f2630f7cf7ca/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:12:40.693896 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc74da8-7139-4a32-9f65-2f8576b03e3f None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:40.694186 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc74da8-7139-4a32-9f65-2f8576b03e3f None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:40.694461 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc74da8-7139-4a32-9f65-2f8576b03e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:40.722721 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-5dc74da8-7139-4a32-9f65-2f8576b03e3f None None] MFA Rules not processed for user `cd8d3ddfd3c2454b9436f2630f7cf7ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:12:40.723974 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-5dc74da8-7139-4a32-9f65-2f8576b03e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:40.787099 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1466/2938] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:12:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:12:40.791700 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11a689-9feb-41a5-b798-6688e14d2f63 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:40.825501 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:40.854515 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11a689-9feb-41a5-b798-6688e14d2f63 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:40.859113 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0877ec-4782-4e7b-b72c-7d1d63c6af54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:40.859709 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0877ec-4782-4e7b-b72c-7d1d63c6af54 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:40.859988 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0877ec-4782-4e7b-b72c-7d1d63c6af54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:40.860257 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0877ec-4782-4e7b-b72c-7d1d63c6af54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:40.861436 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0877ec-4782-4e7b-b72c-7d1d63c6af54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:40.863329 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0877ec-4782-4e7b-b72c-7d1d63c6af54 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:40.889765 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1473/2939] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 18:12:40 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:12:40.893810 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc74da8-7139-4a32-9f65-2f8576b03e3f None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:40.904252 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc74da8-7139-4a32-9f65-2f8576b03e3f None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:40.960784 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab00131-2857-47dd-bb88-22e25cef98b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:40.961419 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab00131-2857-47dd-bb88-22e25cef98b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:40.961697 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab00131-2857-47dd-bb88-22e25cef98b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:40.961964 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab00131-2857-47dd-bb88-22e25cef98b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:40.962600 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab00131-2857-47dd-bb88-22e25cef98b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:40.964512 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab00131-2857-47dd-bb88-22e25cef98b6 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:40.985961 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1467/2940] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 18:12:40 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:12:40.989998 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0877ec-4782-4e7b-b72c-7d1d63c6af54 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:41.000352 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0877ec-4782-4e7b-b72c-7d1d63c6af54 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:41.005032 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864df19b-e978-45b8-9ed2-28d305683cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:41.005639 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864df19b-e978-45b8-9ed2-28d305683cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:41.005899 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864df19b-e978-45b8-9ed2-28d305683cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:41.006171 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864df19b-e978-45b8-9ed2-28d305683cd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:41.006802 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864df19b-e978-45b8-9ed2-28d305683cd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:41.008685 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864df19b-e978-45b8-9ed2-28d305683cd6 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:41.019649 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1474/2941] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:12:41.023584 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab00131-2857-47dd-bb88-22e25cef98b6 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:41.033950 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab00131-2857-47dd-bb88-22e25cef98b6 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:41.038479 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4af16-a543-473f-9f49-513830748ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:41.039063 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4af16-a543-473f-9f49-513830748ccf admin admin] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:41.039337 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4af16-a543-473f-9f49-513830748ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:41.039599 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4af16-a543-473f-9f49-513830748ccf admin admin] PATH_INFO: `/v3/roles` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:41.040225 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4af16-a543-473f-9f49-513830748ccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:41.041824 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4af16-a543-473f-9f49-513830748ccf admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:41.046883 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:41.052102 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1468/2942] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:12:41.056220 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864df19b-e978-45b8-9ed2-28d305683cd6 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:41.066012 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864df19b-e978-45b8-9ed2-28d305683cd6 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:41.070553 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e886c-10ff-44cf-ad8f-8203d8eab97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:41.071192 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e886c-10ff-44cf-ad8f-8203d8eab97d admin admin] REQUEST_METHOD: `PUT` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:41.071470 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e886c-10ff-44cf-ad8f-8203d8eab97d admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:41.071741 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e886c-10ff-44cf-ad8f-8203d8eab97d admin admin] PATH_INFO: `/v3/projects/05b3efd8be8648c384d38a0bd577c163/users/3e9ecf5016c34e82971a27b5ff243029/roles/b4593720c06e4a0db655f8e33079a15f` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:41.087084 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e886c-10ff-44cf-ad8f-8203d8eab97d admin admin] RBAC: Authorizing `identity:create_grant(project_id=05b3efd8be8648c384d38a0bd577c163, user_id=3e9ecf5016c34e82971a27b5ff243029, role_id=b4593720c06e4a0db655f8e33079a15f)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:41.089784 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e886c-10ff-44cf-ad8f-8203d8eab97d admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:41.103096 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1475/2943] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:12:41 2022] PUT /identity/v3/projects/05b3efd8be8648c384d38a0bd577c163/users/3e9ecf5016c34e82971a27b5ff243029/roles/b4593720c06e4a0db655f8e33079a15f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:12:41.113405 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a75a88-bd6d-4dbf-88b3-08a9476572d6 None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:41.113661 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a75a88-bd6d-4dbf-88b3-08a9476572d6 None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:41.113941 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a75a88-bd6d-4dbf-88b3-08a9476572d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:41.141338 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-d2a75a88-bd6d-4dbf-88b3-08a9476572d6 None None] MFA Rules not processed for user `3e9ecf5016c34e82971a27b5ff243029`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:12:41.143029 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-d2a75a88-bd6d-4dbf-88b3-08a9476572d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:41.205966 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1469/2944] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:12:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:12:41.210778 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e886c-10ff-44cf-ad8f-8203d8eab97d admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:41.273686 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e886c-10ff-44cf-ad8f-8203d8eab97d admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:41.278373 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d1d44d-45c6-43b3-8bf4-492edb680193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:41.278979 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1d44d-45c6-43b3-8bf4-492edb680193 admin admin] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:41.279256 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1d44d-45c6-43b3-8bf4-492edb680193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:41.279530 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1d44d-45c6-43b3-8bf4-492edb680193 admin admin] PATH_INFO: `/v3/projects` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:41.280198 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d1d44d-45c6-43b3-8bf4-492edb680193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:41.282267 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d1d44d-45c6-43b3-8bf4-492edb680193 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:41.310418 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1476/2945] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Sep 26 18:12:41 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:12:41.314663 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a75a88-bd6d-4dbf-88b3-08a9476572d6 None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:41.325352 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a75a88-bd6d-4dbf-88b3-08a9476572d6 None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:41.382400 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c6d6b-6b07-44ea-b794-a30aaf57ff32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:41.382994 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c6d6b-6b07-44ea-b794-a30aaf57ff32 admin admin] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:41.383180 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c6d6b-6b07-44ea-b794-a30aaf57ff32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:41.383447 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c6d6b-6b07-44ea-b794-a30aaf57ff32 admin admin] PATH_INFO: `/v3/users` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:41.384082 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c6d6b-6b07-44ea-b794-a30aaf57ff32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:41.386021 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c6d6b-6b07-44ea-b794-a30aaf57ff32 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:41.407231 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1470/2946] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Sep 26 18:12:41 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 18:12:41.411857 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d1d44d-45c6-43b3-8bf4-492edb680193 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:41.422128 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d1d44d-45c6-43b3-8bf4-492edb680193 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:41.427370 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce62fc-0c0e-468f-961e-8f90f4b8bd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:41.427963 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce62fc-0c0e-468f-961e-8f90f4b8bd96 admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:41.428243 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce62fc-0c0e-468f-961e-8f90f4b8bd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:41.428545 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce62fc-0c0e-468f-961e-8f90f4b8bd96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:41.429247 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce62fc-0c0e-468f-961e-8f90f4b8bd96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:41.430844 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce62fc-0c0e-468f-961e-8f90f4b8bd96 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:41.441713 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1477/2947] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:12:41.445844 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c6d6b-6b07-44ea-b794-a30aaf57ff32 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:41.455625 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c6d6b-6b07-44ea-b794-a30aaf57ff32 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:41.460487 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0be7b-f55d-4921-93df-4bc5ca262b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:41.461151 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0be7b-f55d-4921-93df-4bc5ca262b24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:41.461430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0be7b-f55d-4921-93df-4bc5ca262b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:41.461702 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0be7b-f55d-4921-93df-4bc5ca262b24 admin admin] PATH_INFO: `/v3/projects/430cb9ab5159443896c7ff905d48b2d9/users/ded57d3d3f9445c699e936fa6d59bff0/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:41.476684 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0be7b-f55d-4921-93df-4bc5ca262b24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=430cb9ab5159443896c7ff905d48b2d9, user_id=ded57d3d3f9445c699e936fa6d59bff0, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:41.479396 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0be7b-f55d-4921-93df-4bc5ca262b24 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:41.493233 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1471/2948] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:12:41 2022] PUT /identity/v3/projects/430cb9ab5159443896c7ff905d48b2d9/users/ded57d3d3f9445c699e936fa6d59bff0/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 18:12:41.497456 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce62fc-0c0e-468f-961e-8f90f4b8bd96 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:41.507958 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce62fc-0c0e-468f-961e-8f90f4b8bd96 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:41.558392 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:41.565781 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4a932-b2be-4321-8a60-b3b81e687e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:41.566384 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4a932-b2be-4321-8a60-b3b81e687e5c admin admin] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:41.566668 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4a932-b2be-4321-8a60-b3b81e687e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:41.566941 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4a932-b2be-4321-8a60-b3b81e687e5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:41.567575 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4a932-b2be-4321-8a60-b3b81e687e5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:41.569231 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4a932-b2be-4321-8a60-b3b81e687e5c admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:41.579123 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1478/2949] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Sep 26 18:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 18:12:41.584224 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0be7b-f55d-4921-93df-4bc5ca262b24 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:41.594745 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0be7b-f55d-4921-93df-4bc5ca262b24 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:41.599957 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae11f9-6057-41a7-a40f-c506afd0dc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:41.600671 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae11f9-6057-41a7-a40f-c506afd0dc0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:41.600946 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae11f9-6057-41a7-a40f-c506afd0dc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:41.601251 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae11f9-6057-41a7-a40f-c506afd0dc0b admin admin] PATH_INFO: `/v3/projects/430cb9ab5159443896c7ff905d48b2d9/users/ded57d3d3f9445c699e936fa6d59bff0/roles/be6ee971abf54b26be509c14823ece55` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:41.603151 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae11f9-6057-41a7-a40f-c506afd0dc0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=430cb9ab5159443896c7ff905d48b2d9, user_id=ded57d3d3f9445c699e936fa6d59bff0, role_id=be6ee971abf54b26be509c14823ece55)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:41.605813 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae11f9-6057-41a7-a40f-c506afd0dc0b admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:41.615844 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1472/2950] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Sep 26 18:12:41 2022] PUT /identity/v3/projects/430cb9ab5159443896c7ff905d48b2d9/users/ded57d3d3f9445c699e936fa6d59bff0/roles/be6ee971abf54b26be509c14823ece55 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:12:41.625878 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecdd86-9978-48ca-92eb-e3a766234946 None None] REQUEST_METHOD: `POST` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:41.626169 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecdd86-9978-48ca-92eb-e3a766234946 None None] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:41.626595 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecdd86-9978-48ca-92eb-e3a766234946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:41.654540 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.auth.core [None req-ceecdd86-9978-48ca-92eb-e3a766234946 None None] MFA Rules not processed for user `ded57d3d3f9445c699e936fa6d59bff0`. Rule list: `[]` (Enabled: `True`). {{(pid=81277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:12:41.655681 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-ceecdd86-9978-48ca-92eb-e3a766234946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:41.723990 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1479/2951] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:12:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:12:41.735834 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae11f9-6057-41a7-a40f-c506afd0dc0b admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:41.737559 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-1aae11f9-6057-41a7-a40f-c506afd0dc0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:41.783987 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:41.796698 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae11f9-6057-41a7-a40f-c506afd0dc0b admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:41.800446 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91409924-f85b-4634-96dd-da41b53b028a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:41.801073 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91409924-f85b-4634-96dd-da41b53b028a service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:41.801368 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91409924-f85b-4634-96dd-da41b53b028a service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:41.801654 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91409924-f85b-4634-96dd-da41b53b028a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:41.858238 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91409924-f85b-4634-96dd-da41b53b028a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:41.859682 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91409924-f85b-4634-96dd-da41b53b028a service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:41.868568 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1473/2952] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:12:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:12:43.372742 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceecdd86-9978-48ca-92eb-e3a766234946 None None] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:43.374199 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-ceecdd86-9978-48ca-92eb-e3a766234946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:43.388286 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceecdd86-9978-48ca-92eb-e3a766234946 None None] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:43.392247 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5fdd8f-0a8c-41bb-ae6c-98933aba48de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:43.392871 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fdd8f-0a8c-41bb-ae6c-98933aba48de service cinder] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:43.393186 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fdd8f-0a8c-41bb-ae6c-98933aba48de service cinder] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:43.393711 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fdd8f-0a8c-41bb-ae6c-98933aba48de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:43.451061 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5fdd8f-0a8c-41bb-ae6c-98933aba48de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:43.452398 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5fdd8f-0a8c-41bb-ae6c-98933aba48de service cinder] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:43.462158 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1480/2953] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:12:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:12:43.980056 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91409924-f85b-4634-96dd-da41b53b028a service cinder] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:43.989354 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91409924-f85b-4634-96dd-da41b53b028a service cinder] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:43.992934 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e6261-83b3-4f5c-b00f-7b3eddc05fda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b32df88c21499d9ca81e439b129431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:43.993563 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e6261-83b3-4f5c-b00f-7b3eddc05fda service cinder] REQUEST_METHOD: `GET` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:43.993839 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e6261-83b3-4f5c-b00f-7b3eddc05fda service cinder] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:43.994107 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e6261-83b3-4f5c-b00f-7b3eddc05fda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:44.003876 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e6261-83b3-4f5c-b00f-7b3eddc05fda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:44.005332 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e6261-83b3-4f5c-b00f-7b3eddc05fda service cinder] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:44.014676 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1474/2954] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:12:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:12:47.919123 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5fdd8f-0a8c-41bb-ae6c-98933aba48de service cinder] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:47.981246 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5fdd8f-0a8c-41bb-ae6c-98933aba48de service cinder] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:47.986361 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f07ad-6ccb-43e0-8797-8044807120f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:47.986988 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f07ad-6ccb-43e0-8797-8044807120f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:47.987268 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f07ad-6ccb-43e0-8797-8044807120f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:47.987546 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f07ad-6ccb-43e0-8797-8044807120f2 admin admin] PATH_INFO: `/v3/users/cd8d3ddfd3c2454b9436f2630f7cf7ca` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:47.988696 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f07ad-6ccb-43e0-8797-8044807120f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd8d3ddfd3c2454b9436f2630f7cf7ca)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:47.990652 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f07ad-6ccb-43e0-8797-8044807120f2 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:48.011961 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:48.037898 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-ce7f07ad-6ccb-43e0-8797-8044807120f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd8d3ddfd3c2454b9436f2630f7cf7ca'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:48.045255 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-ce7f07ad-6ccb-43e0-8797-8044807120f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd8d3ddfd3c2454b9436f2630f7cf7ca'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:48.045875 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-ce7f07ad-6ccb-43e0-8797-8044807120f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd8d3ddfd3c2454b9436f2630f7cf7ca'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:48.046481 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-ce7f07ad-6ccb-43e0-8797-8044807120f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd8d3ddfd3c2454b9436f2630f7cf7ca'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:48.054040 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-ce7f07ad-6ccb-43e0-8797-8044807120f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd8d3ddfd3c2454b9436f2630f7cf7ca'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:48.071140 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1481/2955] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 18:12:47 2022] DELETE /identity/v3/users/cd8d3ddfd3c2454b9436f2630f7cf7ca => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:12:48.075827 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ffbeb-8ef2-430e-a879-a29d200d2aad None None] REQUEST_METHOD: `POST` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:48.076314 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ffbeb-8ef2-430e-a879-a29d200d2aad None None] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:48.076430 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ffbeb-8ef2-430e-a879-a29d200d2aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:48.096056 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.auth.core [None req-7a3ffbeb-8ef2-430e-a879-a29d200d2aad None None] MFA Rules not processed for user `7155e9699cdb4b3f90bd34118e45f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81278) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 18:12:48.097320 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-7a3ffbeb-8ef2-430e-a879-a29d200d2aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:48.155315 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1475/2956] 10.222.0.62 () {58 vars in 958 bytes} [Mon Sep 26 18:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 18:12:48.164923 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f07ad-6ccb-43e0-8797-8044807120f2 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:48.166335 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-ce7f07ad-6ccb-43e0-8797-8044807120f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:48.223488 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f07ad-6ccb-43e0-8797-8044807120f2 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:48.227115 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df8a30-75f8-4f2e-b745-5b2bafc3c98d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0ed50f4edcf468192a053b1e0fd6910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:48.227710 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df8a30-75f8-4f2e-b745-5b2bafc3c98d service neutron] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:48.227984 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df8a30-75f8-4f2e-b745-5b2bafc3c98d service neutron] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:48.228251 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df8a30-75f8-4f2e-b745-5b2bafc3c98d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:48.237121 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df8a30-75f8-4f2e-b745-5b2bafc3c98d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:48.238531 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df8a30-75f8-4f2e-b745-5b2bafc3c98d service neutron] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:48.247815 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1482/2957] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:12:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:12:48.517423 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ffbeb-8ef2-430e-a879-a29d200d2aad None None] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:48.518897 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-7a3ffbeb-8ef2-430e-a879-a29d200d2aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:48.532829 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ffbeb-8ef2-430e-a879-a29d200d2aad None None] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:48.537697 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e7f145-9e5c-4bd3-991f-52732c8b5378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:48.538881 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7f145-9e5c-4bd3-991f-52732c8b5378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:48.539161 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7f145-9e5c-4bd3-991f-52732c8b5378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:48.539603 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7f145-9e5c-4bd3-991f-52732c8b5378 admin admin] PATH_INFO: `/v3/projects/22aac373bdac440e81521a6b864f3f63` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:48.540743 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e7f145-9e5c-4bd3-991f-52732c8b5378 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22aac373bdac440e81521a6b864f3f63)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:48.542894 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e7f145-9e5c-4bd3-991f-52732c8b5378 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:48.591171 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-82e7f145-9e5c-4bd3-991f-52732c8b5378 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22aac373bdac440e81521a6b864f3f63', 'request_id': 'req-82e7f145-9e5c-4bd3-991f-52732c8b5378'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:48.596641 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-82e7f145-9e5c-4bd3-991f-52732c8b5378 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22aac373bdac440e81521a6b864f3f63', 'request_id': 'req-82e7f145-9e5c-4bd3-991f-52732c8b5378'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:48.603958 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-82e7f145-9e5c-4bd3-991f-52732c8b5378 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22aac373bdac440e81521a6b864f3f63', 'request_id': 'req-82e7f145-9e5c-4bd3-991f-52732c8b5378'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:48.615659 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-82e7f145-9e5c-4bd3-991f-52732c8b5378 admin admin] The token cache is being invalidate because project 22aac373bdac440e81521a6b864f3f63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:12:48.615949 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-82e7f145-9e5c-4bd3-991f-52732c8b5378 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:48.616584 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-82e7f145-9e5c-4bd3-991f-52732c8b5378 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:48.618101 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1476/2958] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:12:48 2022] DELETE /identity/v3/projects/22aac373bdac440e81521a6b864f3f63 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:12:48.622113 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df8a30-75f8-4f2e-b745-5b2bafc3c98d service neutron] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:48.632325 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df8a30-75f8-4f2e-b745-5b2bafc3c98d service neutron] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:48.686840 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097cfc3-57a6-4856-8081-cdd0721b9b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:48.687531 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097cfc3-57a6-4856-8081-cdd0721b9b55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:48.687810 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097cfc3-57a6-4856-8081-cdd0721b9b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:48.688088 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097cfc3-57a6-4856-8081-cdd0721b9b55 admin admin] PATH_INFO: `/v3/users/3e9ecf5016c34e82971a27b5ff243029` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:48.689921 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5097cfc3-57a6-4856-8081-cdd0721b9b55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e9ecf5016c34e82971a27b5ff243029)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:48.691892 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5097cfc3-57a6-4856-8081-cdd0721b9b55 admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:48.733090 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:48.739844 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-5097cfc3-57a6-4856-8081-cdd0721b9b55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e9ecf5016c34e82971a27b5ff243029'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:48.748411 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-5097cfc3-57a6-4856-8081-cdd0721b9b55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e9ecf5016c34e82971a27b5ff243029'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:48.749058 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-5097cfc3-57a6-4856-8081-cdd0721b9b55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e9ecf5016c34e82971a27b5ff243029'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:48.749665 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-5097cfc3-57a6-4856-8081-cdd0721b9b55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e9ecf5016c34e82971a27b5ff243029'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:48.756672 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-5097cfc3-57a6-4856-8081-cdd0721b9b55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e9ecf5016c34e82971a27b5ff243029'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:48.776175 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1483/2959] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 18:12:48 2022] DELETE /identity/v3/users/3e9ecf5016c34e82971a27b5ff243029 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 18:12:49.047510 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e7f145-9e5c-4bd3-991f-52732c8b5378 admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:49.049702 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-82e7f145-9e5c-4bd3-991f-52732c8b5378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:49.063386 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e7f145-9e5c-4bd3-991f-52732c8b5378 admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:49.067475 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:49.129784 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713bf6c-8493-4f1b-b408-fa608a09dbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:49.130514 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713bf6c-8493-4f1b-b408-fa608a09dbea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:49.130669 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713bf6c-8493-4f1b-b408-fa608a09dbea admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:49.130937 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713bf6c-8493-4f1b-b408-fa608a09dbea admin admin] PATH_INFO: `/v3/projects/05b3efd8be8648c384d38a0bd577c163` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:49.132077 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713bf6c-8493-4f1b-b408-fa608a09dbea admin admin] RBAC: Authorizing `identity:delete_project(project_id=05b3efd8be8648c384d38a0bd577c163)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:49.134025 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713bf6c-8493-4f1b-b408-fa608a09dbea admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:49.180933 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-6713bf6c-8493-4f1b-b408-fa608a09dbea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05b3efd8be8648c384d38a0bd577c163', 'request_id': 'req-6713bf6c-8493-4f1b-b408-fa608a09dbea'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:49.186341 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-6713bf6c-8493-4f1b-b408-fa608a09dbea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05b3efd8be8648c384d38a0bd577c163', 'request_id': 'req-6713bf6c-8493-4f1b-b408-fa608a09dbea'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:49.193639 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-6713bf6c-8493-4f1b-b408-fa608a09dbea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05b3efd8be8648c384d38a0bd577c163', 'request_id': 'req-6713bf6c-8493-4f1b-b408-fa608a09dbea'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:49.205827 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-6713bf6c-8493-4f1b-b408-fa608a09dbea admin admin] The token cache is being invalidate because project 05b3efd8be8648c384d38a0bd577c163 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:12:49.206113 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-6713bf6c-8493-4f1b-b408-fa608a09dbea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:49.206736 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-6713bf6c-8493-4f1b-b408-fa608a09dbea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:49.208202 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1477/2960] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:12:49 2022] DELETE /identity/v3/projects/05b3efd8be8648c384d38a0bd577c163 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:12:49.212535 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097cfc3-57a6-4856-8081-cdd0721b9b55 admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:49.213937 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-5097cfc3-57a6-4856-8081-cdd0721b9b55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:49.227095 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097cfc3-57a6-4856-8081-cdd0721b9b55 admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:49.283169 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ecd1ce-c6cf-408e-babc-29b502d9d41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:49.283711 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ecd1ce-c6cf-408e-babc-29b502d9d41e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:49.283986 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ecd1ce-c6cf-408e-babc-29b502d9d41e admin admin] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:49.284253 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ecd1ce-c6cf-408e-babc-29b502d9d41e admin admin] PATH_INFO: `/v3/users/ded57d3d3f9445c699e936fa6d59bff0` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:49.285396 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ecd1ce-c6cf-408e-babc-29b502d9d41e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ded57d3d3f9445c699e936fa6d59bff0)` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:49.287360 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ecd1ce-c6cf-408e-babc-29b502d9d41e admin admin] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:49.333932 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-a2ecd1ce-c6cf-408e-babc-29b502d9d41e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ded57d3d3f9445c699e936fa6d59bff0'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:49.342759 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-a2ecd1ce-c6cf-408e-babc-29b502d9d41e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ded57d3d3f9445c699e936fa6d59bff0'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:49.343499 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-a2ecd1ce-c6cf-408e-babc-29b502d9d41e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ded57d3d3f9445c699e936fa6d59bff0'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:49.344219 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-a2ecd1ce-c6cf-408e-babc-29b502d9d41e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ded57d3d3f9445c699e936fa6d59bff0'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:49.351622 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.notifications [None req-a2ecd1ce-c6cf-408e-babc-29b502d9d41e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ded57d3d3f9445c699e936fa6d59bff0'} {{(pid=81277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:49.369062 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1484/2961] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Sep 26 18:12:49 2022] DELETE /identity/v3/users/ded57d3d3f9445c699e936fa6d59bff0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:12:49.639645 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713bf6c-8493-4f1b-b408-fa608a09dbea admin admin] Authenticating user token {{(pid=81278) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:12:49.641109 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.fernet_utils [None req-6713bf6c-8493-4f1b-b408-fa608a09dbea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81278) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:12:49.653937 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713bf6c-8493-4f1b-b408-fa608a09dbea admin admin] Validating token access rules against request {{(pid=81278) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:12:49.711449 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c0ba7-a22f-40d4-a816-a2162ce59881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7155e9699cdb4b3f90bd34118e45f2bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068ad96e90d940c6a9455251dbef5ca0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81278) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:12:49.712072 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c0ba7-a22f-40d4-a816-a2162ce59881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:12:49.712344 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c0ba7-a22f-40d4-a816-a2162ce59881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:12:49.712609 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c0ba7-a22f-40d4-a816-a2162ce59881 admin admin] PATH_INFO: `/v3/projects/430cb9ab5159443896c7ff905d48b2d9` {{(pid=81278) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:12:49.713730 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883c0ba7-a22f-40d4-a816-a2162ce59881 admin admin] RBAC: Authorizing `identity:delete_project(project_id=430cb9ab5159443896c7ff905d48b2d9)` {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:12:49.715624 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883c0ba7-a22f-40d4-a816-a2162ce59881 admin admin] RBAC: Authorization granted {{(pid=81278) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:12:49.755587 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:49.764416 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-883c0ba7-a22f-40d4-a816-a2162ce59881 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '430cb9ab5159443896c7ff905d48b2d9', 'request_id': 'req-883c0ba7-a22f-40d4-a816-a2162ce59881'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:49.769899 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-883c0ba7-a22f-40d4-a816-a2162ce59881 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '430cb9ab5159443896c7ff905d48b2d9', 'request_id': 'req-883c0ba7-a22f-40d4-a816-a2162ce59881'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:49.777257 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-883c0ba7-a22f-40d4-a816-a2162ce59881 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '430cb9ab5159443896c7ff905d48b2d9', 'request_id': 'req-883c0ba7-a22f-40d4-a816-a2162ce59881'} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:49.789582 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-883c0ba7-a22f-40d4-a816-a2162ce59881 admin admin] The token cache is being invalidate because project 430cb9ab5159443896c7ff905d48b2d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81278) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 18:12:49.790022 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-883c0ba7-a22f-40d4-a816-a2162ce59881 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:49.790673 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG keystone.notifications [None req-883c0ba7-a22f-40d4-a816-a2162ce59881 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81278) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 18:12:49.792152 dv-cinder-859318-1-smb devstack@keystone.service[81278]: [pid: 81278|app: 0|req: 1478/2962] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Sep 26 18:12:49 2022] DELETE /identity/v3/projects/430cb9ab5159443896c7ff905d48b2d9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 18:12:59.365678 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=67,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:12:59.786476 dv-cinder-859318-1-smb devstack@keystone.service[81278]: DEBUG dbcounter [-] [81278] Writing DB stats keystone:SELECT=10,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 18:14:58.000922 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ecd1ce-c6cf-408e-babc-29b502d9d41e admin admin] Authenticating user token {{(pid=81277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 18:14:58.002401 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-a2ecd1ce-c6cf-408e-babc-29b502d9d41e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:14:58.139527 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ecd1ce-c6cf-408e-babc-29b502d9d41e admin admin] Validating token access rules against request {{(pid=81277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 18:14:58.197507 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51797c-3fc0-4813-a9c4-86913ac84e9c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5043d835c08458c9f3911a4741bdaa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '125361b23eb14b53aca5e0139919881e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 18:14:58.198117 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51797c-3fc0-4813-a9c4-86913ac84e9c service placement] REQUEST_METHOD: `GET` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 18:14:58.198399 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51797c-3fc0-4813-a9c4-86913ac84e9c service placement] SCRIPT_NAME: `/identity` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 18:14:58.198671 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51797c-3fc0-4813-a9c4-86913ac84e9c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 18:14:58.200951 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.fernet_utils [None req-7d51797c-3fc0-4813-a9c4-86913ac84e9c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 18:14:58.212369 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d51797c-3fc0-4813-a9c4-86913ac84e9c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 18:14:58.213983 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d51797c-3fc0-4813-a9c4-86913ac84e9c service placement] RBAC: Authorization granted {{(pid=81277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 18:14:58.224588 dv-cinder-859318-1-smb devstack@keystone.service[81277]: [pid: 81277|app: 0|req: 1485/2963] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Sep 26 18:14:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 18:15:08.220312 dv-cinder-859318-1-smb devstack@keystone.service[81277]: DEBUG dbcounter [-] [81277] Writing DB stats keystone:SELECT=89 {{(pid=81277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}